Started by upstream project "osmo-gsm-tester_build-osmo-nitb" build number 12985 originally caused by: Started by upstream project "master-openbsc" build number 13182 originally caused by: Started by timer Running as SYSTEM Building remotely on osmo-gsm-tester-prod (osmo-gsm-tester) in workspace /home/jenkins/workspace/osmo-gsm-tester_run-prod The recommended git tool is: NONE No credentials specified > git rev-parse --resolve-git-dir /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/.git # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url https://gerrit.osmocom.org/osmo-gsm-tester # timeout=10 Fetching upstream changes from https://gerrit.osmocom.org/osmo-gsm-tester > git --version # timeout=10 > git --version # 'git version 2.20.1' > git fetch --tags --force --progress -- https://gerrit.osmocom.org/osmo-gsm-tester +refs/heads/*:refs/remotes/origin/* # timeout=10 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10 Checking out Revision bfc438bb2b17f4129018768a1f7bab52f1e96750 (refs/remotes/origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Commit message: "templates: osmo-msc: modernize" > git rev-list --no-walk bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bsc" build number 17675 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts" build number 7507 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-ggsn" build number 6687 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hlr" build number 8711 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-mgw" build number 8956 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hnbgw" build number 2978 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-msc" build number 29296 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu" build number 5152 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-sgsn" build number 30079 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-trx" build number 4679 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-nitb" build number 12985 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-stp" build number 9252 Copied 2 artifacts from "osmo-gsm-tester_build-osmocom-bb" build number 4707 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-sysmo" build number 8038 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-sysmo" build number 5191 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-oc2g" build number 5534 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-oc2g" build number 3909 Copied 2 artifacts from "osmo-gsm-tester_build-open5gs" build number 8 Copied 2 artifacts from "osmo-gsm-tester_build-srslte" build number 19 [osmo-gsm-tester_run-prod] $ /bin/sh /tmp/jenkins9913536194708016053.sh + unlink osmo-gsm-tester/sysmocom/resources.conf + ln -s resources.conf.prod osmo-gsm-tester/sysmocom/resources.conf + PATH=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src:/usr/local/bin:/usr/bin:/bin:/usr/games ./osmo-gsm-tester/contrib/jenkins-run.sh + base=/home/jenkins/workspace/osmo-gsm-tester_run-prod + dirname -- ./osmo-gsm-tester/contrib/jenkins-run.sh + CDPATH= cd -- ./osmo-gsm-tester/contrib + pwd -P + SCRIPT_DIR=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib + OSMO_GSM_TESTER_CONF=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf + date +%F %T + time_start=2022-12-12 20:36:22 + trial_dir_prefix=trial- + rm -rf trial-2381 trial-2381-bin.tgz trial-2381-run.tgz + trial_dir=trial-2382 + mkdir -p trial-2382 + mv open5gs.build-8.tgz osmo-bsc.build-17675.tgz osmo-bts-oc2g.build-5534.tgz osmo-bts-sysmo.build-8038.tgz osmo-bts.build-7507.tgz osmo-ggsn.build-6687.tgz osmo-hlr.build-8711.tgz osmo-hnbgw.build-2978.tgz osmo-mgw.build-8956.tgz osmo-msc.build-29296.tgz osmo-nitb.build-12985.tgz osmo-pcu-oc2g.build-3909.tgz osmo-pcu-sysmo.build-5191.tgz osmo-pcu.build-5152.tgz osmo-sgsn.build-30079.tgz osmo-stp.build-9252.tgz osmo-trx.build-4679.tgz osmocom-bb.build-4707.tgz srslte.build-19.tgz trial-2382 + cat open5gs.build-8.md5 osmo-bsc.build-17675.md5 osmo-bts-oc2g.build-5534.md5 osmo-bts-sysmo.build-8038.md5 osmo-bts.build-7507.md5 osmo-ggsn.build-6687.md5 osmo-hlr.build-8711.md5 osmo-hnbgw.build-2978.md5 osmo-mgw.build-8956.md5 osmo-msc.build-29296.md5 osmo-nitb.build-12985.md5 osmo-pcu-oc2g.build-3909.md5 osmo-pcu-sysmo.build-5191.md5 osmo-pcu.build-5152.md5 osmo-sgsn.build-30079.md5 osmo-stp.build-9252.md5 osmo-trx.build-4679.md5 osmocom-bb.build-4707.md5 srslte.build-19.md5 + rm open5gs.build-8.md5 osmo-bsc.build-17675.md5 osmo-bts-oc2g.build-5534.md5 osmo-bts-sysmo.build-8038.md5 osmo-bts.build-7507.md5 osmo-ggsn.build-6687.md5 osmo-hlr.build-8711.md5 osmo-hnbgw.build-2978.md5 osmo-mgw.build-8956.md5 osmo-msc.build-29296.md5 osmo-nitb.build-12985.md5 osmo-pcu-oc2g.build-3909.md5 osmo-pcu-sysmo.build-5191.md5 osmo-pcu.build-5152.md5 osmo-sgsn.build-30079.md5 osmo-stp.build-9252.md5 osmo-trx.build-4679.md5 osmocom-bb.build-4707.md5 srslte.build-19.md5 + exit_code=1 + which osmo-gsm-tester.py + python3 -u /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo-gsm-tester.py -c /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf trial-2382 combinations: None trial: 'trial-2382' tests: None Running default suites: nitb_sms:sysmo sms:sysmo nitb_ussd:sysmo ussd:sysmo voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:sysmo+mod-bts0-dynts-osmo emergency:sysmo gprs:sysmo gprs:sysmo+mod-bts0-egprs gprs:sysmo+mod-bts0-dynts-ipa gprs:sysmo+mod-bts0-dynts-osmo dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:sysmo+mod-bts0-dynts67-osmo nitb_sms:oc2g sms:oc2g nitb_ussd:oc2g ussd:oc2g voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:oc2g+mod-bts0-dynts-osmo emergency:oc2g gprs:oc2g gprs:oc2g+mod-bts0-egprs gprs:oc2g+mod-bts0-dynts-ipa gprs:oc2g+mod-bts0-dynts-osmo dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:oc2g+mod-bts0-dynts67-osmo nitb_sms:trx-b200 sms:trx-b200 nitb_ussd:trx-b200 ussd:trx-b200 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-b200+mod-bts0-dynts-osmo voice:trx-b200+mod-bts0-trxdversion0 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-b200 gprs:trx-b200 gprs:trx-b200+mod-bts0-egprs gprs:trx-b200+mod-bts0-dynts-ipa gprs:trx-b200+mod-bts0-dynts-osmo gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-b200+mod-bts0-dynts67-osmo nitb_sms:trx-sysmocell5000 sms:trx-sysmocell5000 nitb_ussd:trx-sysmocell5000 ussd:trx-sysmocell5000 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-sysmocell5000+mod-bts0-dynts-osmo emergency:trx-sysmocell5000 gprs:trx-sysmocell5000 gprs:trx-sysmocell5000+mod-bts0-egprs gprs:trx-sysmocell5000+mod-bts0-dynts-ipa gprs:trx-sysmocell5000+mod-bts0-dynts-osmo dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo nitb_sms:trx-umtrx sms:trx-umtrx nitb_ussd:trx-umtrx ussd:trx-umtrx voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-umtrx+mod-bts0-dynts-osmo voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-umtrx gprs:trx-umtrx gprs:trx-umtrx+mod-bts0-egprs gprs:trx-umtrx+mod-bts0-dynts-ipa gprs:trx-umtrx+mod-bts0-dynts-osmo gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-umtrx+mod-bts0-dynts67-osmo nitb_sms:trx-lms sms:trx-lms nitb_ussd:trx-lms ussd:trx-lms voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms+mod-bts0-dynts-osmo emergency:trx-lms gprs:trx-lms gprs:trx-lms+mod-bts0-egprs gprs:trx-lms+mod-bts0-dynts-ipa gprs:trx-lms+mod-bts0-dynts-osmo dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms+mod-bts0-dynts67-osmo nitb_sms:trx-lms-limenet-micro sms:trx-lms-limenet-micro nitb_ussd:trx-lms-limenet-micro ussd:trx-lms-limenet-micro voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo emergency:trx-lms-limenet-micro gprs:trx-lms-limenet-micro gprs:trx-lms-limenet-micro+mod-bts0-egprs gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo nitb_sms:nanobts sms:nanobts+band-1900 nitb_ussd:nanobts+band-1900 ussd:nanobts+band-1900 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any emergency:nanobts+band-1900 gprs:nanobts+band-1900 gprs:nanobts+band-1900+mod-bts0-egprs gprs:nanobts+band-1900+mod-bts0-dynts-ipa dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any sms:nanobts+band-900 nitb_ussd:nanobts+band-900 ussd:nanobts+band-900 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:nanobts+band-900 gprs:nanobts+band-900 gprs:nanobts+band-900+mod-bts0-egprs gprs:nanobts+band-900+mod-bts0-dynts-ipa gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any nitb_smpp smpp encryption 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover_2G:nanobts+bts1-oc2g handover_2G:nanobts+bts1-octphy handover_2G:nanobts+bts1-trx-lms handover_2G:nanobts+bts1-trx-lms-limenet-micro handover_2G:nanobts+bts1-trx-sysmocell5000 handover_2G:nanobts+bts1-sysmo handover_2G:nanobts+bts1-trx-b200 handover_2G:nanobts+bts1-trx-umtrx handover_2G:oc2g+bts1-octphy handover_2G:oc2g+bts1-trx-lms handover_2G:oc2g+bts1-trx-lms-limenet-micro handover_2G:oc2g+bts1-trx-sysmocell5000 handover_2G:oc2g+bts1-sysmo handover_2G:oc2g+bts1-trx-b200 handover_2G:oc2g+bts1-trx-umtrx handover_2G:octphy+bts1-trx-lms handover_2G:octphy+bts1-trx-lms-limenet-micro handover_2G:octphy+bts1-trx-sysmocell5000 handover_2G:octphy+bts1-sysmo handover_2G:octphy+bts1-trx-b200 handover_2G:octphy+bts1-trx-umtrx handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover_2G:trx-lms+bts1-trx-sysmocell5000 handover_2G:trx-lms+bts1-sysmo handover_2G:trx-lms+bts1-trx-b200 handover_2G:trx-lms+bts1-trx-umtrx handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover_2G:trx-sysmocell5000+bts1-sysmo handover_2G:trx-sysmocell5000+bts1-trx-b200 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover_2G:sysmo+bts1-trx-b200 handover_2G:sysmo+bts1-trx-umtrx handover_2G:trx-b200+bts1-trx-umtrx -------------------------------------------------------------------------------------------- trial-2382 -------------------------------------------------------------------------------------------- 20:36:34.087949 tst trial-2382: Detailed log at /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/log --------------------------------------------------------------------- trial-2382 nitb_sms:sysmo --------------------------------------------------------------------- 20:38:40.908475 tst nitb_sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:38:40.912022 tst nitb_sms:sysmo: Verifying 1 x bts (candidates: 11) 20:38:40.932681 tst nitb_sms:sysmo: Verifying 1 x ip_address (candidates: 9) 20:38:40.940037 tst nitb_sms:sysmo: Verifying 2 x modem (candidates: 12) 20:38:40.994199 tst nitb_sms:sysmo: Reserving 1 x bts (candidates: 11) 20:38:41.015856 tst nitb_sms:sysmo: Reserving 1 x ip_address (candidates: 9) 20:38:41.022878 tst nitb_sms:sysmo: Reserving 2 x modem (candidates: 12) 20:38:41.559176 tst nitb_sms:sysmo: RESERVED RESOURCES for nitb_sms: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 nitb_sms:sysmo mo_mt_sms.py ---------------------------------------------- 20:38:41.564337 tst nitb_sms:sysmo: Using 1 x ip_address (candidates: 1) 20:38:41.575308 tst nitb_sms:sysmo: Using 1 x bts (candidates: 1) 20:38:41.949726 tst mo_mt_sms.py: using LAC 31359 20:38:42.188888 tst mo_mt_sms.py: using RAC 249 20:38:42.306718 tst mo_mt_sms.py: using CellId 31359 20:38:42.426480 tst mo_mt_sms.py: using BVCI 31360 20:38:42.537506 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 20:38:42.722160 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 20:38:42.842198 tst mo_mt_sms.py:9: start nitb and bts... 20:38:43.063694 run osmo-nitb_10.42.42.2: Starting osmo-nitb 20:38:45.420120 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24872): Launched 20:38:45.754675 run osmo-nitb_10.42.42.2(pid=24873): Launched 20:38:45.949944 run osmo-nitb_10.42.42.2(pid=24873): ERR: Terminated: ERROR {rc=2} [trial-2382↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24873)] 20:38:46.084768 run osmo-nitb_10.42.42.2(pid=24873): stdout: | (launched: 2022-12-12_20:38:45.692675) 20:38:46.219969 run osmo-nitb_10.42.42.2(pid=24873): stderr: | (launched: 2022-12-12_20:38:45.742293) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 20:38:46.383159 run osmo-nitb_10.42.42.2(pid=24873): stdout: | (launched: 2022-12-12_20:38:45.692675) 20:38:46.529461 run osmo-nitb_10.42.42.2(pid=24873): stderr: | (launched: 2022-12-12_20:38:45.742293) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 20:38:46.696097 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=24873): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24873) [trial-2382↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24873)] [trial-2382↪nitb_sms:sysmo↪mo_mt_sms.py:11] 20:38:46.706298 tst mo_mt_sms.py:11: Test FAILED (5.1 sec) 20:38:46.714037 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24872): Terminating (SIGTERM) 20:38:46.938288 --- ParallelTerminationStrategy: PID 24872 died... 20:38:46.969409 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24872): Terminated: ok {rc=0} 20:38:47.101298 bus /sierra_3: Setting Powered False 20:38:48.251464 bus /sierra_3: Setting Powered False 20:38:49.385581 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 nitb_sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 sms:sysmo --------------------------------------------------------------------- 20:38:50.572068 tst sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:38:50.576892 tst sms:sysmo: Verifying 1 x bts (candidates: 11) 20:38:50.599407 tst sms:sysmo: Verifying 6 x ip_address (candidates: 9) 20:38:50.627626 tst sms:sysmo: Verifying 2 x modem (candidates: 12) 20:38:50.680625 tst sms:sysmo: Reserving 1 x bts (candidates: 11) 20:38:50.702682 tst sms:sysmo: Reserving 6 x ip_address (candidates: 9) 20:38:50.730863 tst sms:sysmo: Reserving 2 x modem (candidates: 12) 20:38:51.278647 tst sms:sysmo: RESERVED RESOURCES for sms: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 sms:sysmo mo_mt_sms.py ---------------------------------------------- 20:38:51.285605 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 20:38:51.297407 tst sms:sysmo: Using 1 x bts (candidates: 1) 20:38:51.333856 tst mo_mt_sms.py: using LAC 31360 20:38:51.462403 tst mo_mt_sms.py: using RAC 250 20:38:51.590171 tst mo_mt_sms.py: using CellId 31360 20:38:51.714654 tst mo_mt_sms.py: using BVCI 31361 20:38:51.832876 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 20:38:51.844649 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 20:38:51.856423 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 20:38:51.869303 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 20:38:51.883254 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 20:38:51.894704 tst sms:sysmo: Using 1 x modem (candidates: 2) 20:38:52.017352 tst sms:sysmo: Using 1 x modem (candidates: 2) 20:38:52.143615 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:38:53.922592 run create_hlr_db(pid=25150): Launched 20:38:54.089638 bus /sierra_2: Setting Powered False 20:38:55.152802 run create_hlr_db(pid=25150): Terminated: ok {rc=0} 20:38:55.608788 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25152): Launched 20:38:55.946458 run osmo-hlr_10.42.42.2(pid=25153): Launched 20:38:56.199235 run osmo-stp_10.42.42.5: Starting osmo-stp 20:38:58.962254 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25155): Launched 20:38:59.301544 run osmo-stp_10.42.42.5(pid=25156): Launched 20:38:59.547036 run osmo-msc_10.42.42.6: Starting osmo-msc 20:39:05.312322 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25158): Launched 20:39:05.661606 run osmo-msc_10.42.42.6(pid=25159): Launched 20:39:06.036879 run osmo-stp_10.42.42.5(pid=25156): ERR: Terminated: ERROR {rc=1} [trial-2382↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25156)] 20:39:06.327860 run osmo-stp_10.42.42.5(pid=25156): stdout: | (launched: 2022-12-12_20:38:59.241340) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:39:06.500627 run osmo-stp_10.42.42.5(pid=25156): stderr: | 20221212203859582 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212203859583 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212203859583 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212203859583 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212203859584 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212203859584 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212203859584 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:39:06.643409 run osmo-stp_10.42.42.5(pid=25156): stdout: | (launched: 2022-12-12_20:38:59.241340) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:39:06.779424 run osmo-stp_10.42.42.5(pid=25156): stderr: | 20221212203859582 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212203859583 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212203859583 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212203859583 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212203859584 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212203859584 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212203859584 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:39:06.941664 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=25156): Process ended prematurely: osmo-stp_10.42.42.5(pid=25156) [trial-2382↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25156)] [trial-2382↪sms:sysmo↪mo_mt_sms.py:16] 20:39:06.951807 tst mo_mt_sms.py:16: Test FAILED (15.7 sec) 20:39:06.981857 run osmo-hlr_10.42.42.2(pid=25153): ERR: Terminated: ERROR {rc=237} [trial-2382↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25153)] 20:39:07.035650 run osmo-hlr_10.42.42.2(pid=25153): stdout: | (launched: 2022-12-12_20:38:55.885870) 20:39:07.091330 run osmo-hlr_10.42.42.2(pid=25153): stderr: | 20221212203856239 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212203856239 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212203856239 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212203856239 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212203856239 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212203856240 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212203856266 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/sms:sysmo/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212203856279 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212203856279 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212203856279 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:39:07.168263 run osmo-msc_10.42.42.6(pid=25159): ERR: Terminated: ERROR {rc=2} [trial-2382↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25159)] 20:39:07.221800 run osmo-msc_10.42.42.6(pid=25159): stdout: | (launched: 2022-12-12_20:39:05.599336) 20:39:07.277082 run osmo-msc_10.42.42.6(pid=25159): stderr: | 20221212203906105 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212203906105 DLGLOBAL DEBUG validating counter group 0x7f2e796cdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212203906105 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212203906105 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212203906106 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212203906106 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212203906107 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212203906108 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212203906108 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212203906108 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:39:07.332196 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25152): Terminating (SIGTERM) 20:39:07.376476 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25155): Terminating (SIGTERM) 20:39:07.420869 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25158): Terminating (SIGTERM) 20:39:07.466268 --- ParallelTerminationStrategy: PID 25152 died... 20:39:07.489102 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25152): Terminated: ok {rc=0} 20:39:07.540652 --- ParallelTerminationStrategy: PID 25155 died... 20:39:07.567209 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25155): Terminated: ok {rc=0} 20:39:07.693351 --- ParallelTerminationStrategy: PID 25158 died... 20:39:07.741546 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25158): Terminated: ok {rc=0} 20:39:07.919043 bus /sierra_3: Setting Powered False 20:39:09.035169 bus /sierra_3: Setting Powered False 20:39:10.154246 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 nitb_ussd:sysmo --------------------------------------------------------------------- 20:39:11.409926 tst nitb_ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:39:11.414157 tst nitb_ussd:sysmo: Verifying 1 x bts (candidates: 11) 20:39:11.436224 tst nitb_ussd:sysmo: Verifying 1 x ip_address (candidates: 9) 20:39:11.444047 tst nitb_ussd:sysmo: Verifying 1 x modem (candidates: 12) 20:39:11.478312 tst nitb_ussd:sysmo: Reserving 1 x bts (candidates: 11) 20:39:11.499201 tst nitb_ussd:sysmo: Reserving 1 x ip_address (candidates: 9) 20:39:11.505917 tst nitb_ussd:sysmo: Reserving 1 x modem (candidates: 12) 20:39:12.026023 tst nitb_ussd:sysmo: RESERVED RESOURCES for nitb_ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2382 nitb_ussd:sysmo assert_extension.py ---------------------------------------------- 20:39:12.031014 tst nitb_ussd:sysmo: Using 1 x ip_address (candidates: 1) 20:39:12.041846 tst nitb_ussd:sysmo: Using 1 x bts (candidates: 1) 20:39:12.077390 tst assert_extension.py: using LAC 31361 20:39:12.201587 tst assert_extension.py: using RAC 251 20:39:12.328445 tst assert_extension.py: using CellId 31361 20:39:12.449108 tst assert_extension.py: using BVCI 31362 20:39:12.562073 tst nitb_ussd:sysmo: Using 1 x modem (candidates: 1) 20:39:12.683288 tst assert_extension.py:10: start nitb and bts... 20:39:12.892832 run osmo-nitb_10.42.42.2: Starting osmo-nitb 20:39:13.527293 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25165): Launched 20:39:13.841430 run osmo-nitb_10.42.42.2(pid=25166): Launched 20:39:14.015152 run osmo-nitb_10.42.42.2(pid=25166): ERR: Terminated: ERROR {rc=2} [trial-2382↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25166)] 20:39:14.155896 run osmo-nitb_10.42.42.2(pid=25166): stdout: | (launched: 2022-12-12_20:39:13.782970) 20:39:14.297740 run osmo-nitb_10.42.42.2(pid=25166): stderr: | (launched: 2022-12-12_20:39:13.829383) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 20:39:14.440056 run osmo-nitb_10.42.42.2(pid=25166): stdout: | (launched: 2022-12-12_20:39:13.782970) 20:39:14.575954 run osmo-nitb_10.42.42.2(pid=25166): stderr: | (launched: 2022-12-12_20:39:13.829383) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7ff6b86c2268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=25166): Process ended prematurely: osmo-nitb_10.42.42.2(pid=25166) [trial-2382↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25166)] 20:39:14.959547 tst osmo-nitb_10.42.42.2(pid=25166): stdout: | (launched: 2022-12-12_20:39:13.782970) 20:39:15.085247 tst osmo-nitb_10.42.42.2(pid=25166): stderr: | (launched: 2022-12-12_20:39:13.829383) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 20:39:15.233833 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=25166): Process ended prematurely: osmo-nitb_10.42.42.2(pid=25166) [trial-2382↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25166)] [trial-2382↪nitb_ussd:sysmo↪assert_extension.py:12] 20:39:15.242216 tst assert_extension.py:12: Test FAILED (3.2 sec) 20:39:15.248882 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25165): Terminating (SIGTERM) 20:39:15.459284 --- ParallelTerminationStrategy: PID 25165 died... 20:39:15.480472 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25165): Terminated: ok {rc=0} 20:39:15.566325 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 nitb_ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 ussd:sysmo --------------------------------------------------------------------- 20:39:16.743049 tst ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:39:16.748695 tst ussd:sysmo: Verifying 1 x bts (candidates: 11) 20:39:16.775967 tst ussd:sysmo: Verifying 6 x ip_address (candidates: 9) 20:39:16.810206 tst ussd:sysmo: Verifying 1 x modem (candidates: 12) 20:39:16.851743 tst ussd:sysmo: Reserving 1 x bts (candidates: 11) 20:39:16.876546 tst ussd:sysmo: Reserving 6 x ip_address (candidates: 9) 20:39:16.908346 tst ussd:sysmo: Reserving 1 x modem (candidates: 12) 20:39:17.431938 tst ussd:sysmo: RESERVED RESOURCES for ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2382 ussd:sysmo assert_extension.py ---------------------------------------------- 20:39:17.438356 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 20:39:17.450164 tst ussd:sysmo: Using 1 x bts (candidates: 1) 20:39:17.487770 tst assert_extension.py: using LAC 31362 20:39:17.620187 tst assert_extension.py: using RAC 252 20:39:17.750890 tst assert_extension.py: using CellId 31362 20:39:17.882240 tst assert_extension.py: using BVCI 31363 20:39:18.005073 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 20:39:18.016256 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 20:39:18.027366 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 20:39:18.038371 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 20:39:18.049414 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 20:39:18.060339 tst ussd:sysmo: Using 1 x modem (candidates: 1) 20:39:18.176046 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:39:18.661970 run create_hlr_db(pid=25170): Launched 20:39:18.785597 bus /sierra_2: Setting Powered False 20:39:19.847903 run create_hlr_db(pid=25170): Terminated: ok {rc=0} 20:39:20.305845 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25172): Launched 20:39:20.643937 run osmo-hlr_10.42.42.2(pid=25173): Launched 20:39:20.774204 run osmo-stp_10.42.42.5: Starting osmo-stp 20:39:21.354041 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25175): Launched 20:39:21.690402 run osmo-stp_10.42.42.5(pid=25176): Launched 20:39:21.820184 run osmo-msc_10.42.42.6: Starting osmo-msc 20:39:22.424810 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25178): Launched 20:39:22.761898 run osmo-msc_10.42.42.6(pid=25179): Launched 20:39:22.948319 run osmo-stp_10.42.42.5(pid=25176): ERR: Terminated: ERROR {rc=1} [trial-2382↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25176)] 20:39:23.089913 run osmo-stp_10.42.42.5(pid=25176): stdout: | (launched: 2022-12-12_20:39:21.628079) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:39:23.232582 run osmo-stp_10.42.42.5(pid=25176): stderr: | 20221212203921824 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212203921824 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212203921824 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212203921825 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212203921825 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212203921825 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212203921826 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:39:23.373352 run osmo-stp_10.42.42.5(pid=25176): stdout: | (launched: 2022-12-12_20:39:21.628079) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:39:23.506884 run osmo-stp_10.42.42.5(pid=25176): stderr: | 20221212203921824 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212203921824 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212203921824 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212203921825 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212203921825 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212203921825 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212203921826 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:39:23.666481 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=25176): Process ended prematurely: osmo-stp_10.42.42.5(pid=25176) [trial-2382↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25176)] [trial-2382↪ussd:sysmo↪assert_extension.py:17] 20:39:23.675515 tst assert_extension.py:17: Test FAILED (6.2 sec) 20:39:23.703605 run osmo-hlr_10.42.42.2(pid=25173): ERR: Terminated: ERROR {rc=237} [trial-2382↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25173)] 20:39:23.755698 run osmo-hlr_10.42.42.2(pid=25173): stdout: | (launched: 2022-12-12_20:39:20.581946) 20:39:23.809979 run osmo-hlr_10.42.42.2(pid=25173): stderr: | 20221212203920783 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212203920783 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212203920783 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212203920783 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212203920783 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212203920783 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212203920838 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/ussd:sysmo/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212203920848 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212203920848 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212203920848 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:39:23.884939 run osmo-msc_10.42.42.6(pid=25179): ERR: Terminated: ERROR {rc=2} [trial-2382↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25179)] 20:39:23.937078 run osmo-msc_10.42.42.6(pid=25179): stdout: | (launched: 2022-12-12_20:39:22.699389) 20:39:23.990608 run osmo-msc_10.42.42.6(pid=25179): stderr: | 20221212203923026 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212203923026 DLGLOBAL DEBUG validating counter group 0x7fa45e1d8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212203923026 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212203923026 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212203923026 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212203923027 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212203923029 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212203923029 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212203923029 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212203923029 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:39:24.044614 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25172): Terminating (SIGTERM) 20:39:24.088021 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25175): Terminating (SIGTERM) 20:39:24.131320 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25178): Terminating (SIGTERM) 20:39:24.174764 --- ParallelTerminationStrategy: PID 25172 died... 20:39:24.195438 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25172): Terminated: ok {rc=0} 20:39:24.243350 --- ParallelTerminationStrategy: PID 25175 died... 20:39:24.263609 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25175): Terminated: ok {rc=0} 20:39:24.311613 --- ParallelTerminationStrategy: PID 25178 died... 20:39:24.331739 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25178): Terminated: ok {rc=0} 20:39:24.422269 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 20:39:25.620809 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:39:25.628007 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 20:39:25.649624 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 20:39:25.677844 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 20:39:25.731998 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 20:39:25.754009 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 20:39:25.782004 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 20:39:26.332891 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 20:39:26.388320 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:39:26.399996 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 20:39:26.458773 tst mo_mt_call.py: using LAC 31363 20:39:26.593309 tst mo_mt_call.py: using RAC 253 20:39:26.719527 tst mo_mt_call.py: using CellId 31363 20:39:26.845471 tst mo_mt_call.py: using BVCI 31364 20:39:26.970054 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:39:26.981908 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:39:26.993619 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:39:27.005152 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:39:27.016714 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:39:27.028412 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 20:39:27.149241 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 20:39:27.272302 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:39:27.803051 run create_hlr_db(pid=25186): Launched 20:39:27.941344 bus /sierra_2: Setting Powered False 20:39:29.008798 run create_hlr_db(pid=25186): Terminated: ok {rc=0} 20:39:29.462552 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25188): Launched 20:39:29.783315 run osmo-hlr_10.42.42.2(pid=25189): Launched 20:39:29.906263 run osmo-stp_10.42.42.5: Starting osmo-stp 20:39:30.452878 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25191): Launched 20:39:30.771091 run osmo-stp_10.42.42.5(pid=25192): Launched 20:39:30.957376 run osmo-msc_10.42.42.6: Starting osmo-msc 20:39:31.676619 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25194): Launched 20:39:32.041609 run osmo-msc_10.42.42.6(pid=25195): Launched 20:39:32.405195 run osmo-stp_10.42.42.5(pid=25192): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25192)] 20:39:32.541062 run osmo-stp_10.42.42.5(pid=25192): stdout: | (launched: 2022-12-12_20:39:30.711777) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:39:32.674494 run osmo-stp_10.42.42.5(pid=25192): stderr: | 20221212203930902 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212203930905 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212203930905 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212203930906 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212203930906 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212203930906 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212203930906 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:39:32.807565 run osmo-stp_10.42.42.5(pid=25192): stdout: | (launched: 2022-12-12_20:39:30.711777) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:39:32.934829 run osmo-stp_10.42.42.5(pid=25192): stderr: | 20221212203930902 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212203930905 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212203930905 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212203930906 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212203930906 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212203930906 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212203930906 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:39:33.087619 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25192): Process ended prematurely: osmo-stp_10.42.42.5(pid=25192) [trial-2382↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25192)] [trial-2382↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 20:39:33.096721 tst mo_mt_call.py:8: Test FAILED (6.8 sec) 20:39:33.124301 run osmo-hlr_10.42.42.2(pid=25189): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25189)] 20:39:33.174570 run osmo-hlr_10.42.42.2(pid=25189): stdout: | (launched: 2022-12-12_20:39:29.723867) 20:39:33.226491 run osmo-hlr_10.42.42.2(pid=25189): stderr: | 20221212203929904 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212203929904 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212203929904 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212203929904 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212203929904 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212203929905 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212203929961 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212203929970 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212203929970 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212203929970 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:39:33.298279 run osmo-msc_10.42.42.6(pid=25195): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25195)] 20:39:33.348122 run osmo-msc_10.42.42.6(pid=25195): stdout: | (launched: 2022-12-12_20:39:31.973383) 20:39:33.399951 run osmo-msc_10.42.42.6(pid=25195): stderr: | 20221212203932398 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212203932398 DLGLOBAL DEBUG validating counter group 0x7f474afaac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212203932398 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212203932398 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212203932398 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212203932398 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212203932400 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212203932400 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212203932401 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212203932401 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:39:33.452124 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25188): Terminating (SIGTERM) 20:39:33.493517 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25191): Terminating (SIGTERM) 20:39:33.535098 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25194): Terminating (SIGTERM) 20:39:33.577060 --- ParallelTerminationStrategy: PID 25188 died... 20:39:33.596825 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25188): Terminated: ok {rc=0} 20:39:33.643142 --- ParallelTerminationStrategy: PID 25191 died... 20:39:33.662375 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25191): Terminated: ok {rc=0} 20:39:33.709124 --- ParallelTerminationStrategy: PID 25194 died... 20:39:33.729116 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25194): Terminated: ok {rc=0} 20:39:33.820547 bus /sierra_3: Setting Powered False 20:39:34.924488 bus /sierra_3: Setting Powered False 20:39:36.044577 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2382 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 20:39:37.197644 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:39:37.209487 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 20:39:37.269165 tst mo_mt_call_osmux.py: using LAC 31364 20:39:37.395445 tst mo_mt_call_osmux.py: using RAC 254 20:39:37.530685 tst mo_mt_call_osmux.py: using CellId 31364 20:39:37.666985 tst mo_mt_call_osmux.py: using BVCI 31365 20:39:37.784348 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:39:37.795812 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:39:37.807042 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:39:37.818391 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:39:37.829988 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:39:37.841246 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 20:39:37.963318 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 20:39:38.084712 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:39:38.579438 run create_hlr_db(pid=25197): Launched 20:39:38.703524 bus /sierra_2: Setting Powered False 20:39:39.768220 run create_hlr_db(pid=25197): Terminated: ok {rc=0} 20:39:40.212430 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25199): Launched 20:39:40.533280 run osmo-hlr_10.42.42.2(pid=25200): Launched 20:39:40.657821 run osmo-stp_10.42.42.5: Starting osmo-stp 20:39:41.205598 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25202): Launched 20:39:41.525941 run osmo-stp_10.42.42.5(pid=25203): Launched 20:39:41.649374 run osmo-msc_10.42.42.6: Starting osmo-msc 20:39:42.222733 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25205): Launched 20:39:42.542481 run osmo-msc_10.42.42.6(pid=25206): Launched 20:39:42.721832 run osmo-stp_10.42.42.5(pid=25203): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25203)] 20:39:42.856735 run osmo-stp_10.42.42.5(pid=25203): stdout: | (launched: 2022-12-12_20:39:41.466209) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:39:42.990931 run osmo-stp_10.42.42.5(pid=25203): stderr: | 20221212203941642 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212203941642 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212203941642 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212203941643 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212203941643 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212203941643 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212203941643 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:39:43.123418 run osmo-stp_10.42.42.5(pid=25203): stdout: | (launched: 2022-12-12_20:39:41.466209) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:39:43.250202 run osmo-stp_10.42.42.5(pid=25203): stderr: | 20221212203941642 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212203941642 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212203941642 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212203941643 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212203941643 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212203941643 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212203941643 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:39:43.401458 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25203): Process ended prematurely: osmo-stp_10.42.42.5(pid=25203) [trial-2382↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25203)] [trial-2382↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 20:39:43.410394 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 20:39:43.437882 run osmo-hlr_10.42.42.2(pid=25200): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25200)] 20:39:43.488154 run osmo-hlr_10.42.42.2(pid=25200): stdout: | (launched: 2022-12-12_20:39:40.473498) 20:39:43.539724 run osmo-hlr_10.42.42.2(pid=25200): stderr: | 20221212203940654 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212203940654 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212203940654 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212203940654 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212203940655 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212203940655 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212203940669 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212203940679 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212203940679 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212203940679 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:39:43.611736 run osmo-msc_10.42.42.6(pid=25206): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25206)] 20:39:43.661683 run osmo-msc_10.42.42.6(pid=25206): stdout: | (launched: 2022-12-12_20:39:42.482821) 20:39:43.713401 run osmo-msc_10.42.42.6(pid=25206): stderr: | 20221212203942759 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212203942759 DLGLOBAL DEBUG validating counter group 0x7f09b5859c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212203942759 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212203942759 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212203942759 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212203942759 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212203942761 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212203942762 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212203942762 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212203942762 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:39:43.765232 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25199): Terminating (SIGTERM) 20:39:43.806453 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25202): Terminating (SIGTERM) 20:39:43.847927 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25205): Terminating (SIGTERM) 20:39:43.889466 --- ParallelTerminationStrategy: PID 25199 died... 20:39:43.909332 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25199): Terminated: ok {rc=0} 20:39:43.955536 --- ParallelTerminationStrategy: PID 25202 died... 20:39:43.974779 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25202): Terminated: ok {rc=0} 20:39:44.021333 --- ParallelTerminationStrategy: PID 25205 died... 20:39:44.040433 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25205): Terminated: ok {rc=0} 20:39:44.130457 bus /sierra_3: Setting Powered False 20:39:45.232310 bus /sierra_3: Setting Powered False 20:39:46.357439 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 20:39:47.615014 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:39:47.621999 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 20:39:47.643793 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 20:39:47.671686 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 20:39:47.725994 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 20:39:47.748004 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 20:39:47.775641 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 20:39:48.331028 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 20:39:48.385304 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:39:48.396816 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 20:39:48.454540 tst mo_mt_call.py: using LAC 31365 20:39:48.588161 tst mo_mt_call.py: using RAC 255 20:39:48.727336 tst mo_mt_call.py: using CellId 31365 20:39:48.860151 tst mo_mt_call.py: using BVCI 31366 20:39:48.978507 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:39:48.989969 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:39:49.001167 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:39:49.012696 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:39:49.024300 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:39:49.036076 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 20:39:49.157917 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 20:39:49.277080 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:39:49.771931 run create_hlr_db(pid=25211): Launched 20:39:49.895555 bus /sierra_2: Setting Powered False 20:39:50.958686 run create_hlr_db(pid=25211): Terminated: ok {rc=0} 20:39:51.424100 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25213): Launched 20:39:51.767289 run osmo-hlr_10.42.42.2(pid=25214): Launched 20:39:51.898492 run osmo-stp_10.42.42.5: Starting osmo-stp 20:39:52.485189 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25216): Launched 20:39:52.829051 run osmo-stp_10.42.42.5(pid=25217): Launched 20:39:52.960245 run osmo-msc_10.42.42.6: Starting osmo-msc 20:39:53.576411 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25219): Launched 20:39:53.919234 run osmo-msc_10.42.42.6(pid=25220): Launched 20:39:54.109231 run osmo-stp_10.42.42.5(pid=25217): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25217)] 20:39:54.254590 run osmo-stp_10.42.42.5(pid=25217): stdout: | (launched: 2022-12-12_20:39:52.765548) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:39:54.398290 run osmo-stp_10.42.42.5(pid=25217): stderr: | 20221212203952962 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212203952962 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212203952962 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212203952963 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212203952963 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212203952963 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212203952963 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:39:54.540155 run osmo-stp_10.42.42.5(pid=25217): stdout: | (launched: 2022-12-12_20:39:52.765548) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:39:54.676026 run osmo-stp_10.42.42.5(pid=25217): stderr: | 20221212203952962 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212203952962 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212203952962 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212203952963 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212203952963 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212203952963 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212203952963 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:39:54.838807 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25217): Process ended prematurely: osmo-stp_10.42.42.5(pid=25217) [trial-2382↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25217)] [trial-2382↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 20:39:54.848439 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 20:39:54.876889 run osmo-hlr_10.42.42.2(pid=25214): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25214)] 20:39:54.928875 run osmo-hlr_10.42.42.2(pid=25214): stdout: | (launched: 2022-12-12_20:39:51.704125) 20:39:54.982833 run osmo-hlr_10.42.42.2(pid=25214): stderr: | 20221212203951907 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212203951907 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212203951907 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212203951907 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212203951907 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212203951907 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212203951932 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212203951942 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212203951942 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212203951942 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:39:55.057730 run osmo-msc_10.42.42.6(pid=25220): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25220)] 20:39:55.109703 run osmo-msc_10.42.42.6(pid=25220): stdout: | (launched: 2022-12-12_20:39:53.855746) 20:39:55.163473 run osmo-msc_10.42.42.6(pid=25220): stderr: | 20221212203954183 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212203954183 DLGLOBAL DEBUG validating counter group 0x7fc7bccfac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212203954183 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212203954183 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212203954184 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212203954184 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212203954185 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212203954186 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212203954186 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212203954186 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:39:55.217570 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25213): Terminating (SIGTERM) 20:39:55.260397 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25216): Terminating (SIGTERM) 20:39:55.303240 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25219): Terminating (SIGTERM) 20:39:55.346449 --- ParallelTerminationStrategy: PID 25213 died... 20:39:55.367046 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25213): Terminated: ok {rc=0} 20:39:55.414957 --- ParallelTerminationStrategy: PID 25216 died... 20:39:55.435089 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25216): Terminated: ok {rc=0} 20:39:55.482840 --- ParallelTerminationStrategy: PID 25219 died... 20:39:55.503016 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25219): Terminated: ok {rc=0} 20:39:55.594311 bus /sierra_3: Setting Powered False 20:39:56.696212 bus /sierra_3: Setting Powered False 20:39:57.815174 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2382 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 20:39:58.967323 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:39:58.979274 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 20:39:59.038840 tst mo_mt_call_osmux.py: using LAC 31366 20:39:59.165882 tst mo_mt_call_osmux.py: using RAC 1 20:39:59.290959 tst mo_mt_call_osmux.py: using CellId 31366 20:39:59.413716 tst mo_mt_call_osmux.py: using BVCI 31367 20:39:59.539437 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:39:59.551662 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:39:59.563400 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:39:59.575606 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:39:59.587744 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:39:59.602724 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 20:39:59.722229 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 20:39:59.846818 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:40:00.377894 run create_hlr_db(pid=25222): Launched 20:40:00.509619 bus /sierra_2: Setting Powered False 20:40:01.572506 run create_hlr_db(pid=25222): Terminated: ok {rc=0} 20:40:02.030841 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25227): Launched 20:40:02.393544 run osmo-hlr_10.42.42.2(pid=25228): Launched 20:40:02.517419 run osmo-stp_10.42.42.5: Starting osmo-stp 20:40:03.103958 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25230): Launched 20:40:03.447785 run osmo-stp_10.42.42.5(pid=25231): Launched 20:40:03.578888 run osmo-msc_10.42.42.6: Starting osmo-msc 20:40:04.194787 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25233): Launched 20:40:04.537082 run osmo-msc_10.42.42.6(pid=25234): Launched 20:40:04.727583 run osmo-stp_10.42.42.5(pid=25231): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25231)] 20:40:04.871505 run osmo-stp_10.42.42.5(pid=25231): stdout: | (launched: 2022-12-12_20:40:03.384495) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:40:05.016884 run osmo-stp_10.42.42.5(pid=25231): stderr: | 20221212204003581 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204003581 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204003582 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204003582 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204003582 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204003582 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204003583 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:40:05.158002 run osmo-stp_10.42.42.5(pid=25231): stdout: | (launched: 2022-12-12_20:40:03.384495) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:40:05.293236 run osmo-stp_10.42.42.5(pid=25231): stderr: | 20221212204003581 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204003581 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204003582 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204003582 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204003582 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204003582 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204003583 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:40:05.455032 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25231): Process ended prematurely: osmo-stp_10.42.42.5(pid=25231) [trial-2382↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25231)] [trial-2382↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 20:40:05.464537 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 20:40:05.492905 run osmo-hlr_10.42.42.2(pid=25228): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25228)] 20:40:05.544586 run osmo-hlr_10.42.42.2(pid=25228): stdout: | (launched: 2022-12-12_20:40:02.334256) 20:40:05.598116 run osmo-hlr_10.42.42.2(pid=25228): stderr: | 20221212204002510 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212204002510 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212204002510 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212204002510 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212204002510 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212204002510 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212204002523 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212204002532 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212204002532 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212204002532 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:40:05.672275 run osmo-msc_10.42.42.6(pid=25234): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25234)] 20:40:05.723834 run osmo-msc_10.42.42.6(pid=25234): stdout: | (launched: 2022-12-12_20:40:04.473778) 20:40:05.777222 run osmo-msc_10.42.42.6(pid=25234): stderr: | 20221212204004802 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212204004802 DLGLOBAL DEBUG validating counter group 0x7f304591dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212204004803 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212204004803 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212204004803 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212204004803 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212204004805 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212204004805 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212204004805 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212204004805 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:40:05.831091 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25227): Terminating (SIGTERM) 20:40:05.873883 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25230): Terminating (SIGTERM) 20:40:05.916727 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25233): Terminating (SIGTERM) 20:40:05.959727 --- ParallelTerminationStrategy: PID 25227 died... 20:40:05.980189 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25227): Terminated: ok {rc=0} 20:40:06.027428 --- ParallelTerminationStrategy: PID 25230 died... 20:40:06.047473 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25230): Terminated: ok {rc=0} 20:40:06.094576 --- ParallelTerminationStrategy: PID 25233 died... 20:40:06.114566 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25233): Terminated: ok {rc=0} 20:40:06.203373 bus /sierra_3: Setting Powered False 20:40:07.306176 bus /sierra_3: Setting Powered False 20:40:08.425103 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 20:40:09.665614 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:40:09.672665 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 20:40:09.694484 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 20:40:09.722071 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 20:40:09.775344 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 20:40:09.797223 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 20:40:09.824683 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 20:40:10.376552 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 20:40:10.431194 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:40:10.442838 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 20:40:10.501346 tst mo_mt_call.py: using LAC 31367 20:40:10.636035 tst mo_mt_call.py: using RAC 2 20:40:10.769783 tst mo_mt_call.py: using CellId 31367 20:40:10.904248 tst mo_mt_call.py: using BVCI 31368 20:40:11.029862 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:40:11.041694 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:40:11.053179 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:40:11.064606 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:40:11.076129 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:40:11.087734 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 20:40:11.205897 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 20:40:11.328638 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:40:11.821743 run create_hlr_db(pid=25239): Launched 20:40:11.943538 bus /sierra_2: Setting Powered False 20:40:13.006449 run create_hlr_db(pid=25239): Terminated: ok {rc=0} 20:40:13.471692 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25241): Launched 20:40:13.815271 run osmo-hlr_10.42.42.2(pid=25242): Launched 20:40:13.945876 run osmo-stp_10.42.42.5: Starting osmo-stp 20:40:14.535018 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25244): Launched 20:40:14.879881 run osmo-stp_10.42.42.5(pid=25245): Launched 20:40:15.010748 run osmo-msc_10.42.42.6: Starting osmo-msc 20:40:15.627446 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25247): Launched 20:40:16.011819 run osmo-msc_10.42.42.6(pid=25248): Launched 20:40:16.433393 run osmo-stp_10.42.42.5(pid=25245): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25245)] 20:40:16.775013 run osmo-stp_10.42.42.5(pid=25245): stdout: | (launched: 2022-12-12_20:40:14.816372) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:40:16.986881 run osmo-stp_10.42.42.5(pid=25245): stderr: | 20221212204015013 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204015013 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204015013 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204015013 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204015014 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204015014 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204015014 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:40:17.129280 run osmo-stp_10.42.42.5(pid=25245): stdout: | (launched: 2022-12-12_20:40:14.816372) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:40:17.261736 run osmo-stp_10.42.42.5(pid=25245): stderr: | 20221212204015013 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204015013 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204015013 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204015013 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204015014 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204015014 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204015014 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:40:17.418564 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25245): Process ended prematurely: osmo-stp_10.42.42.5(pid=25245) [trial-2382↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25245)] [trial-2382↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 20:40:17.428294 tst mo_mt_call.py:8: Test FAILED (7.0 sec) 20:40:17.459157 run osmo-hlr_10.42.42.2(pid=25242): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25242)] 20:40:17.509897 run osmo-hlr_10.42.42.2(pid=25242): stdout: | (launched: 2022-12-12_20:40:13.751668) 20:40:17.562245 run osmo-hlr_10.42.42.2(pid=25242): stderr: | 20221212204013952 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212204013952 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212204013952 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212204013952 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212204013952 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212204013952 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212204013964 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212204013973 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212204013973 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212204013974 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:40:17.634512 run osmo-msc_10.42.42.6(pid=25248): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25248)] 20:40:17.685225 run osmo-msc_10.42.42.6(pid=25248): stdout: | (launched: 2022-12-12_20:40:15.948407) 20:40:17.737177 run osmo-msc_10.42.42.6(pid=25248): stderr: | 20221212204016480 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212204016480 DLGLOBAL DEBUG validating counter group 0x7faff97f3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212204016481 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212204016481 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212204016481 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212204016483 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212204016488 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212204016488 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212204016490 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212204016490 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:40:17.789582 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25241): Terminating (SIGTERM) 20:40:17.831148 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25244): Terminating (SIGTERM) 20:40:17.872727 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25247): Terminating (SIGTERM) 20:40:17.914495 --- ParallelTerminationStrategy: PID 25241 died... 20:40:17.934011 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25241): Terminated: ok {rc=0} 20:40:17.980897 --- ParallelTerminationStrategy: PID 25244 died... 20:40:18.000157 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25244): Terminated: ok {rc=0} 20:40:18.046837 --- ParallelTerminationStrategy: PID 25247 died... 20:40:18.066151 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25247): Terminated: ok {rc=0} 20:40:18.156116 bus /sierra_3: Setting Powered False 20:40:19.258575 bus /sierra_3: Setting Powered False 20:40:20.376195 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2382 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 20:40:21.527763 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:40:21.540030 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 20:40:21.597362 tst mo_mt_call_osmux.py: using LAC 31368 20:40:21.721632 tst mo_mt_call_osmux.py: using RAC 3 20:40:21.848495 tst mo_mt_call_osmux.py: using CellId 31368 20:40:21.986931 tst mo_mt_call_osmux.py: using BVCI 31369 20:40:22.112472 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:40:22.124302 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:40:22.136179 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:40:22.147641 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:40:22.159139 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:40:22.170697 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 20:40:22.293335 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 20:40:22.413358 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:40:22.907448 run create_hlr_db(pid=25250): Launched 20:40:23.031168 bus /sierra_2: Setting Powered False 20:40:24.094194 run create_hlr_db(pid=25250): Terminated: ok {rc=0} 20:40:24.559135 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25252): Launched 20:40:24.903541 run osmo-hlr_10.42.42.2(pid=25253): Launched 20:40:25.034759 run osmo-stp_10.42.42.5: Starting osmo-stp 20:40:25.623842 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25255): Launched 20:40:25.967913 run osmo-stp_10.42.42.5(pid=25256): Launched 20:40:26.099458 run osmo-msc_10.42.42.6: Starting osmo-msc 20:40:26.716104 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25258): Launched 20:40:27.059901 run osmo-msc_10.42.42.6(pid=25259): Launched 20:40:27.250200 run osmo-stp_10.42.42.5(pid=25256): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25256)] 20:40:27.393852 run osmo-stp_10.42.42.5(pid=25256): stdout: | (launched: 2022-12-12_20:40:25.904551) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:40:27.538788 run osmo-stp_10.42.42.5(pid=25256): stderr: | 20221212204026103 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204026103 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204026104 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204026104 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204026104 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204026105 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204026105 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:40:27.680925 run osmo-stp_10.42.42.5(pid=25256): stdout: | (launched: 2022-12-12_20:40:25.904551) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:40:27.817193 run osmo-stp_10.42.42.5(pid=25256): stderr: | 20221212204026103 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204026103 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204026104 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204026104 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204026104 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204026105 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204026105 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:40:27.980244 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25256): Process ended prematurely: osmo-stp_10.42.42.5(pid=25256) [trial-2382↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25256)] [trial-2382↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 20:40:27.990132 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 20:40:28.018516 run osmo-hlr_10.42.42.2(pid=25253): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25253)] 20:40:28.070371 run osmo-hlr_10.42.42.2(pid=25253): stdout: | (launched: 2022-12-12_20:40:24.839115) 20:40:28.123915 run osmo-hlr_10.42.42.2(pid=25253): stderr: | 20221212204025043 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212204025043 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212204025043 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212204025043 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212204025043 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212204025043 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212204025062 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212204025072 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212204025073 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212204025073 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:40:28.198637 run osmo-msc_10.42.42.6(pid=25259): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25259)] 20:40:28.250462 run osmo-msc_10.42.42.6(pid=25259): stdout: | (launched: 2022-12-12_20:40:26.996405) 20:40:28.303915 run osmo-msc_10.42.42.6(pid=25259): stderr: | 20221212204027322 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212204027322 DLGLOBAL DEBUG validating counter group 0x7f877d25dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212204027322 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212204027322 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212204027322 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212204027323 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212204027324 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212204027325 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212204027325 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212204027325 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:40:28.357679 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25252): Terminating (SIGTERM) 20:40:28.401143 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25255): Terminating (SIGTERM) 20:40:28.444323 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25258): Terminating (SIGTERM) 20:40:28.487828 --- ParallelTerminationStrategy: PID 25252 died... 20:40:28.508402 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25252): Terminated: ok {rc=0} 20:40:28.556170 --- ParallelTerminationStrategy: PID 25255 died... 20:40:28.576319 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25255): Terminated: ok {rc=0} 20:40:28.623734 --- ParallelTerminationStrategy: PID 25258 died... 20:40:28.643826 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25258): Terminated: ok {rc=0} 20:40:28.734731 bus /sierra_3: Setting Powered False 20:40:29.836263 bus /sierra_3: Setting Powered False 20:40:30.984479 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 20:40:32.249534 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:40:32.256792 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 20:40:32.280852 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 20:40:32.308024 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 20:40:32.361609 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 20:40:32.382303 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 20:40:32.409901 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 20:40:32.958937 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 20:40:33.011019 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:40:33.022267 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 20:40:33.078521 tst mo_mt_call.py: using LAC 31369 20:40:33.204768 tst mo_mt_call.py: using RAC 4 20:40:33.330720 tst mo_mt_call.py: using CellId 31369 20:40:33.456156 tst mo_mt_call.py: using BVCI 31370 20:40:33.573585 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:40:33.584706 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:40:33.595717 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:40:33.606560 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:40:33.617585 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:40:33.628456 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 20:40:33.750324 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 20:40:33.870445 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:40:34.401094 run create_hlr_db(pid=25265): Launched 20:40:34.538993 bus /sierra_2: Setting Powered False 20:40:35.601927 run create_hlr_db(pid=25265): Terminated: ok {rc=0} 20:40:36.077932 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25267): Launched 20:40:36.419943 run osmo-hlr_10.42.42.2(pid=25268): Launched 20:40:36.550852 run osmo-stp_10.42.42.5: Starting osmo-stp 20:40:37.139936 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25270): Launched 20:40:37.482660 run osmo-stp_10.42.42.5(pid=25271): Launched 20:40:37.614801 run osmo-msc_10.42.42.6: Starting osmo-msc 20:40:38.231039 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25273): Launched 20:40:38.572378 run osmo-msc_10.42.42.6(pid=25274): Launched 20:40:38.766670 run osmo-stp_10.42.42.5(pid=25271): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25271)] 20:40:38.910527 run osmo-stp_10.42.42.5(pid=25271): stdout: | (launched: 2022-12-12_20:40:37.418973) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:40:39.054645 run osmo-stp_10.42.42.5(pid=25271): stderr: | 20221212204037618 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204037619 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204037619 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204037619 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204037620 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204037620 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204037620 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:40:39.196503 run osmo-stp_10.42.42.5(pid=25271): stdout: | (launched: 2022-12-12_20:40:37.418973) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:40:39.332279 run osmo-stp_10.42.42.5(pid=25271): stderr: | 20221212204037618 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204037619 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204037619 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204037619 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204037620 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204037620 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204037620 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:40:39.494554 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25271): Process ended prematurely: osmo-stp_10.42.42.5(pid=25271) [trial-2382↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25271)] [trial-2382↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 20:40:39.504354 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 20:40:39.532929 run osmo-hlr_10.42.42.2(pid=25268): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25268)] 20:40:39.584544 run osmo-hlr_10.42.42.2(pid=25268): stdout: | (launched: 2022-12-12_20:40:36.356839) 20:40:39.637935 run osmo-hlr_10.42.42.2(pid=25268): stderr: | 20221212204036562 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212204036562 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212204036562 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212204036562 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212204036562 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212204036562 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212204036575 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212204036586 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212204036586 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212204036586 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:40:39.711960 run osmo-msc_10.42.42.6(pid=25274): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25274)] 20:40:39.763505 run osmo-msc_10.42.42.6(pid=25274): stdout: | (launched: 2022-12-12_20:40:38.509198) 20:40:39.817121 run osmo-msc_10.42.42.6(pid=25274): stderr: | 20221212204038837 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212204038837 DLGLOBAL DEBUG validating counter group 0x7f766f42cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212204038837 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212204038837 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212204038838 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212204038838 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212204038839 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212204038840 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212204038840 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212204038840 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:40:39.870798 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25267): Terminating (SIGTERM) 20:40:39.913504 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25270): Terminating (SIGTERM) 20:40:39.956382 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25273): Terminating (SIGTERM) 20:40:39.999588 --- ParallelTerminationStrategy: PID 25267 died... 20:40:40.020180 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25267): Terminated: ok {rc=0} 20:40:40.068149 --- ParallelTerminationStrategy: PID 25270 died... 20:40:40.088377 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25270): Terminated: ok {rc=0} 20:40:40.135751 --- ParallelTerminationStrategy: PID 25273 died... 20:40:40.155900 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25273): Terminated: ok {rc=0} 20:40:40.246743 bus /sierra_3: Setting Powered False 20:40:41.348591 bus /sierra_3: Setting Powered False 20:40:42.470915 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2382 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 20:40:43.621765 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:40:43.633796 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 20:40:43.690358 tst mo_mt_call_osmux.py: using LAC 31370 20:40:43.815915 tst mo_mt_call_osmux.py: using RAC 5 20:40:43.941951 tst mo_mt_call_osmux.py: using CellId 31370 20:40:44.068148 tst mo_mt_call_osmux.py: using BVCI 31371 20:40:44.185460 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:40:44.196537 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:40:44.207464 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:40:44.218722 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:40:44.230155 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:40:44.241434 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 20:40:44.358809 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 20:40:44.481845 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:40:45.014794 run create_hlr_db(pid=25276): Launched 20:40:45.155474 bus /sierra_2: Setting Powered False 20:40:46.222392 run create_hlr_db(pid=25276): Terminated: ok {rc=0} 20:40:46.706829 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25278): Launched 20:40:47.066892 run osmo-hlr_10.42.42.2(pid=25279): Launched 20:40:47.210790 run osmo-stp_10.42.42.5: Starting osmo-stp 20:40:47.799891 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25281): Launched 20:40:48.144478 run osmo-stp_10.42.42.5(pid=25282): Launched 20:40:48.276059 run osmo-msc_10.42.42.6: Starting osmo-msc 20:40:48.894286 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25284): Launched 20:40:49.239400 run osmo-msc_10.42.42.6(pid=25285): Launched 20:40:49.429868 run osmo-stp_10.42.42.5(pid=25282): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25282)] 20:40:49.572566 run osmo-stp_10.42.42.5(pid=25282): stdout: | (launched: 2022-12-12_20:40:48.081327) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:40:49.716203 run osmo-stp_10.42.42.5(pid=25282): stderr: | 20221212204048279 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204048279 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204048279 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204048279 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204048280 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204048280 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204048280 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:40:49.858856 run osmo-stp_10.42.42.5(pid=25282): stdout: | (launched: 2022-12-12_20:40:48.081327) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:40:49.994696 run osmo-stp_10.42.42.5(pid=25282): stderr: | 20221212204048279 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204048279 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204048279 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204048279 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204048280 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204048280 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204048280 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:40:50.157437 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25282): Process ended prematurely: osmo-stp_10.42.42.5(pid=25282) [trial-2382↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25282)] [trial-2382↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 20:40:50.167417 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 20:40:50.195952 run osmo-hlr_10.42.42.2(pid=25279): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25279)] 20:40:50.247792 run osmo-hlr_10.42.42.2(pid=25279): stdout: | (launched: 2022-12-12_20:40:47.003258) 20:40:50.301261 run osmo-hlr_10.42.42.2(pid=25279): stderr: | 20221212204047199 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212204047199 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212204047199 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212204047199 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212204047199 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212204047199 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212204047211 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212204047219 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212204047220 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212204047220 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:40:50.375426 run osmo-msc_10.42.42.6(pid=25285): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25285)] 20:40:50.427050 run osmo-msc_10.42.42.6(pid=25285): stdout: | (launched: 2022-12-12_20:40:49.175749) 20:40:50.481404 run osmo-msc_10.42.42.6(pid=25285): stderr: | 20221212204049502 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212204049502 DLGLOBAL DEBUG validating counter group 0x7f983df0bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212204049503 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212204049503 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212204049503 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212204049503 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212204049505 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212204049505 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212204049505 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212204049505 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:40:50.534935 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25278): Terminating (SIGTERM) 20:40:50.577516 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25281): Terminating (SIGTERM) 20:40:50.620379 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25284): Terminating (SIGTERM) 20:40:50.663300 --- ParallelTerminationStrategy: PID 25278 died... 20:40:50.684049 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25278): Terminated: ok {rc=0} 20:40:50.731560 --- ParallelTerminationStrategy: PID 25281 died... 20:40:50.751648 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25281): Terminated: ok {rc=0} 20:40:50.799052 --- ParallelTerminationStrategy: PID 25284 died... 20:40:50.819369 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25284): Terminated: ok {rc=0} 20:40:50.911021 bus /sierra_3: Setting Powered False 20:40:52.013225 bus /sierra_3: Setting Powered False 20:40:53.133497 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 20:40:54.375574 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:40:54.382778 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 20:40:54.404351 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 20:40:54.432122 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 20:40:54.486053 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 20:40:54.507533 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 20:40:54.535020 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 20:40:55.087042 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 20:40:55.141924 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:40:55.153785 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 20:40:55.211856 tst mo_mt_call.py: using LAC 31371 20:40:55.345134 tst mo_mt_call.py: using RAC 6 20:40:55.482252 tst mo_mt_call.py: using CellId 31371 20:40:55.616533 tst mo_mt_call.py: using BVCI 31372 20:40:55.740499 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:40:55.752360 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:40:55.763827 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:40:55.775340 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:40:55.786943 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:40:55.798525 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 20:40:55.917195 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 20:40:56.039800 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:40:56.570533 run create_hlr_db(pid=25290): Launched 20:40:56.708759 bus /sierra_2: Setting Powered False 20:40:57.776350 run create_hlr_db(pid=25290): Terminated: ok {rc=0} 20:40:58.231043 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25292): Launched 20:40:58.552537 run osmo-hlr_10.42.42.2(pid=25293): Launched 20:40:58.675711 run osmo-stp_10.42.42.5: Starting osmo-stp 20:40:59.223781 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25295): Launched 20:40:59.543834 run osmo-stp_10.42.42.5(pid=25296): Launched 20:40:59.667428 run osmo-msc_10.42.42.6: Starting osmo-msc 20:41:00.242656 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25298): Launched 20:41:00.565294 run osmo-msc_10.42.42.6(pid=25299): Launched 20:41:00.744186 run osmo-stp_10.42.42.5(pid=25296): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25296)] 20:41:00.921206 run osmo-stp_10.42.42.5(pid=25296): stdout: | (launched: 2022-12-12_20:40:59.484673) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:41:01.107153 run osmo-stp_10.42.42.5(pid=25296): stderr: | 20221212204059658 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204059658 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204059658 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204059659 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204059659 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204059659 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204059659 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:41:01.255466 run osmo-stp_10.42.42.5(pid=25296): stdout: | (launched: 2022-12-12_20:40:59.484673) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:41:01.397162 run osmo-stp_10.42.42.5(pid=25296): stderr: | 20221212204059658 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204059658 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204059658 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204059659 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204059659 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204059659 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204059659 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:41:01.565254 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25296): Process ended prematurely: osmo-stp_10.42.42.5(pid=25296) [trial-2382↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25296)] [trial-2382↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 20:41:01.575454 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 20:41:01.606960 run osmo-hlr_10.42.42.2(pid=25293): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25293)] 20:41:01.661671 run osmo-hlr_10.42.42.2(pid=25293): stdout: | (launched: 2022-12-12_20:40:58.493030) 20:41:01.717742 run osmo-hlr_10.42.42.2(pid=25293): stderr: | 20221212204058673 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212204058673 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212204058674 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212204058674 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212204058674 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212204058674 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212204058686 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212204058694 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212204058694 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212204058694 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:41:01.796347 run osmo-msc_10.42.42.6(pid=25299): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25299)] 20:41:01.851714 run osmo-msc_10.42.42.6(pid=25299): stdout: | (launched: 2022-12-12_20:41:00.505553) 20:41:01.908085 run osmo-msc_10.42.42.6(pid=25299): stderr: | 20221212204100783 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212204100783 DLGLOBAL DEBUG validating counter group 0x7f4e24bbfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212204100783 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212204100783 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212204100783 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212204100784 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212204100785 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212204100786 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212204100786 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212204100786 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:41:01.964487 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25292): Terminating (SIGTERM) 20:41:02.011257 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25295): Terminating (SIGTERM) 20:41:02.058549 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25298): Terminating (SIGTERM) 20:41:02.106448 --- ParallelTerminationStrategy: PID 25292 died... 20:41:02.127684 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25292): Terminated: ok {rc=0} 20:41:02.180120 --- ParallelTerminationStrategy: PID 25295 died... 20:41:02.201253 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25295): Terminated: ok {rc=0} 20:41:02.250515 --- ParallelTerminationStrategy: PID 25298 died... 20:41:02.270983 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25298): Terminated: ok {rc=0} 20:41:02.363245 bus /sierra_3: Setting Powered False 20:41:03.466118 bus /sierra_3: Setting Powered False 20:41:04.585639 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2382 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 20:41:05.733749 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:41:05.745844 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 20:41:05.802795 tst mo_mt_call_osmux.py: using LAC 31372 20:41:05.929440 tst mo_mt_call_osmux.py: using RAC 7 20:41:06.064222 tst mo_mt_call_osmux.py: using CellId 31372 20:41:06.200295 tst mo_mt_call_osmux.py: using BVCI 31373 20:41:06.325968 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:41:06.337770 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:41:06.349414 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:41:06.360798 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:41:06.372356 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:41:06.384009 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 20:41:06.502667 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 20:41:06.628744 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:41:07.159798 run create_hlr_db(pid=25301): Launched 20:41:07.298162 bus /sierra_2: Setting Powered False 20:41:08.365726 run create_hlr_db(pid=25301): Terminated: ok {rc=0} 20:41:08.820262 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25303): Launched 20:41:09.141893 run osmo-hlr_10.42.42.2(pid=25304): Launched 20:41:09.265435 run osmo-stp_10.42.42.5: Starting osmo-stp 20:41:09.829066 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25306): Launched 20:41:10.148531 run osmo-stp_10.42.42.5(pid=25307): Launched 20:41:10.271340 run osmo-msc_10.42.42.6: Starting osmo-msc 20:41:10.848046 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25309): Launched 20:41:11.170414 run osmo-msc_10.42.42.6(pid=25310): Launched 20:41:11.349597 run osmo-stp_10.42.42.5(pid=25307): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25307)] 20:41:11.483784 run osmo-stp_10.42.42.5(pid=25307): stdout: | (launched: 2022-12-12_20:41:10.088923) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:41:11.618188 run osmo-stp_10.42.42.5(pid=25307): stderr: | 20221212204110267 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204110267 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204110267 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204110268 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204110268 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204110268 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204110268 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:41:11.750873 run osmo-stp_10.42.42.5(pid=25307): stdout: | (launched: 2022-12-12_20:41:10.088923) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:41:11.877880 run osmo-stp_10.42.42.5(pid=25307): stderr: | 20221212204110267 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204110267 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204110267 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204110268 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204110268 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204110268 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204110268 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:41:12.029704 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25307): Process ended prematurely: osmo-stp_10.42.42.5(pid=25307) [trial-2382↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25307)] [trial-2382↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 20:41:12.038598 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 20:41:12.065989 run osmo-hlr_10.42.42.2(pid=25304): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25304)] 20:41:12.115369 run osmo-hlr_10.42.42.2(pid=25304): stdout: | (launched: 2022-12-12_20:41:09.082449) 20:41:12.166628 run osmo-hlr_10.42.42.2(pid=25304): stderr: | 20221212204109263 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212204109263 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212204109263 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212204109263 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212204109263 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212204109263 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212204109275 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212204109285 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212204109285 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212204109285 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:41:12.237901 run osmo-msc_10.42.42.6(pid=25310): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25310)] 20:41:12.287083 run osmo-msc_10.42.42.6(pid=25310): stdout: | (launched: 2022-12-12_20:41:11.110662) 20:41:12.338083 run osmo-msc_10.42.42.6(pid=25310): stderr: | 20221212204111388 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212204111388 DLGLOBAL DEBUG validating counter group 0x7ff09ab9ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212204111388 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212204111388 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212204111389 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212204111389 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212204111392 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212204111392 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212204111392 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212204111392 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:41:12.389290 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25303): Terminating (SIGTERM) 20:41:12.430022 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25306): Terminating (SIGTERM) 20:41:12.470823 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25309): Terminating (SIGTERM) 20:41:12.511703 --- ParallelTerminationStrategy: PID 25303 died... 20:41:12.531023 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25303): Terminated: ok {rc=0} 20:41:12.577150 --- ParallelTerminationStrategy: PID 25306 died... 20:41:12.596038 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25306): Terminated: ok {rc=0} 20:41:12.641629 --- ParallelTerminationStrategy: PID 25309 died... 20:41:12.660483 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25309): Terminated: ok {rc=0} 20:41:12.748589 bus /sierra_3: Setting Powered False 20:41:13.850007 bus /sierra_3: Setting Powered False 20:41:14.969951 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 20:41:16.233219 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:41:16.245608 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 20:41:16.277969 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 20:41:16.314868 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 20:41:16.375573 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 20:41:16.406876 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 20:41:16.442228 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 20:41:16.973211 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 20:41:17.043423 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:41:17.058173 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 20:41:17.126701 tst mo_mt_call.py: using LAC 31373 20:41:17.264388 tst mo_mt_call.py: using RAC 8 20:41:17.402645 tst mo_mt_call.py: using CellId 31373 20:41:17.539429 tst mo_mt_call.py: using BVCI 31374 20:41:17.662996 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:41:17.674589 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:41:17.685962 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:41:17.697666 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:41:17.709420 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:41:17.721356 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:41:17.846605 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:41:17.967329 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:41:18.463960 run create_hlr_db(pid=25315): Launched 20:41:18.586712 bus /sierra_2: Setting Powered False 20:41:19.649979 run create_hlr_db(pid=25315): Terminated: ok {rc=0} 20:41:20.117922 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25317): Launched 20:41:20.462403 run osmo-hlr_10.42.42.2(pid=25318): Launched 20:41:20.595468 run osmo-stp_10.42.42.5: Starting osmo-stp 20:41:21.184683 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25320): Launched 20:41:21.508862 run osmo-stp_10.42.42.5(pid=25321): Launched 20:41:21.633179 run osmo-msc_10.42.42.6: Starting osmo-msc 20:41:22.227218 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25323): Launched 20:41:22.549620 run osmo-msc_10.42.42.6(pid=25324): Launched 20:41:22.727646 run osmo-stp_10.42.42.5(pid=25321): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25321)] 20:41:22.863199 run osmo-stp_10.42.42.5(pid=25321): stdout: | (launched: 2022-12-12_20:41:21.449429) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:41:22.998948 run osmo-stp_10.42.42.5(pid=25321): stderr: | 20221212204121626 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204121626 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204121627 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204121627 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204121628 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204121628 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204121628 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:41:23.132003 run osmo-stp_10.42.42.5(pid=25321): stdout: | (launched: 2022-12-12_20:41:21.449429) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:41:23.259723 run osmo-stp_10.42.42.5(pid=25321): stderr: | 20221212204121626 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204121626 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204121627 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204121627 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204121628 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204121628 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204121628 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:41:23.412806 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25321): Process ended prematurely: osmo-stp_10.42.42.5(pid=25321) [trial-2382↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25321)] [trial-2382↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 20:41:23.422087 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 20:41:23.449487 run osmo-hlr_10.42.42.2(pid=25318): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25318)] 20:41:23.499510 run osmo-hlr_10.42.42.2(pid=25318): stdout: | (launched: 2022-12-12_20:41:20.398701) 20:41:23.551458 run osmo-hlr_10.42.42.2(pid=25318): stderr: | 20221212204120602 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212204120602 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212204120602 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212204120603 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212204120603 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212204120603 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212204120632 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212204120641 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212204120641 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212204120641 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:41:23.623011 run osmo-msc_10.42.42.6(pid=25324): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25324)] 20:41:23.672622 run osmo-msc_10.42.42.6(pid=25324): stdout: | (launched: 2022-12-12_20:41:22.489816) 20:41:23.723708 run osmo-msc_10.42.42.6(pid=25324): stderr: | 20221212204122768 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212204122768 DLGLOBAL DEBUG validating counter group 0x7fe80f063c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212204122768 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212204122768 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212204122768 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212204122768 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212204122770 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212204122771 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212204122771 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212204122771 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:41:23.774903 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25317): Terminating (SIGTERM) 20:41:23.816080 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25320): Terminating (SIGTERM) 20:41:23.857345 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25323): Terminating (SIGTERM) 20:41:23.898313 --- ParallelTerminationStrategy: PID 25317 died... 20:41:23.917795 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25317): Terminated: ok {rc=0} 20:41:23.963418 --- ParallelTerminationStrategy: PID 25320 died... 20:41:23.982523 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25320): Terminated: ok {rc=0} 20:41:24.028079 --- ParallelTerminationStrategy: PID 25323 died... 20:41:24.047095 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25323): Terminated: ok {rc=0} 20:41:24.133723 bus /sierra_3: Setting Powered False 20:41:25.234957 bus /sierra_3: Setting Powered False 20:41:26.353741 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2382 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 20:41:27.502116 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:41:27.514183 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 20:41:27.571378 tst mo_mt_call_osmux.py: using LAC 31374 20:41:27.697640 tst mo_mt_call_osmux.py: using RAC 9 20:41:27.832059 tst mo_mt_call_osmux.py: using CellId 31374 20:41:27.965658 tst mo_mt_call_osmux.py: using BVCI 31375 20:41:28.092745 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:41:28.104805 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:41:28.116523 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:41:28.128314 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:41:28.140617 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:41:28.152471 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:41:28.275428 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:41:28.395253 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:41:28.891184 run create_hlr_db(pid=25326): Launched 20:41:29.015334 bus /sierra_2: Setting Powered False 20:41:30.079119 run create_hlr_db(pid=25326): Terminated: ok {rc=0} 20:41:30.544120 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25328): Launched 20:41:30.896085 run osmo-hlr_10.42.42.2(pid=25329): Launched 20:41:31.102866 run osmo-stp_10.42.42.5: Starting osmo-stp 20:41:31.852633 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25331): Launched 20:41:32.209191 run osmo-stp_10.42.42.5(pid=25332): Launched 20:41:32.462840 run osmo-msc_10.42.42.6: Starting osmo-msc 20:41:33.081702 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25334): Launched 20:41:33.401703 run osmo-msc_10.42.42.6(pid=25335): Launched 20:41:33.587584 run osmo-stp_10.42.42.5(pid=25332): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25332)] 20:41:33.726582 run osmo-stp_10.42.42.5(pid=25332): stdout: | (launched: 2022-12-12_20:41:32.145439) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:41:33.861453 run osmo-stp_10.42.42.5(pid=25332): stderr: | 20221212204132414 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204132414 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204132414 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204132415 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204132415 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204132415 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204132415 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:41:33.994871 run osmo-stp_10.42.42.5(pid=25332): stdout: | (launched: 2022-12-12_20:41:32.145439) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:41:34.122789 run osmo-stp_10.42.42.5(pid=25332): stderr: | 20221212204132414 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204132414 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204132414 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204132415 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204132415 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204132415 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204132415 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:41:34.275788 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25332): Process ended prematurely: osmo-stp_10.42.42.5(pid=25332) [trial-2382↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25332)] [trial-2382↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 20:41:34.285114 tst mo_mt_call_osmux.py:8: Test FAILED (6.8 sec) 20:41:34.312403 run osmo-hlr_10.42.42.2(pid=25329): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25329)] 20:41:34.362013 run osmo-hlr_10.42.42.2(pid=25329): stdout: | (launched: 2022-12-12_20:41:30.823456) 20:41:34.413213 run osmo-hlr_10.42.42.2(pid=25329): stderr: | 20221212204131208 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212204131208 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212204131208 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212204131208 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212204131208 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212204131208 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212204131258 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212204131275 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212204131275 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212204131275 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:41:34.484255 run osmo-msc_10.42.42.6(pid=25335): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25335)] 20:41:34.533527 run osmo-msc_10.42.42.6(pid=25335): stdout: | (launched: 2022-12-12_20:41:33.341998) 20:41:34.584455 run osmo-msc_10.42.42.6(pid=25335): stderr: | 20221212204133620 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212204133620 DLGLOBAL DEBUG validating counter group 0x7fc579aebc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212204133620 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212204133620 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212204133621 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212204133621 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212204133623 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212204133623 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212204133623 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212204133623 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:41:34.635762 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25328): Terminating (SIGTERM) 20:41:34.676641 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25331): Terminating (SIGTERM) 20:41:34.717487 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25334): Terminating (SIGTERM) 20:41:34.758591 --- ParallelTerminationStrategy: PID 25328 died... 20:41:34.778175 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25328): Terminated: ok {rc=0} 20:41:34.824051 --- ParallelTerminationStrategy: PID 25331 died... 20:41:34.843155 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25331): Terminated: ok {rc=0} 20:41:34.889251 --- ParallelTerminationStrategy: PID 25334 died... 20:41:34.908379 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25334): Terminated: ok {rc=0} 20:41:34.996414 bus /sierra_3: Setting Powered False 20:41:36.097501 bus /sierra_3: Setting Powered False 20:41:37.213919 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 voice:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 20:41:38.458523 tst voice:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:41:38.464803 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 20:41:38.486934 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 20:41:38.514602 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 20:41:38.566591 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 20:41:38.588160 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 20:41:38.615721 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 20:41:39.167662 tst voice:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 20:41:39.222143 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:41:39.233720 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:41:39.291009 tst mo_mt_call.py: using LAC 31375 20:41:39.423650 tst mo_mt_call.py: using RAC 10 20:41:39.557062 tst mo_mt_call.py: using CellId 31375 20:41:39.692394 tst mo_mt_call.py: using BVCI 31376 20:41:39.817336 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:41:39.828815 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:41:39.840455 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:41:39.851841 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:41:39.863165 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:41:39.874573 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 20:41:39.993223 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 20:41:40.119274 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:41:40.650047 run create_hlr_db(pid=25340): Launched 20:41:40.789137 bus /sierra_2: Setting Powered False 20:41:41.857395 run create_hlr_db(pid=25340): Terminated: ok {rc=0} 20:41:42.313437 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25342): Launched 20:41:42.636286 run osmo-hlr_10.42.42.2(pid=25343): Launched 20:41:42.758015 run osmo-stp_10.42.42.5: Starting osmo-stp 20:41:43.319136 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25345): Launched 20:41:43.640183 run osmo-stp_10.42.42.5(pid=25346): Launched 20:41:43.762241 run osmo-msc_10.42.42.6: Starting osmo-msc 20:41:44.339106 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25348): Launched 20:41:44.659353 run osmo-msc_10.42.42.6(pid=25349): Launched 20:41:44.837789 run osmo-stp_10.42.42.5(pid=25346): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25346)] 20:41:44.972712 run osmo-stp_10.42.42.5(pid=25346): stdout: | (launched: 2022-12-12_20:41:43.580163) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:41:45.106608 run osmo-stp_10.42.42.5(pid=25346): stderr: | 20221212204143757 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204143757 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204143757 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204143758 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204143758 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204143758 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204143758 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:41:45.239083 run osmo-stp_10.42.42.5(pid=25346): stdout: | (launched: 2022-12-12_20:41:43.580163) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:41:45.366025 run osmo-stp_10.42.42.5(pid=25346): stderr: | 20221212204143757 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204143757 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204143757 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204143758 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204143758 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204143758 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204143758 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:41:45.517810 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25346): Process ended prematurely: osmo-stp_10.42.42.5(pid=25346) [trial-2382↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25346)] [trial-2382↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 20:41:45.526796 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 20:41:45.554344 run osmo-hlr_10.42.42.2(pid=25343): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25343)] 20:41:45.603780 run osmo-hlr_10.42.42.2(pid=25343): stdout: | (launched: 2022-12-12_20:41:42.576075) 20:41:45.654811 run osmo-hlr_10.42.42.2(pid=25343): stderr: | 20221212204142755 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212204142755 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212204142755 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212204142755 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212204142755 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212204142755 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212204142767 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212204142776 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212204142776 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212204142776 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:41:45.726207 run osmo-msc_10.42.42.6(pid=25349): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25349)] 20:41:45.775369 run osmo-msc_10.42.42.6(pid=25349): stdout: | (launched: 2022-12-12_20:41:44.599286) 20:41:45.826141 run osmo-msc_10.42.42.6(pid=25349): stderr: | 20221212204144875 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212204144875 DLGLOBAL DEBUG validating counter group 0x7f69f6d70c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212204144875 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212204144876 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212204144876 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212204144876 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212204144878 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212204144878 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212204144878 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212204144878 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:41:45.893062 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25342): Terminating (SIGTERM) 20:41:45.941363 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25345): Terminating (SIGTERM) 20:41:45.983552 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25348): Terminating (SIGTERM) 20:41:46.026068 --- ParallelTerminationStrategy: PID 25342 died... 20:41:46.048252 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25342): Terminated: ok {rc=0} 20:41:46.095304 --- ParallelTerminationStrategy: PID 25345 died... 20:41:46.115239 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25345): Terminated: ok {rc=0} 20:41:46.161880 --- ParallelTerminationStrategy: PID 25348 died... 20:41:46.181701 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25348): Terminated: ok {rc=0} 20:41:46.270757 bus /sierra_3: Setting Powered False 20:41:47.370907 bus /sierra_3: Setting Powered False 20:41:48.489161 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2382 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 20:41:49.640861 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:41:49.652484 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:41:49.709361 tst mo_mt_call_osmux.py: using LAC 31376 20:41:49.833228 tst mo_mt_call_osmux.py: using RAC 11 20:41:49.958751 tst mo_mt_call_osmux.py: using CellId 31376 20:41:50.083957 tst mo_mt_call_osmux.py: using BVCI 31377 20:41:50.210394 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:41:50.222275 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:41:50.233831 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:41:50.246004 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:41:50.258150 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:41:50.270434 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 20:41:50.390244 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 20:41:50.513180 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:41:51.043635 run create_hlr_db(pid=25351): Launched 20:41:51.181358 bus /sierra_2: Setting Powered False 20:41:52.249104 run create_hlr_db(pid=25351): Terminated: ok {rc=0} 20:41:52.704096 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25353): Launched 20:41:53.024134 run osmo-hlr_10.42.42.2(pid=25354): Launched 20:41:53.144829 run osmo-stp_10.42.42.5: Starting osmo-stp 20:41:53.742039 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25356): Launched 20:41:54.084610 run osmo-stp_10.42.42.5(pid=25357): Launched 20:41:54.213999 run osmo-msc_10.42.42.6: Starting osmo-msc 20:41:54.830079 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25359): Launched 20:41:55.172351 run osmo-msc_10.42.42.6(pid=25360): Launched 20:41:55.361249 run osmo-stp_10.42.42.5(pid=25357): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25357)] 20:41:55.507151 run osmo-stp_10.42.42.5(pid=25357): stdout: | (launched: 2022-12-12_20:41:54.021149) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:41:55.651405 run osmo-stp_10.42.42.5(pid=25357): stderr: | 20221212204154220 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204154221 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204154221 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204154221 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204154222 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204154222 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204154222 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:41:55.792337 run osmo-stp_10.42.42.5(pid=25357): stdout: | (launched: 2022-12-12_20:41:54.021149) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:41:55.927992 run osmo-stp_10.42.42.5(pid=25357): stderr: | 20221212204154220 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204154221 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204154221 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204154221 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204154222 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204154222 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204154222 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:41:56.089849 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25357): Process ended prematurely: osmo-stp_10.42.42.5(pid=25357) [trial-2382↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25357)] [trial-2382↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 20:41:56.099672 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 20:41:56.128007 run osmo-hlr_10.42.42.2(pid=25354): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25354)] 20:41:56.179896 run osmo-hlr_10.42.42.2(pid=25354): stdout: | (launched: 2022-12-12_20:41:52.964388) 20:41:56.233389 run osmo-hlr_10.42.42.2(pid=25354): stderr: | 20221212204153143 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212204153143 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212204153143 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212204153143 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212204153143 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212204153143 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212204153155 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212204153164 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212204153164 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212204153164 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:41:56.307593 run osmo-msc_10.42.42.6(pid=25360): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25360)] 20:41:56.358895 run osmo-msc_10.42.42.6(pid=25360): stdout: | (launched: 2022-12-12_20:41:55.108608) 20:41:56.411731 run osmo-msc_10.42.42.6(pid=25360): stderr: | 20221212204155438 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212204155439 DLGLOBAL DEBUG validating counter group 0x7f519a078c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212204155439 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212204155439 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212204155439 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212204155439 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212204155441 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212204155441 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212204155441 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212204155442 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:41:56.465107 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25353): Terminating (SIGTERM) 20:41:56.507746 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25356): Terminating (SIGTERM) 20:41:56.550413 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25359): Terminating (SIGTERM) 20:41:56.593243 --- ParallelTerminationStrategy: PID 25353 died... 20:41:56.613731 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25353): Terminated: ok {rc=0} 20:41:56.660937 --- ParallelTerminationStrategy: PID 25356 died... 20:41:56.680935 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25356): Terminated: ok {rc=0} 20:41:56.728409 --- ParallelTerminationStrategy: PID 25359 died... 20:41:56.748464 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25359): Terminated: ok {rc=0} 20:41:56.838552 bus /sierra_3: Setting Powered False 20:41:57.941148 bus /sierra_3: Setting Powered False 20:41:59.059056 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 voice:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 emergency:sysmo --------------------------------------------------------------------- 20:42:00.301644 tst emergency:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:42:00.306429 tst emergency:sysmo: Verifying 1 x bts (candidates: 11) 20:42:00.328406 tst emergency:sysmo: Verifying 6 x ip_address (candidates: 9) 20:42:00.356818 tst emergency:sysmo: Verifying 4 x modem (candidates: 12) 20:42:00.444066 tst emergency:sysmo: Reserving 1 x bts (candidates: 11) 20:42:00.465958 tst emergency:sysmo: Reserving 6 x ip_address (candidates: 9) 20:42:00.493507 tst emergency:sysmo: Reserving 4 x modem (candidates: 12) 20:42:01.129382 tst emergency:sysmo: RESERVED RESOURCES for emergency: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2382 emergency:sysmo emergency_mo_mt_call.py ---------------------------------------------- 20:42:01.137362 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 20:42:01.156633 tst emergency:sysmo: Using 1 x bts (candidates: 1) 20:42:01.201396 tst emergency_mo_mt_call.py: using LAC 31377 20:42:01.333389 tst emergency_mo_mt_call.py: using RAC 12 20:42:01.491468 tst emergency_mo_mt_call.py: using CellId 31377 20:42:01.623591 tst emergency_mo_mt_call.py: using BVCI 31378 20:42:01.741789 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 20:42:01.753744 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 20:42:01.765650 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 20:42:01.778438 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 20:42:01.792401 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 20:42:01.805495 tst emergency:sysmo: Using 1 x modem (candidates: 4) 20:42:01.933592 tst emergency:sysmo: Using 1 x modem (candidates: 4) 20:42:02.083306 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:42:02.621472 run create_hlr_db(pid=25376): Launched 20:42:02.758530 bus /sierra_2: Setting Powered False 20:42:03.823999 run create_hlr_db(pid=25376): Terminated: ok {rc=0} 20:42:04.273710 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25378): Launched 20:42:04.588376 run osmo-hlr_10.42.42.2(pid=25379): Launched 20:42:04.708272 run osmo-stp_10.42.42.5: Starting osmo-stp 20:42:05.252087 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25381): Launched 20:42:05.589665 run osmo-stp_10.42.42.5(pid=25382): Launched 20:42:05.730444 tst emergency_mo_mt_call.py: using MSISDN 7965 20:42:05.903551 run osmo-msc_10.42.42.6: Starting osmo-msc 20:42:06.507319 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25384): Launched 20:42:06.844046 run osmo-msc_10.42.42.6(pid=25385): Launched 20:42:07.031142 run osmo-stp_10.42.42.5(pid=25382): ERR: Terminated: ERROR {rc=1} [trial-2382↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25382)] 20:42:07.172366 run osmo-stp_10.42.42.5(pid=25382): stdout: | (launched: 2022-12-12_20:42:05.526767) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:42:07.316015 run osmo-stp_10.42.42.5(pid=25382): stderr: | 20221212204205725 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204205725 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204205725 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204205726 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204205726 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204205726 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204205726 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:42:07.456133 run osmo-stp_10.42.42.5(pid=25382): stdout: | (launched: 2022-12-12_20:42:05.526767) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:42:07.589409 run osmo-stp_10.42.42.5(pid=25382): stderr: | 20221212204205725 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204205725 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204205725 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204205726 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204205726 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204205726 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204205726 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:42:07.749256 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=25382): Process ended prematurely: osmo-stp_10.42.42.5(pid=25382) [trial-2382↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25382)] [trial-2382↪emergency:sysmo↪emergency_mo_mt_call.py:19] 20:42:07.758250 tst emergency_mo_mt_call.py:19: Test FAILED (6.6 sec) 20:42:07.786217 run osmo-hlr_10.42.42.2(pid=25379): ERR: Terminated: ERROR {rc=237} [trial-2382↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25379)] 20:42:07.838053 run osmo-hlr_10.42.42.2(pid=25379): stdout: | (launched: 2022-12-12_20:42:04.528826) 20:42:07.891876 run osmo-hlr_10.42.42.2(pid=25379): stderr: | 20221212204204709 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212204204709 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212204204709 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212204204709 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212204204709 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212204204709 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212204204721 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/emergency:sysmo/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212204204729 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212204204729 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212204204729 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:42:07.966318 run osmo-msc_10.42.42.6(pid=25385): ERR: Terminated: ERROR {rc=2} [trial-2382↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25385)] 20:42:08.018025 run osmo-msc_10.42.42.6(pid=25385): stdout: | (launched: 2022-12-12_20:42:06.781056) 20:42:08.071184 run osmo-msc_10.42.42.6(pid=25385): stderr: | 20221212204207107 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212204207107 DLGLOBAL DEBUG validating counter group 0x7f33bce4ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212204207107 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212204207107 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212204207107 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212204207108 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212204207109 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212204207110 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212204207110 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212204207110 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:42:08.124920 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25378): Terminating (SIGTERM) 20:42:08.168198 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25381): Terminating (SIGTERM) 20:42:08.211241 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25384): Terminating (SIGTERM) 20:42:08.254440 --- ParallelTerminationStrategy: PID 25378 died... 20:42:08.275032 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25378): Terminated: ok {rc=0} 20:42:08.322593 --- ParallelTerminationStrategy: PID 25381 died... 20:42:08.342695 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25381): Terminated: ok {rc=0} 20:42:08.390202 --- ParallelTerminationStrategy: PID 25384 died... 20:42:08.410290 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25384): Terminated: ok {rc=0} 20:42:08.500358 bus /sierra_3: Setting Powered False 20:42:09.602949 bus /sierra_3: Setting Powered False 20:42:10.720749 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2382 emergency:sysmo emergency_preemptive_call.py ---------------------------------------------- 20:42:11.810959 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 20:42:11.822944 tst emergency:sysmo: Using 1 x bts (candidates: 1) 20:42:11.861517 tst emergency_preemptive_call.py: using LAC 31378 20:42:11.993719 tst emergency_preemptive_call.py: using RAC 13 20:42:12.118556 tst emergency_preemptive_call.py: using CellId 31378 20:42:12.253662 tst emergency_preemptive_call.py: using BVCI 31379 20:42:12.377110 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 20:42:12.388692 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 20:42:12.400441 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 20:42:12.411814 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 20:42:12.423357 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 20:42:12.434534 tst emergency:sysmo: Using 1 x modem (candidates: 4) 20:42:12.556743 tst emergency:sysmo: Using 1 x modem (candidates: 4) 20:42:12.674438 tst emergency:sysmo: Using 1 x modem (candidates: 4) 20:42:12.792065 tst emergency:sysmo: Using 1 x modem (candidates: 4) 20:42:12.912702 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:42:13.434603 run create_hlr_db(pid=25387): Launched 20:42:13.569815 bus /sierra_2: Setting Powered False 20:42:14.635887 run create_hlr_db(pid=25387): Terminated: ok {rc=0} 20:42:15.102884 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25389): Launched 20:42:15.440808 run osmo-hlr_10.42.42.2(pid=25390): Launched 20:42:15.569994 run osmo-stp_10.42.42.5: Starting osmo-stp 20:42:16.167393 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25392): Launched 20:42:16.513061 run osmo-stp_10.42.42.5(pid=25393): Launched 20:42:16.786322 tst emergency_preemptive_call.py: using MSISDN 7966 20:42:16.965832 run osmo-msc_10.42.42.6: Starting osmo-msc 20:42:17.557855 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25395): Launched 20:42:17.895199 run osmo-msc_10.42.42.6(pid=25396): Launched 20:42:18.088175 run osmo-stp_10.42.42.5(pid=25393): ERR: Terminated: ERROR {rc=1} [trial-2382↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25393)] 20:42:18.228684 run osmo-stp_10.42.42.5(pid=25393): stdout: | (launched: 2022-12-12_20:42:16.441707) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:42:18.370348 run osmo-stp_10.42.42.5(pid=25393): stderr: | 20221212204216656 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204216656 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204216656 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204216657 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204216658 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204216658 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204216658 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:42:18.510924 run osmo-stp_10.42.42.5(pid=25393): stdout: | (launched: 2022-12-12_20:42:16.441707) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:42:18.644220 run osmo-stp_10.42.42.5(pid=25393): stderr: | 20221212204216656 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204216656 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204216656 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204216657 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204216658 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204216658 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204216658 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:42:18.803820 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=25393): Process ended prematurely: osmo-stp_10.42.42.5(pid=25393) [trial-2382↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25393)] [trial-2382↪emergency:sysmo↪emergency_preemptive_call.py:32] 20:42:18.812833 tst emergency_preemptive_call.py:32: Test FAILED (7.0 sec) 20:42:18.840621 run osmo-hlr_10.42.42.2(pid=25390): ERR: Terminated: ERROR {rc=237} [trial-2382↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25390)] 20:42:18.892216 run osmo-hlr_10.42.42.2(pid=25390): stdout: | (launched: 2022-12-12_20:42:15.377814) 20:42:18.945528 run osmo-hlr_10.42.42.2(pid=25390): stderr: | 20221212204215583 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212204215583 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212204215583 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212204215584 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212204215584 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212204215584 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212204215596 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/emergency:sysmo/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212204215605 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212204215606 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212204215606 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:42:19.019533 run osmo-msc_10.42.42.6(pid=25396): ERR: Terminated: ERROR {rc=2} [trial-2382↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25396)] 20:42:19.070699 run osmo-msc_10.42.42.6(pid=25396): stdout: | (launched: 2022-12-12_20:42:17.831748) 20:42:19.123945 run osmo-msc_10.42.42.6(pid=25396): stderr: | 20221212204218161 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212204218161 DLGLOBAL DEBUG validating counter group 0x7f7f28caec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212204218161 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212204218161 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212204218162 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212204218162 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212204218164 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212204218164 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212204218164 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212204218164 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:42:19.177366 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25389): Terminating (SIGTERM) 20:42:19.220089 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25392): Terminating (SIGTERM) 20:42:19.262820 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25395): Terminating (SIGTERM) 20:42:19.305856 --- ParallelTerminationStrategy: PID 25389 died... 20:42:19.326386 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25389): Terminated: ok {rc=0} 20:42:19.373727 --- ParallelTerminationStrategy: PID 25392 died... 20:42:19.393690 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25392): Terminated: ok {rc=0} 20:42:19.440860 --- ParallelTerminationStrategy: PID 25395 died... 20:42:19.461212 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25395): Terminated: ok {rc=0} 20:42:19.550128 bus /sierra_9: Setting Powered False 20:42:20.652432 bus /sierra_9: Setting Powered False 20:42:21.770902 bus /sierra_8: Setting Powered False 20:42:22.872590 bus /sierra_8: Setting Powered False 20:42:23.990203 bus /sierra_3: Setting Powered False 20:42:25.091136 bus /sierra_3: Setting Powered False 20:42:26.210112 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 emergency:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 gprs:sysmo --------------------------------------------------------------------- 20:42:27.472883 tst gprs:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:42:27.477241 tst gprs:sysmo: Verifying 1 x bts (candidates: 11) 20:42:27.498030 tst gprs:sysmo: Verifying 9 x ip_address (candidates: 9) 20:42:27.537483 tst gprs:sysmo: Verifying 4 x modem (candidates: 12) 20:42:27.631960 tst gprs:sysmo: Reserving 1 x bts (candidates: 11) 20:42:27.653065 tst gprs:sysmo: Reserving 9 x ip_address (candidates: 9) 20:42:27.692010 tst gprs:sysmo: Reserving 4 x modem (candidates: 12) 20:42:28.276657 tst gprs:sysmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2382 gprs:sysmo cs_paging_gprs_active.py ---------------------------------------------- 20:42:28.332546 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:42:28.343400 tst gprs:sysmo: Using 1 x bts (candidates: 1) 20:42:28.379391 tst cs_paging_gprs_active.py: using LAC 31379 20:42:28.506481 tst cs_paging_gprs_active.py: using RAC 14 20:42:28.633590 tst cs_paging_gprs_active.py: using CellId 31379 20:42:28.759995 tst cs_paging_gprs_active.py: using BVCI 31380 20:42:28.877732 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:42:28.888535 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:42:28.899326 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:42:28.910346 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:42:28.921007 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:42:28.931782 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:42:28.942807 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:42:28.953498 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:42:28.964562 tst gprs:sysmo: Using 1 x modem (candidates: 4) 20:42:29.087991 tst gprs:sysmo: Using 1 x modem (candidates: 4) 20:42:29.207192 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 20:42:29.423773 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:42:29.747029 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25401): Launched 20:42:30.026560 run iperf3-srv_10.42.42.10(pid=25402): Launched 20:42:30.146877 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 20:42:30.361048 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:42:30.682674 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25403): Launched 20:42:30.994606 run iperf3-srv_10.42.42.10(pid=25404): Launched 20:42:31.150980 tst cs_paging_gprs_active.py:38: start network... 20:42:31.408130 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:42:31.985342 run create_hlr_db(pid=25405): Launched 20:42:32.158264 bus /sierra_2: Setting Powered False 20:42:33.225273 run create_hlr_db(pid=25405): Terminated: ok {rc=0} 20:42:33.702077 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25407): Launched 20:42:34.047718 run osmo-hlr_10.42.42.2(pid=25408): Launched 20:42:34.178051 run osmo-stp_10.42.42.5: Starting osmo-stp 20:42:34.767498 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25410): Launched 20:42:35.110649 run osmo-stp_10.42.42.5(pid=25411): Launched 20:42:35.240887 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:42:36.831703 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25413): Launched 20:42:36.962507 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:42:37.254621 run patchelf(pid=25414): Launched 20:42:37.445275 run osmo-stp_10.42.42.5(pid=25411): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25411)] 20:42:37.589609 run osmo-stp_10.42.42.5(pid=25411): stdout: | (launched: 2022-12-12_20:42:35.046709) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:42:37.735442 run osmo-stp_10.42.42.5(pid=25411): stderr: | 20221212204235246 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204235246 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204235247 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204235247 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204235247 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204235248 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204235248 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:42:37.881661 run osmo-stp_10.42.42.5(pid=25411): stdout: | (launched: 2022-12-12_20:42:35.046709) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:42:38.022433 run osmo-stp_10.42.42.5(pid=25411): stderr: | 20221212204235246 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204235246 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204235247 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204235247 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204235247 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204235248 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204235248 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:42:38.188648 run patchelf(pid=25414): Terminating (SIGINT) 20:42:38.380354 run patchelf(pid=25414): Terminated: ok {rc=0} 20:42:38.517966 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=25411): Process ended prematurely: osmo-stp_10.42.42.5(pid=25411) [trial-2382↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25411)] [trial-2382↪gprs:sysmo↪cs_paging_gprs_active.py:38] 20:42:38.528169 tst cs_paging_gprs_active.py:38: Test FAILED (10.2 sec) 20:42:38.557325 run osmo-hlr_10.42.42.2(pid=25408): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:sysmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25408)] 20:42:38.608628 run osmo-hlr_10.42.42.2(pid=25408): stdout: | (launched: 2022-12-12_20:42:33.983533) 20:42:38.661902 run osmo-hlr_10.42.42.2(pid=25408): stderr: | 20221212204234188 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212204234188 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212204234188 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212204234188 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212204234188 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212204234188 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212204234200 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:sysmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212204234213 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212204234213 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212204234213 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:42:38.715643 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25401): Terminating (SIGTERM) 20:42:38.758486 run iperf3-srv_10.42.42.10(pid=25402): Terminating (SIGTERM) 20:42:38.802275 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25403): Terminating (SIGTERM) 20:42:38.846434 run iperf3-srv_10.42.42.10(pid=25404): Terminating (SIGTERM) 20:42:38.888322 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25407): Terminating (SIGTERM) 20:42:38.929875 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25410): Terminating (SIGTERM) 20:42:38.971000 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25413): Terminating (SIGTERM) 20:42:39.013856 --- ParallelTerminationStrategy: PID 25401 died... 20:42:39.033531 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25401): Terminated: ok {rc=0} 20:42:39.079727 --- ParallelTerminationStrategy: PID 25402 died... 20:42:39.098797 run iperf3-srv_10.42.42.10(pid=25402): Terminated {rc=256} 20:42:39.145132 --- ParallelTerminationStrategy: PID 25403 died... 20:42:39.164392 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25403): Terminated: ok {rc=0} 20:42:39.211225 --- ParallelTerminationStrategy: PID 25404 died... 20:42:39.230462 run iperf3-srv_10.42.42.10(pid=25404): Terminated {rc=256} 20:42:39.277113 --- ParallelTerminationStrategy: PID 25407 died... 20:42:39.296314 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25407): Terminated: ok {rc=0} 20:42:39.342343 --- ParallelTerminationStrategy: PID 25410 died... 20:42:39.361780 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25410): Terminated: ok {rc=0} 20:42:39.407313 --- ParallelTerminationStrategy: PID 25413 died... 20:42:39.426483 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25413): Terminated: ok {rc=0} 20:42:39.514390 bus /gobi_0: Setting Powered False 20:42:40.615236 bus /gobi_0: Setting Powered False 20:42:41.734221 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:sysmo iperf3.py ---------------------------------------------- 20:42:42.885887 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:42:42.897548 tst gprs:sysmo: Using 1 x bts (candidates: 1) 20:42:42.933259 tst iperf3.py: using LAC 31380 20:42:43.057994 tst iperf3.py: using RAC 15 20:42:43.185076 tst iperf3.py: using CellId 31380 20:42:43.311304 tst iperf3.py: using BVCI 31381 20:42:43.428767 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:42:43.439490 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:42:43.450073 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:42:43.460869 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:42:43.471524 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:42:43.482285 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:42:43.493168 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:42:43.504048 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:42:43.514881 tst gprs:sysmo: Using 1 x modem (candidates: 4) 20:42:43.638871 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 20:42:43.873285 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:42:44.218568 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25415): Launched 20:42:44.516298 run iperf3-srv_10.42.42.10(pid=25416): Launched 20:42:44.644462 tst iperf3.py:8: start network... 20:42:44.875339 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:42:45.407287 run create_hlr_db(pid=25417): Launched 20:42:45.546801 bus /gobi_6: Setting Powered False 20:42:46.640868 run create_hlr_db(pid=25417): Terminated: ok {rc=0} 20:42:47.165729 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25419): Launched 20:42:47.490372 run osmo-hlr_10.42.42.2(pid=25420): Launched 20:42:47.613467 run osmo-stp_10.42.42.5: Starting osmo-stp 20:42:48.163556 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25422): Launched 20:42:48.483445 run osmo-stp_10.42.42.5(pid=25423): Launched 20:42:48.605252 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:42:49.153494 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25425): Launched 20:42:49.276132 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:42:49.549270 run patchelf(pid=25426): Launched 20:42:49.726143 run osmo-stp_10.42.42.5(pid=25423): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25423)] 20:42:49.860370 run osmo-stp_10.42.42.5(pid=25423): stdout: | (launched: 2022-12-12_20:42:48.423484) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:42:49.996613 run osmo-stp_10.42.42.5(pid=25423): stderr: | 20221212204248600 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204248600 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204248600 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204248602 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204248602 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204248602 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204248602 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:42:50.133357 run osmo-stp_10.42.42.5(pid=25423): stdout: | (launched: 2022-12-12_20:42:48.423484) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:42:50.263855 run osmo-stp_10.42.42.5(pid=25423): stderr: | 20221212204248600 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204248600 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204248600 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204248602 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204248602 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204248602 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204248602 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:42:50.418812 run patchelf(pid=25426): Terminating (SIGINT) 20:42:50.598198 run patchelf(pid=25426): Terminated: ok {rc=0} 20:42:50.727556 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25423): Process ended prematurely: osmo-stp_10.42.42.5(pid=25423) [trial-2382↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25423)] [trial-2382↪gprs:sysmo↪iperf3.py:8] 20:42:50.737388 tst iperf3.py:8: Test FAILED (7.9 sec) 20:42:50.766043 run osmo-hlr_10.42.42.2(pid=25420): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:sysmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25420)] 20:42:50.815891 run osmo-hlr_10.42.42.2(pid=25420): stdout: | (launched: 2022-12-12_20:42:47.430274) 20:42:50.867551 run osmo-hlr_10.42.42.2(pid=25420): stderr: | 20221212204247614 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212204247614 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212204247614 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212204247614 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212204247614 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212204247614 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212204247626 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:sysmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212204247634 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212204247634 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212204247635 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:42:50.919145 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25415): Terminating (SIGTERM) 20:42:50.960274 run iperf3-srv_10.42.42.10(pid=25416): Terminating (SIGTERM) 20:42:51.002376 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25419): Terminating (SIGTERM) 20:42:51.047789 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25422): Terminating (SIGTERM) 20:42:51.090528 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25425): Terminating (SIGTERM) 20:42:51.133847 --- ParallelTerminationStrategy: PID 25415 died... 20:42:51.154370 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25415): Terminated: ok {rc=0} 20:42:51.202672 --- ParallelTerminationStrategy: PID 25416 died... 20:42:51.222752 run iperf3-srv_10.42.42.10(pid=25416): Terminated {rc=256} 20:42:51.272825 --- ParallelTerminationStrategy: PID 25419 died... 20:42:51.292474 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25419): Terminated: ok {rc=0} 20:42:51.339462 --- ParallelTerminationStrategy: PID 25422 died... 20:42:51.358950 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25422): Terminated: ok {rc=0} 20:42:51.405542 --- ParallelTerminationStrategy: PID 25425 died... 20:42:51.424795 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25425): Terminated: ok {rc=0} 20:42:51.515143 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:sysmo iperf3m4.py ---------------------------------------------- 20:42:52.672632 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:42:52.684412 tst gprs:sysmo: Using 1 x bts (candidates: 1) 20:42:52.719372 tst iperf3m4.py: using LAC 31381 20:42:52.852368 tst iperf3m4.py: using RAC 16 20:42:52.987316 tst iperf3m4.py: using CellId 31381 20:42:53.122612 tst iperf3m4.py: using BVCI 31382 20:42:53.248512 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:42:53.259819 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:42:53.271318 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:42:53.282411 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:42:53.293334 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:42:53.304139 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:42:53.315293 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:42:53.326308 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:42:53.337423 tst gprs:sysmo: Using 1 x modem (candidates: 4) 20:42:53.458141 tst gprs:sysmo: Using 1 x modem (candidates: 4) 20:42:53.584862 tst gprs:sysmo: Using 1 x modem (candidates: 4) 20:42:53.708243 tst gprs:sysmo: Using 1 x modem (candidates: 4) 20:42:53.827056 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 20:42:54.042458 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:42:54.366111 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25427): Launched 20:42:54.646452 run iperf3-srv_10.42.42.10(pid=25428): Launched 20:42:54.766662 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 20:42:54.981680 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:42:55.304205 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25429): Launched 20:42:55.583650 run iperf3-srv_10.42.42.10(pid=25430): Launched 20:42:55.703691 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 20:42:55.918502 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:42:56.241551 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25431): Launched 20:42:56.521641 run iperf3-srv_10.42.42.10(pid=25432): Launched 20:42:56.641680 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 20:42:56.857076 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:42:57.180180 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25433): Launched 20:42:57.475388 run iperf3-srv_10.42.42.10(pid=25434): Launched 20:42:57.594986 tst iperf3m4.py:8: start network... 20:42:57.808817 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:42:58.305921 run create_hlr_db(pid=25435): Launched 20:42:58.427187 bus /gobi_6: Setting Powered False 20:42:59.490402 run create_hlr_db(pid=25435): Terminated: ok {rc=0} 20:42:59.957403 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25437): Launched 20:43:00.302893 run osmo-hlr_10.42.42.2(pid=25438): Launched 20:43:00.433249 run osmo-stp_10.42.42.5: Starting osmo-stp 20:43:01.054579 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25440): Launched 20:43:01.399794 run osmo-stp_10.42.42.5(pid=25441): Launched 20:43:01.571187 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:43:02.327574 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25443): Launched 20:43:02.449615 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:43:02.720841 run patchelf(pid=25444): Launched 20:43:02.897650 run osmo-stp_10.42.42.5(pid=25441): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25441)] 20:43:03.032087 run osmo-stp_10.42.42.5(pid=25441): stdout: | (launched: 2022-12-12_20:43:01.334439) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:43:03.168390 run osmo-stp_10.42.42.5(pid=25441): stderr: | 20221212204301754 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204301755 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204301756 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204301757 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204301758 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204301758 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204301758 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:43:03.304703 run osmo-stp_10.42.42.5(pid=25441): stdout: | (launched: 2022-12-12_20:43:01.334439) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:43:03.435702 run osmo-stp_10.42.42.5(pid=25441): stderr: | 20221212204301754 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204301755 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204301756 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204301757 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204301758 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204301758 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204301758 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:43:03.591063 run patchelf(pid=25444): Terminating (SIGINT) 20:43:03.770676 run patchelf(pid=25444): Terminated: ok {rc=0} 20:43:03.900648 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25441): Process ended prematurely: osmo-stp_10.42.42.5(pid=25441) [trial-2382↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25441)] [trial-2382↪gprs:sysmo↪iperf3m4.py:8] 20:43:03.910340 tst iperf3m4.py:8: Test FAILED (11.3 sec) 20:43:03.939056 run osmo-hlr_10.42.42.2(pid=25438): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:sysmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25438)] 20:43:03.989081 run osmo-hlr_10.42.42.2(pid=25438): stdout: | (launched: 2022-12-12_20:43:00.238706) 20:43:04.040682 run osmo-hlr_10.42.42.2(pid=25438): stderr: | 20221212204300443 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212204300443 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212204300443 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212204300443 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212204300443 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212204300443 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212204300456 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:sysmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212204300465 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212204300465 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212204300465 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:43:04.092904 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25427): Terminating (SIGTERM) 20:43:04.134774 run iperf3-srv_10.42.42.10(pid=25428): Terminating (SIGTERM) 20:43:04.176491 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25429): Terminating (SIGTERM) 20:43:04.218086 run iperf3-srv_10.42.42.10(pid=25430): Terminating (SIGTERM) 20:43:04.259357 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25431): Terminating (SIGTERM) 20:43:04.300748 run iperf3-srv_10.42.42.10(pid=25432): Terminating (SIGTERM) 20:43:04.342387 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25433): Terminating (SIGTERM) 20:43:04.384255 run iperf3-srv_10.42.42.10(pid=25434): Terminating (SIGTERM) 20:43:04.425794 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25437): Terminating (SIGTERM) 20:43:04.467460 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25440): Terminating (SIGTERM) 20:43:04.509079 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25443): Terminating (SIGTERM) 20:43:04.550948 --- ParallelTerminationStrategy: PID 25427 died... 20:43:04.570673 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25427): Terminated: ok {rc=0} 20:43:04.617702 --- ParallelTerminationStrategy: PID 25428 died... 20:43:04.637234 run iperf3-srv_10.42.42.10(pid=25428): Terminated {rc=256} 20:43:04.682986 --- ParallelTerminationStrategy: PID 25429 died... 20:43:04.702302 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25429): Terminated: ok {rc=0} 20:43:04.748809 --- ParallelTerminationStrategy: PID 25430 died... 20:43:04.768449 run iperf3-srv_10.42.42.10(pid=25430): Terminated {rc=256} 20:43:04.814762 --- ParallelTerminationStrategy: PID 25431 died... 20:43:04.834158 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25431): Terminated: ok {rc=0} 20:43:04.880295 --- ParallelTerminationStrategy: PID 25432 died... 20:43:04.899826 run iperf3-srv_10.42.42.10(pid=25432): Terminated {rc=256} 20:43:04.946202 --- ParallelTerminationStrategy: PID 25433 died... 20:43:04.965419 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25433): Terminated: ok {rc=0} 20:43:05.011364 --- ParallelTerminationStrategy: PID 25434 died... 20:43:05.030959 run iperf3-srv_10.42.42.10(pid=25434): Terminated {rc=256} 20:43:05.076288 --- ParallelTerminationStrategy: PID 25437 died... 20:43:05.095923 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25437): Terminated: ok {rc=0} 20:43:05.141802 --- ParallelTerminationStrategy: PID 25440 died... 20:43:05.161109 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25440): Terminated: ok {rc=0} 20:43:05.206916 --- ParallelTerminationStrategy: PID 25443 died... 20:43:05.226005 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25443): Terminated: ok {rc=0} 20:43:05.315743 bus /gobi_4: Setting Powered False 20:43:06.418534 bus /gobi_4: Setting Powered False 20:43:07.537487 bus /gobi_1: Setting Powered False 20:43:08.640019 bus /gobi_1: Setting Powered False 20:43:09.759476 bus /gobi_0: Setting Powered False 20:43:10.861482 bus /gobi_0: Setting Powered False 20:43:11.979752 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:sysmo ping.py ---------------------------------------------- 20:43:13.085531 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:43:13.097452 tst gprs:sysmo: Using 1 x bts (candidates: 1) 20:43:13.134856 tst ping.py: using LAC 31382 20:43:13.268161 tst ping.py: using RAC 17 20:43:13.401634 tst ping.py: using CellId 31382 20:43:13.533223 tst ping.py: using BVCI 31383 20:43:13.656143 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:43:13.667372 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:43:13.678505 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:43:13.689587 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:43:13.700436 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:43:13.711397 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:43:13.722493 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:43:13.733567 tst gprs:sysmo: Using 1 x modem (candidates: 4) 20:43:13.857267 tst ping.py:19: start network... 20:43:14.083641 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:43:14.606742 run create_hlr_db(pid=25445): Launched 20:43:14.742209 bus /gobi_6: Setting Powered False 20:43:15.808388 run create_hlr_db(pid=25445): Terminated: ok {rc=0} 20:43:16.298807 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25447): Launched 20:43:16.659329 run osmo-hlr_10.42.42.2(pid=25448): Launched 20:43:16.969100 run osmo-stp_10.42.42.5: Starting osmo-stp 20:43:17.652173 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25450): Launched 20:43:17.968546 run osmo-stp_10.42.42.5(pid=25451): Launched 20:43:18.087786 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:43:18.627137 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25453): Launched 20:43:18.746591 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:43:19.012791 run patchelf(pid=25454): Launched 20:43:19.186868 run osmo-stp_10.42.42.5(pid=25451): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25451)] 20:43:19.318794 run osmo-stp_10.42.42.5(pid=25451): stdout: | (launched: 2022-12-12_20:43:17.908737) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:43:19.452790 run osmo-stp_10.42.42.5(pid=25451): stderr: | 20221212204318084 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204318084 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204318084 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204318085 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204318085 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204318085 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204318085 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:43:19.586863 run osmo-stp_10.42.42.5(pid=25451): stdout: | (launched: 2022-12-12_20:43:17.908737) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:43:19.715116 run osmo-stp_10.42.42.5(pid=25451): stderr: | 20221212204318084 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204318084 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204318084 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204318085 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204318085 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204318085 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204318085 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:43:19.867026 run patchelf(pid=25454): Terminating (SIGINT) 20:43:20.042189 run patchelf(pid=25454): Terminated: ok {rc=0} 20:43:20.169052 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=25451): Process ended prematurely: osmo-stp_10.42.42.5(pid=25451) [trial-2382↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25451)] [trial-2382↪gprs:sysmo↪ping.py:22] 20:43:20.177860 tst ping.py:22: Test FAILED (7.1 sec) 20:43:20.205405 run osmo-hlr_10.42.42.2(pid=25448): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:sysmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25448)] 20:43:20.255507 run osmo-hlr_10.42.42.2(pid=25448): stdout: | (launched: 2022-12-12_20:43:16.595391) 20:43:20.309516 run osmo-hlr_10.42.42.2(pid=25448): stderr: | 20221212204316827 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212204316827 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212204316827 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212204316827 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212204316827 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212204316828 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212204316842 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:sysmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212204316865 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212204316865 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212204316866 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:43:20.363967 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25447): Terminating (SIGTERM) 20:43:20.405937 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25450): Terminating (SIGTERM) 20:43:20.455991 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25453): Terminating (SIGTERM) 20:43:20.501606 --- ParallelTerminationStrategy: PID 25447 died... 20:43:20.521295 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25447): Terminated: ok {rc=0} 20:43:20.568476 --- ParallelTerminationStrategy: PID 25450 died... 20:43:20.587727 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25450): Terminated: ok {rc=0} 20:43:20.634458 --- ParallelTerminationStrategy: PID 25453 died... 20:43:20.653772 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25453): Terminated: ok {rc=0} 20:43:20.744693 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:sysmo ping_idle_ping.py ---------------------------------------------- 20:43:21.837256 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:43:21.849094 tst gprs:sysmo: Using 1 x bts (candidates: 1) 20:43:21.885521 tst ping_idle_ping.py: using LAC 31383 20:43:22.012344 tst ping_idle_ping.py: using RAC 18 20:43:22.146613 tst ping_idle_ping.py: using CellId 31383 20:43:22.281861 tst ping_idle_ping.py: using BVCI 31384 20:43:22.404517 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:43:22.415822 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:43:22.426998 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:43:22.438175 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:43:22.449155 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:43:22.460152 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:43:22.471335 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:43:22.482566 tst gprs:sysmo: Using 1 x modem (candidates: 4) 20:43:22.612219 tst ping_idle_ping.py:24: start network... 20:43:22.840036 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:43:23.362630 run create_hlr_db(pid=25464): Launched 20:43:23.498760 bus /gobi_6: Setting Powered False 20:43:24.565289 run create_hlr_db(pid=25464): Terminated: ok {rc=0} 20:43:25.012553 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25466): Launched 20:43:25.327595 run osmo-hlr_10.42.42.2(pid=25467): Launched 20:43:25.447894 run osmo-stp_10.42.42.5: Starting osmo-stp 20:43:25.987817 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25469): Launched 20:43:26.303101 run osmo-stp_10.42.42.5(pid=25470): Launched 20:43:26.424644 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:43:26.967529 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25472): Launched 20:43:27.088066 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:43:27.354683 run patchelf(pid=25473): Launched 20:43:27.528280 run osmo-stp_10.42.42.5(pid=25470): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25470)] 20:43:27.660755 run osmo-stp_10.42.42.5(pid=25470): stdout: | (launched: 2022-12-12_20:43:26.243102) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:43:27.794946 run osmo-stp_10.42.42.5(pid=25470): stderr: | 20221212204326418 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204326418 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204326419 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204326419 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204326419 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204326420 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204326420 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:43:27.929437 run osmo-stp_10.42.42.5(pid=25470): stdout: | (launched: 2022-12-12_20:43:26.243102) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:43:28.057625 run osmo-stp_10.42.42.5(pid=25470): stderr: | 20221212204326418 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204326418 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204326419 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204326419 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204326419 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204326420 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204326420 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:43:28.209918 run patchelf(pid=25473): Terminating (SIGINT) 20:43:28.386450 run patchelf(pid=25473): Terminated: ok {rc=0} 20:43:28.513621 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=25470): Process ended prematurely: osmo-stp_10.42.42.5(pid=25470) [trial-2382↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25470)] [trial-2382↪gprs:sysmo↪ping_idle_ping.py:27] 20:43:28.522437 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 20:43:28.549968 run osmo-hlr_10.42.42.2(pid=25467): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:sysmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25467)] 20:43:28.599334 run osmo-hlr_10.42.42.2(pid=25467): stdout: | (launched: 2022-12-12_20:43:25.268284) 20:43:28.650238 run osmo-hlr_10.42.42.2(pid=25467): stderr: | 20221212204325449 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212204325449 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212204325449 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212204325449 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212204325449 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212204325449 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212204325516 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:sysmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212204325525 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212204325525 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212204325525 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:43:28.701947 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25466): Terminating (SIGTERM) 20:43:28.743004 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25469): Terminating (SIGTERM) 20:43:28.783795 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25472): Terminating (SIGTERM) 20:43:28.825124 --- ParallelTerminationStrategy: PID 25466 died... 20:43:28.844557 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25466): Terminated: ok {rc=0} 20:43:28.890097 --- ParallelTerminationStrategy: PID 25469 died... 20:43:28.909132 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25469): Terminated: ok {rc=0} 20:43:28.954606 --- ParallelTerminationStrategy: PID 25472 died... 20:43:28.973555 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25472): Terminated: ok {rc=0} 20:43:29.061543 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2382 gprs:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 gprs:sysmo+mod-bts0-egprs --------------------------------------------------------------------- 20:43:30.350512 tst gprs:sysmo+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:43:30.356127 tst gprs:sysmo+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 20:43:30.378400 tst gprs:sysmo+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 20:43:30.417517 tst gprs:sysmo+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 20:43:30.505266 tst gprs:sysmo+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 20:43:30.525858 tst gprs:sysmo+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 20:43:30.564367 tst gprs:sysmo+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 20:43:31.182856 tst gprs:sysmo+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2382 gprs:sysmo+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 20:43:31.237943 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:43:31.250015 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 20:43:31.288695 tst cs_paging_gprs_active.py: using LAC 31384 20:43:31.423561 tst cs_paging_gprs_active.py: using RAC 19 20:43:31.555379 tst cs_paging_gprs_active.py: using CellId 31384 20:43:31.686246 tst cs_paging_gprs_active.py: using BVCI 31385 20:43:31.807543 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:43:31.819719 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:43:31.831547 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:43:31.843936 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:43:31.856291 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:43:31.868306 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:43:31.880653 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:43:31.893975 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:43:31.906778 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:43:32.029912 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:43:32.173631 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 20:43:32.413924 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:43:32.760686 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25477): Launched 20:43:33.060829 run iperf3-srv_10.42.42.10(pid=25478): Launched 20:43:33.190305 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 20:43:33.423886 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:43:33.771893 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25479): Launched 20:43:34.071735 run iperf3-srv_10.42.42.10(pid=25480): Launched 20:43:34.200193 tst cs_paging_gprs_active.py:38: start network... 20:43:34.433950 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:43:34.968222 run create_hlr_db(pid=25481): Launched 20:43:35.106826 bus /gobi_6: Setting Powered False 20:43:36.173961 run create_hlr_db(pid=25481): Terminated: ok {rc=0} 20:43:36.650634 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25483): Launched 20:43:36.995507 run osmo-hlr_10.42.42.2(pid=25484): Launched 20:43:37.126492 run osmo-stp_10.42.42.5: Starting osmo-stp 20:43:37.717277 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25486): Launched 20:43:38.061385 run osmo-stp_10.42.42.5(pid=25487): Launched 20:43:38.194530 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:43:38.788216 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25489): Launched 20:43:38.919093 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:43:39.210783 run patchelf(pid=25490): Launched 20:43:39.399842 run osmo-stp_10.42.42.5(pid=25487): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25487)] 20:43:39.544419 run osmo-stp_10.42.42.5(pid=25487): stdout: | (launched: 2022-12-12_20:43:37.996809) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:43:39.690439 run osmo-stp_10.42.42.5(pid=25487): stderr: | 20221212204338194 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204338195 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204338195 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204338195 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204338196 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204338196 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204338196 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:43:39.836332 run osmo-stp_10.42.42.5(pid=25487): stdout: | (launched: 2022-12-12_20:43:37.996809) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:43:39.977194 run osmo-stp_10.42.42.5(pid=25487): stderr: | 20221212204338194 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204338195 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204338195 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204338195 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204338196 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204338196 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204338196 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:43:40.143517 run patchelf(pid=25490): Terminating (SIGINT) 20:43:40.335384 run patchelf(pid=25490): Terminated: ok {rc=0} 20:43:40.474516 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=25487): Process ended prematurely: osmo-stp_10.42.42.5(pid=25487) [trial-2382↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25487)] [trial-2382↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 20:43:40.484828 tst cs_paging_gprs_active.py:38: Test FAILED (9.3 sec) 20:43:40.514213 run osmo-hlr_10.42.42.2(pid=25484): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25484)] 20:43:40.565835 run osmo-hlr_10.42.42.2(pid=25484): stdout: | (launched: 2022-12-12_20:43:36.931255) 20:43:40.619228 run osmo-hlr_10.42.42.2(pid=25484): stderr: | 20221212204337134 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212204337134 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212204337134 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212204337134 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212204337135 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212204337135 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212204337192 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:sysmo+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212204337202 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212204337203 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212204337203 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:43:40.673101 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25477): Terminating (SIGTERM) 20:43:40.716310 run iperf3-srv_10.42.42.10(pid=25478): Terminating (SIGTERM) 20:43:40.759571 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25479): Terminating (SIGTERM) 20:43:40.802767 run iperf3-srv_10.42.42.10(pid=25480): Terminating (SIGTERM) 20:43:40.845689 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25483): Terminating (SIGTERM) 20:43:40.888883 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25486): Terminating (SIGTERM) 20:43:40.932157 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25489): Terminating (SIGTERM) 20:43:40.975550 --- ParallelTerminationStrategy: PID 25477 died... 20:43:40.996313 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25477): Terminated: ok {rc=0} 20:43:41.044186 --- ParallelTerminationStrategy: PID 25478 died... 20:43:41.064186 run iperf3-srv_10.42.42.10(pid=25478): Terminated {rc=256} 20:43:41.111444 --- ParallelTerminationStrategy: PID 25479 died... 20:43:41.131656 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25479): Terminated: ok {rc=0} 20:43:41.179371 --- ParallelTerminationStrategy: PID 25480 died... 20:43:41.199370 run iperf3-srv_10.42.42.10(pid=25480): Terminated {rc=256} 20:43:41.246618 --- ParallelTerminationStrategy: PID 25483 died... 20:43:41.266761 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25483): Terminated: ok {rc=0} 20:43:41.314049 --- ParallelTerminationStrategy: PID 25486 died... 20:43:41.334239 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25486): Terminated: ok {rc=0} 20:43:41.382367 --- ParallelTerminationStrategy: PID 25489 died... 20:43:41.402689 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25489): Terminated: ok {rc=0} 20:43:41.493502 bus /gobi_0: Setting Powered False 20:43:42.595887 bus /gobi_0: Setting Powered False 20:43:43.717381 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:sysmo+mod-bts0-egprs iperf3.py ---------------------------------------------- 20:43:44.874393 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:43:44.886751 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 20:43:44.926554 tst iperf3.py: using LAC 31385 20:43:45.062378 tst iperf3.py: using RAC 20 20:43:45.197717 tst iperf3.py: using CellId 31385 20:43:45.334327 tst iperf3.py: using BVCI 31386 20:43:45.461043 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:43:45.472383 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:43:45.483701 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:43:45.495119 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:43:45.506543 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:43:45.517768 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:43:45.529320 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:43:45.540618 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:43:45.552173 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:43:45.674636 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 20:43:45.920094 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:43:46.274764 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25492): Launched 20:43:46.592380 run iperf3-srv_10.42.42.10(pid=25493): Launched 20:43:46.759113 tst iperf3.py:8: start network... 20:43:47.051082 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:43:47.587638 run create_hlr_db(pid=25494): Launched 20:43:47.725675 bus /gobi_6: Setting Powered False 20:43:48.792853 run create_hlr_db(pid=25494): Terminated: ok {rc=0} 20:43:49.248870 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25496): Launched 20:43:49.582962 run osmo-hlr_10.42.42.2(pid=25497): Launched 20:43:49.714218 run osmo-stp_10.42.42.5: Starting osmo-stp 20:43:50.303545 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25499): Launched 20:43:50.647739 run osmo-stp_10.42.42.5(pid=25500): Launched 20:43:50.776887 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:43:51.368576 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25502): Launched 20:43:51.500212 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:43:51.790335 run patchelf(pid=25503): Launched 20:43:51.981246 run osmo-stp_10.42.42.5(pid=25500): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25500)] 20:43:52.125179 run osmo-stp_10.42.42.5(pid=25500): stdout: | (launched: 2022-12-12_20:43:50.583727) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:43:52.270567 run osmo-stp_10.42.42.5(pid=25500): stderr: | 20221212204350782 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204350782 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204350782 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204350783 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204350783 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204350783 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204350783 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:43:52.416407 run osmo-stp_10.42.42.5(pid=25500): stdout: | (launched: 2022-12-12_20:43:50.583727) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:43:52.556898 run osmo-stp_10.42.42.5(pid=25500): stderr: | 20221212204350782 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204350782 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204350782 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204350783 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204350783 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204350783 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204350783 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:43:52.722646 run patchelf(pid=25503): Terminating (SIGINT) 20:43:52.914148 run patchelf(pid=25503): Terminated: ok {rc=0} 20:43:53.052225 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25500): Process ended prematurely: osmo-stp_10.42.42.5(pid=25500) [trial-2382↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25500)] [trial-2382↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8] 20:43:53.062621 tst iperf3.py:8: Test FAILED (8.2 sec) 20:43:53.091878 run osmo-hlr_10.42.42.2(pid=25497): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:sysmo+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25497)] 20:43:53.144002 run osmo-hlr_10.42.42.2(pid=25497): stdout: | (launched: 2022-12-12_20:43:49.518637) 20:43:53.197447 run osmo-hlr_10.42.42.2(pid=25497): stderr: | 20221212204349723 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212204349723 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212204349723 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212204349723 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212204349723 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212204349723 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212204349734 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:sysmo+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212204349743 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212204349743 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212204349743 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:43:53.251385 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25492): Terminating (SIGTERM) 20:43:53.294509 run iperf3-srv_10.42.42.10(pid=25493): Terminating (SIGTERM) 20:43:53.337622 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25496): Terminating (SIGTERM) 20:43:53.380809 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25499): Terminating (SIGTERM) 20:43:53.423866 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25502): Terminating (SIGTERM) 20:43:53.467067 --- ParallelTerminationStrategy: PID 25492 died... 20:43:53.487800 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25492): Terminated: ok {rc=0} 20:43:53.535740 --- ParallelTerminationStrategy: PID 25493 died... 20:43:53.555851 run iperf3-srv_10.42.42.10(pid=25493): Terminated {rc=256} 20:43:53.603090 --- ParallelTerminationStrategy: PID 25496 died... 20:43:53.623379 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25496): Terminated: ok {rc=0} 20:43:53.671027 --- ParallelTerminationStrategy: PID 25499 died... 20:43:53.691332 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25499): Terminated: ok {rc=0} 20:43:53.738852 --- ParallelTerminationStrategy: PID 25502 died... 20:43:53.759230 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25502): Terminated: ok {rc=0} 20:43:53.850203 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:sysmo+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 20:43:55.006996 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:43:55.019348 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 20:43:55.058476 tst iperf3m4.py: using LAC 31386 20:43:55.193308 tst iperf3m4.py: using RAC 21 20:43:55.327330 tst iperf3m4.py: using CellId 31386 20:43:55.462989 tst iperf3m4.py: using BVCI 31387 20:43:55.589176 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:43:55.600623 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:43:55.612030 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:43:55.623355 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:43:55.634606 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:43:55.645869 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:43:55.657391 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:43:55.668544 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:43:55.680061 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:43:55.799332 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:43:55.925130 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:43:56.049514 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:43:56.169048 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 20:43:56.386044 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:43:56.712460 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25504): Launched 20:43:56.993114 run iperf3-srv_10.42.42.10(pid=25505): Launched 20:43:57.113457 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 20:43:57.328384 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:43:57.651973 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25506): Launched 20:43:57.953224 run iperf3-srv_10.42.42.10(pid=25507): Launched 20:43:58.081389 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 20:43:58.312145 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:43:58.658606 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25508): Launched 20:43:58.957966 run iperf3-srv_10.42.42.10(pid=25509): Launched 20:43:59.088801 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 20:43:59.321074 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:43:59.668425 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25510): Launched 20:43:59.968173 run iperf3-srv_10.42.42.10(pid=25511): Launched 20:44:00.096523 tst iperf3m4.py:8: start network... 20:44:00.327961 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:44:00.863450 run create_hlr_db(pid=25512): Launched 20:44:01.054783 bus /gobi_6: Setting Powered False 20:44:02.121804 run create_hlr_db(pid=25512): Terminated: ok {rc=0} 20:44:02.576721 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25514): Launched 20:44:02.898739 run osmo-hlr_10.42.42.2(pid=25515): Launched 20:44:03.021109 run osmo-stp_10.42.42.5: Starting osmo-stp 20:44:03.570862 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25517): Launched 20:44:03.892539 run osmo-stp_10.42.42.5(pid=25518): Launched 20:44:04.015320 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:44:04.566913 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25520): Launched 20:44:04.689212 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:44:04.960776 run patchelf(pid=25521): Launched 20:44:05.137762 run osmo-stp_10.42.42.5(pid=25518): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25518)] 20:44:05.272014 run osmo-stp_10.42.42.5(pid=25518): stdout: | (launched: 2022-12-12_20:44:03.832072) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:44:05.408269 run osmo-stp_10.42.42.5(pid=25518): stderr: | 20221212204404007 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204404007 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204404008 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204404008 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204404009 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204404009 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204404009 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:44:05.544231 run osmo-stp_10.42.42.5(pid=25518): stdout: | (launched: 2022-12-12_20:44:03.832072) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:44:05.674740 run osmo-stp_10.42.42.5(pid=25518): stderr: | 20221212204404007 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204404007 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204404008 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204404008 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204404009 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204404009 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204404009 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:44:05.829089 run patchelf(pid=25521): Terminating (SIGINT) 20:44:06.007971 run patchelf(pid=25521): Terminated: ok {rc=0} 20:44:06.137723 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25518): Process ended prematurely: osmo-stp_10.42.42.5(pid=25518) [trial-2382↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25518)] [trial-2382↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8] 20:44:06.147279 tst iperf3m4.py:8: Test FAILED (11.2 sec) 20:44:06.176118 run osmo-hlr_10.42.42.2(pid=25515): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25515)] 20:44:06.225937 run osmo-hlr_10.42.42.2(pid=25515): stdout: | (launched: 2022-12-12_20:44:02.838319) 20:44:06.277766 run osmo-hlr_10.42.42.2(pid=25515): stderr: | 20221212204403018 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212204403018 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212204403018 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212204403018 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212204403018 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212204403018 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212204403030 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:sysmo+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212204403038 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212204403038 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212204403038 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:44:06.330020 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25504): Terminating (SIGTERM) 20:44:06.371669 run iperf3-srv_10.42.42.10(pid=25505): Terminating (SIGTERM) 20:44:06.413207 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25506): Terminating (SIGTERM) 20:44:06.454695 run iperf3-srv_10.42.42.10(pid=25507): Terminating (SIGTERM) 20:44:06.496063 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25508): Terminating (SIGTERM) 20:44:06.537434 run iperf3-srv_10.42.42.10(pid=25509): Terminating (SIGTERM) 20:44:06.578834 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25510): Terminating (SIGTERM) 20:44:06.620314 run iperf3-srv_10.42.42.10(pid=25511): Terminating (SIGTERM) 20:44:06.661811 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25514): Terminating (SIGTERM) 20:44:06.703447 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25517): Terminating (SIGTERM) 20:44:06.744745 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25520): Terminating (SIGTERM) 20:44:06.786369 --- ParallelTerminationStrategy: PID 25504 died... 20:44:06.806197 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25504): Terminated: ok {rc=0} 20:44:06.852344 --- ParallelTerminationStrategy: PID 25505 died... 20:44:06.871640 run iperf3-srv_10.42.42.10(pid=25505): Terminated {rc=256} 20:44:06.917331 --- ParallelTerminationStrategy: PID 25506 died... 20:44:06.936640 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25506): Terminated: ok {rc=0} 20:44:06.982406 --- ParallelTerminationStrategy: PID 25507 died... 20:44:07.001686 run iperf3-srv_10.42.42.10(pid=25507): Terminated {rc=256} 20:44:07.047325 --- ParallelTerminationStrategy: PID 25508 died... 20:44:07.066961 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25508): Terminated: ok {rc=0} 20:44:07.112930 --- ParallelTerminationStrategy: PID 25509 died... 20:44:07.132670 run iperf3-srv_10.42.42.10(pid=25509): Terminated {rc=256} 20:44:07.178566 --- ParallelTerminationStrategy: PID 25510 died... 20:44:07.197915 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25510): Terminated: ok {rc=0} 20:44:07.243747 --- ParallelTerminationStrategy: PID 25511 died... 20:44:07.263167 run iperf3-srv_10.42.42.10(pid=25511): Terminated {rc=256} 20:44:07.308896 --- ParallelTerminationStrategy: PID 25514 died... 20:44:07.328327 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25514): Terminated: ok {rc=0} 20:44:07.374261 --- ParallelTerminationStrategy: PID 25517 died... 20:44:07.393711 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25517): Terminated: ok {rc=0} 20:44:07.440092 --- ParallelTerminationStrategy: PID 25520 died... 20:44:07.459341 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25520): Terminated: ok {rc=0} 20:44:07.545909 bus /gobi_4: Setting Powered False 20:44:08.647891 bus /gobi_4: Setting Powered False 20:44:09.768857 bus /gobi_1: Setting Powered False 20:44:10.871407 bus /gobi_1: Setting Powered False 20:44:11.991406 bus /gobi_0: Setting Powered False 20:44:13.093033 bus /gobi_0: Setting Powered False 20:44:14.216495 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:sysmo+mod-bts0-egprs ping.py ---------------------------------------------- 20:44:15.322229 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:44:15.333785 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 20:44:15.376918 tst ping.py: using LAC 31387 20:44:15.500528 tst ping.py: using RAC 22 20:44:15.621973 tst ping.py: using CellId 31387 20:44:15.745363 tst ping.py: using BVCI 31388 20:44:15.879018 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:44:15.890536 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:44:15.902215 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:44:15.914351 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:44:15.926785 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:44:15.938599 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:44:15.950960 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:44:15.962888 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:44:16.091682 tst ping.py:19: start network... 20:44:16.351562 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:44:16.859160 run create_hlr_db(pid=25523): Launched 20:44:17.016138 bus /gobi_6: Setting Powered False 20:44:18.077607 run create_hlr_db(pid=25523): Terminated: ok {rc=0} 20:44:18.516620 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25525): Launched 20:44:18.832328 run osmo-hlr_10.42.42.2(pid=25526): Launched 20:44:18.951463 run osmo-stp_10.42.42.5: Starting osmo-stp 20:44:19.503585 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25528): Launched 20:44:19.818269 run osmo-stp_10.42.42.5(pid=25529): Launched 20:44:19.938675 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:44:20.480053 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25531): Launched 20:44:20.600195 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:44:20.866989 run patchelf(pid=25532): Launched 20:44:21.040671 run osmo-stp_10.42.42.5(pid=25529): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25529)] 20:44:21.172791 run osmo-stp_10.42.42.5(pid=25529): stdout: | (launched: 2022-12-12_20:44:19.758744) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:44:21.306243 run osmo-stp_10.42.42.5(pid=25529): stderr: | 20221212204419935 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204419935 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204419935 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204419935 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204419936 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204419936 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204419936 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:44:21.439985 run osmo-stp_10.42.42.5(pid=25529): stdout: | (launched: 2022-12-12_20:44:19.758744) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:44:21.568036 run osmo-stp_10.42.42.5(pid=25529): stderr: | 20221212204419935 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204419935 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204419935 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204419935 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204419936 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204419936 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204419936 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:44:21.719966 run patchelf(pid=25532): Terminating (SIGINT) 20:44:21.895500 run patchelf(pid=25532): Terminated: ok {rc=0} 20:44:22.022107 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=25529): Process ended prematurely: osmo-stp_10.42.42.5(pid=25529) [trial-2382↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25529)] [trial-2382↪gprs:sysmo+mod-bts0-egprs↪ping.py:22] 20:44:22.031000 tst ping.py:22: Test FAILED (6.7 sec) 20:44:22.058934 run osmo-hlr_10.42.42.2(pid=25526): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:sysmo+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25526)] 20:44:22.108694 run osmo-hlr_10.42.42.2(pid=25526): stdout: | (launched: 2022-12-12_20:44:18.773132) 20:44:22.159645 run osmo-hlr_10.42.42.2(pid=25526): stderr: | 20221212204418953 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212204418953 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212204418953 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212204418953 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212204418953 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212204418953 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212204418969 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:sysmo+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212204418979 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212204418980 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212204418980 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:44:22.211383 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25525): Terminating (SIGTERM) 20:44:22.252629 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25528): Terminating (SIGTERM) 20:44:22.293584 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25531): Terminating (SIGTERM) 20:44:22.334740 --- ParallelTerminationStrategy: PID 25525 died... 20:44:22.354656 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25525): Terminated: ok {rc=0} 20:44:22.400467 --- ParallelTerminationStrategy: PID 25528 died... 20:44:22.419473 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25528): Terminated: ok {rc=0} 20:44:22.465266 --- ParallelTerminationStrategy: PID 25531 died... 20:44:22.484486 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25531): Terminated: ok {rc=0} 20:44:22.572484 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:sysmo+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 20:44:23.663617 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:44:23.675772 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 20:44:23.719720 tst ping_idle_ping.py: using LAC 31388 20:44:23.844561 tst ping_idle_ping.py: using RAC 23 20:44:23.966573 tst ping_idle_ping.py: using CellId 31388 20:44:24.089594 tst ping_idle_ping.py: using BVCI 31389 20:44:24.206010 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:44:24.216867 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:44:24.227705 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:44:24.238820 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:44:24.249843 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:44:24.260634 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:44:24.271764 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:44:24.282783 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:44:24.412854 tst ping_idle_ping.py:24: start network... 20:44:24.640168 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:44:25.163715 run create_hlr_db(pid=25533): Launched 20:44:25.300414 bus /gobi_6: Setting Powered False 20:44:26.363373 run create_hlr_db(pid=25533): Terminated: ok {rc=0} 20:44:26.812183 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25535): Launched 20:44:27.128213 run osmo-hlr_10.42.42.2(pid=25536): Launched 20:44:27.248167 run osmo-stp_10.42.42.5: Starting osmo-stp 20:44:27.806997 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25538): Launched 20:44:28.123561 run osmo-stp_10.42.42.5(pid=25539): Launched 20:44:28.243973 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:44:28.789348 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25541): Launched 20:44:28.909641 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:44:29.178553 run patchelf(pid=25542): Launched 20:44:29.352273 run osmo-stp_10.42.42.5(pid=25539): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25539)] 20:44:29.484368 run osmo-stp_10.42.42.5(pid=25539): stdout: | (launched: 2022-12-12_20:44:28.063691) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:44:29.618219 run osmo-stp_10.42.42.5(pid=25539): stderr: | 20221212204428237 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204428237 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204428238 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204428238 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204428239 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204428239 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204428239 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:44:29.752191 run osmo-stp_10.42.42.5(pid=25539): stdout: | (launched: 2022-12-12_20:44:28.063691) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:44:29.880389 run osmo-stp_10.42.42.5(pid=25539): stderr: | 20221212204428237 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204428237 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204428238 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204428238 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204428239 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204428239 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204428239 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:44:30.032497 run patchelf(pid=25542): Terminating (SIGINT) 20:44:30.208428 run patchelf(pid=25542): Terminated: ok {rc=0} 20:44:30.335405 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=25539): Process ended prematurely: osmo-stp_10.42.42.5(pid=25539) [trial-2382↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25539)] [trial-2382↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27] 20:44:30.344418 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 20:44:30.371971 run osmo-hlr_10.42.42.2(pid=25536): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25536)] 20:44:30.421208 run osmo-hlr_10.42.42.2(pid=25536): stdout: | (launched: 2022-12-12_20:44:27.068656) 20:44:30.472056 run osmo-hlr_10.42.42.2(pid=25536): stderr: | 20221212204427248 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212204427248 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212204427248 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212204427248 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212204427248 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212204427248 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212204427261 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:sysmo+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212204427271 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212204427271 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212204427271 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:44:30.523356 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25535): Terminating (SIGTERM) 20:44:30.564311 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25538): Terminating (SIGTERM) 20:44:30.605248 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25541): Terminating (SIGTERM) 20:44:30.646561 --- ParallelTerminationStrategy: PID 25535 died... 20:44:30.666304 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25535): Terminated: ok {rc=0} 20:44:30.712091 --- ParallelTerminationStrategy: PID 25538 died... 20:44:30.731153 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25538): Terminated: ok {rc=0} 20:44:30.776637 --- ParallelTerminationStrategy: PID 25541 died... 20:44:30.795851 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25541): Terminated: ok {rc=0} 20:44:30.911070 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2382 gprs:sysmo+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 gprs:sysmo+mod-bts0-dynts-ipa --------------------------------------------------------------------- 20:44:32.220384 tst gprs:sysmo+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:44:32.226850 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 20:44:32.249193 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 20:44:32.290650 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 20:44:32.386429 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 20:44:32.407386 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 20:44:32.446447 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 20:44:33.032926 tst gprs:sysmo+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2382 gprs:sysmo+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 20:44:33.084918 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:44:33.095890 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 20:44:33.150755 tst cs_paging_gprs_active.py: using LAC 31389 20:44:33.273557 tst cs_paging_gprs_active.py: using RAC 24 20:44:33.407589 tst cs_paging_gprs_active.py: using CellId 31389 20:44:33.540184 tst cs_paging_gprs_active.py: using BVCI 31390 20:44:33.664881 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:44:33.676623 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:44:33.688077 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:44:33.699501 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:44:33.710671 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:44:33.722094 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:44:33.733665 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:44:33.744727 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:44:33.756147 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:44:33.876474 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:44:34.000027 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 20:44:34.232364 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:44:34.573083 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25549): Launched 20:44:34.852686 run iperf3-srv_10.42.42.10(pid=25550): Launched 20:44:34.973230 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 20:44:35.188246 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:44:35.511551 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25551): Launched 20:44:35.790735 run iperf3-srv_10.42.42.10(pid=25552): Launched 20:44:35.910336 tst cs_paging_gprs_active.py:38: start network... 20:44:36.124854 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:44:36.620187 run create_hlr_db(pid=25553): Launched 20:44:36.743291 bus /gobi_6: Setting Powered False 20:44:37.806571 run create_hlr_db(pid=25553): Terminated: ok {rc=0} 20:44:38.274053 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25555): Launched 20:44:38.620169 run osmo-hlr_10.42.42.2(pid=25556): Launched 20:44:38.751556 run osmo-stp_10.42.42.5: Starting osmo-stp 20:44:39.344810 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25558): Launched 20:44:39.688425 run osmo-stp_10.42.42.5(pid=25559): Launched 20:44:39.819547 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:44:40.412878 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25561): Launched 20:44:40.543243 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:44:40.834339 run patchelf(pid=25562): Launched 20:44:41.025238 run osmo-stp_10.42.42.5(pid=25559): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25559)] 20:44:41.169209 run osmo-stp_10.42.42.5(pid=25559): stdout: | (launched: 2022-12-12_20:44:39.624393) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:44:41.314821 run osmo-stp_10.42.42.5(pid=25559): stderr: | 20221212204439819 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204439819 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204439820 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204439820 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204439820 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204439821 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204439821 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:44:41.460481 run osmo-stp_10.42.42.5(pid=25559): stdout: | (launched: 2022-12-12_20:44:39.624393) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:44:41.600150 run osmo-stp_10.42.42.5(pid=25559): stderr: | 20221212204439819 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204439819 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204439820 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204439820 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204439820 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204439821 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204439821 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:44:41.766026 run patchelf(pid=25562): Terminating (SIGINT) 20:44:41.958448 run patchelf(pid=25562): Terminated: ok {rc=0} 20:44:42.096387 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=25559): Process ended prematurely: osmo-stp_10.42.42.5(pid=25559) [trial-2382↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25559)] [trial-2382↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 20:44:42.106770 tst cs_paging_gprs_active.py:38: Test FAILED (9.1 sec) 20:44:42.136138 run osmo-hlr_10.42.42.2(pid=25556): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25556)] 20:44:42.187481 run osmo-hlr_10.42.42.2(pid=25556): stdout: | (launched: 2022-12-12_20:44:38.555740) 20:44:42.240523 run osmo-hlr_10.42.42.2(pid=25556): stderr: | 20221212204438761 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212204438761 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212204438761 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212204438761 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212204438761 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212204438761 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212204438773 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:sysmo+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212204438782 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212204438783 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212204438783 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:44:42.294701 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25549): Terminating (SIGTERM) 20:44:42.337535 run iperf3-srv_10.42.42.10(pid=25550): Terminating (SIGTERM) 20:44:42.380297 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25551): Terminating (SIGTERM) 20:44:42.423210 run iperf3-srv_10.42.42.10(pid=25552): Terminating (SIGTERM) 20:44:42.466050 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25555): Terminating (SIGTERM) 20:44:42.509186 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25558): Terminating (SIGTERM) 20:44:42.552014 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25561): Terminating (SIGTERM) 20:44:42.595196 --- ParallelTerminationStrategy: PID 25549 died... 20:44:42.615821 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25549): Terminated: ok {rc=0} 20:44:42.663826 --- ParallelTerminationStrategy: PID 25550 died... 20:44:42.683770 run iperf3-srv_10.42.42.10(pid=25550): Terminated {rc=256} 20:44:42.730982 --- ParallelTerminationStrategy: PID 25551 died... 20:44:42.751009 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25551): Terminated: ok {rc=0} 20:44:42.798110 --- ParallelTerminationStrategy: PID 25552 died... 20:44:42.818018 run iperf3-srv_10.42.42.10(pid=25552): Terminated {rc=256} 20:44:42.865170 --- ParallelTerminationStrategy: PID 25555 died... 20:44:42.885235 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25555): Terminated: ok {rc=0} 20:44:42.932890 --- ParallelTerminationStrategy: PID 25558 died... 20:44:42.953226 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25558): Terminated: ok {rc=0} 20:44:43.000439 --- ParallelTerminationStrategy: PID 25561 died... 20:44:43.020579 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25561): Terminated: ok {rc=0} 20:44:43.109967 bus /gobi_0: Setting Powered False 20:44:44.210986 bus /gobi_0: Setting Powered False 20:44:45.329368 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:sysmo+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 20:44:46.493268 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:44:46.506256 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 20:44:46.572376 tst iperf3.py: using LAC 31390 20:44:46.707399 tst iperf3.py: using RAC 25 20:44:46.845368 tst iperf3.py: using CellId 31390 20:44:46.982248 tst iperf3.py: using BVCI 31391 20:44:47.102964 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:44:47.115395 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:44:47.127493 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:44:47.140329 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:44:47.152761 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:44:47.166752 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:44:47.178913 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:44:47.191887 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:44:47.204133 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:44:47.328321 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 20:44:47.559751 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:44:47.903736 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25563): Launched 20:44:48.202406 run iperf3-srv_10.42.42.10(pid=25564): Launched 20:44:48.330433 tst iperf3.py:8: start network... 20:44:48.561914 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:44:49.094699 run create_hlr_db(pid=25565): Launched 20:44:49.234261 bus /gobi_6: Setting Powered False 20:44:50.302229 run create_hlr_db(pid=25565): Terminated: ok {rc=0} 20:44:50.756740 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25567): Launched 20:44:51.077534 run osmo-hlr_10.42.42.2(pid=25568): Launched 20:44:51.203110 run osmo-stp_10.42.42.5: Starting osmo-stp 20:44:51.768937 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25570): Launched 20:44:52.089244 run osmo-stp_10.42.42.5(pid=25571): Launched 20:44:52.210623 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:44:52.759678 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25573): Launched 20:44:52.881746 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:44:53.153880 run patchelf(pid=25574): Launched 20:44:53.330884 run osmo-stp_10.42.42.5(pid=25571): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25571)] 20:44:53.465571 run osmo-stp_10.42.42.5(pid=25571): stdout: | (launched: 2022-12-12_20:44:52.029198) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:44:53.601528 run osmo-stp_10.42.42.5(pid=25571): stderr: | 20221212204452205 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204452205 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204452205 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204452206 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204452206 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204452206 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204452206 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:44:53.737680 run osmo-stp_10.42.42.5(pid=25571): stdout: | (launched: 2022-12-12_20:44:52.029198) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:44:53.868485 run osmo-stp_10.42.42.5(pid=25571): stderr: | 20221212204452205 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204452205 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204452205 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204452206 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204452206 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204452206 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204452206 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:44:54.023004 run patchelf(pid=25574): Terminating (SIGINT) 20:44:54.201993 run patchelf(pid=25574): Terminated: ok {rc=0} 20:44:54.330922 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25571): Process ended prematurely: osmo-stp_10.42.42.5(pid=25571) [trial-2382↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25571)] [trial-2382↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8] 20:44:54.340378 tst iperf3.py:8: Test FAILED (7.9 sec) 20:44:54.368631 run osmo-hlr_10.42.42.2(pid=25568): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25568)] 20:44:54.418437 run osmo-hlr_10.42.42.2(pid=25568): stdout: | (launched: 2022-12-12_20:44:51.017416) 20:44:54.469830 run osmo-hlr_10.42.42.2(pid=25568): stderr: | 20221212204451198 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212204451198 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212204451198 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212204451198 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212204451198 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212204451198 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212204451210 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:sysmo+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212204451218 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212204451218 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212204451218 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:44:54.521690 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25563): Terminating (SIGTERM) 20:44:54.562863 run iperf3-srv_10.42.42.10(pid=25564): Terminating (SIGTERM) 20:44:54.604136 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25567): Terminating (SIGTERM) 20:44:54.645681 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25570): Terminating (SIGTERM) 20:44:54.687063 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25573): Terminating (SIGTERM) 20:44:54.728644 --- ParallelTerminationStrategy: PID 25563 died... 20:44:54.748458 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25563): Terminated: ok {rc=0} 20:44:54.794392 --- ParallelTerminationStrategy: PID 25564 died... 20:44:54.813703 run iperf3-srv_10.42.42.10(pid=25564): Terminated {rc=256} 20:44:54.859163 --- ParallelTerminationStrategy: PID 25567 died... 20:44:54.878333 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25567): Terminated: ok {rc=0} 20:44:54.923825 --- ParallelTerminationStrategy: PID 25570 died... 20:44:54.943061 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25570): Terminated: ok {rc=0} 20:44:54.988639 --- ParallelTerminationStrategy: PID 25573 died... 20:44:55.007935 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25573): Terminated: ok {rc=0} 20:44:55.096637 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:sysmo+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 20:44:56.249419 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:44:56.261242 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 20:44:56.318579 tst iperf3m4.py: using LAC 31391 20:44:56.445721 tst iperf3m4.py: using RAC 26 20:44:56.572456 tst iperf3m4.py: using CellId 31391 20:44:56.698226 tst iperf3m4.py: using BVCI 31392 20:44:56.815820 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:44:56.826880 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:44:56.837691 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:44:56.848690 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:44:56.859746 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:44:56.870853 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:44:56.882227 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:44:56.893196 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:44:56.904297 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:44:57.029697 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:44:57.153130 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:44:57.276508 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:44:57.396438 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 20:44:57.629901 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:44:57.975876 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25575): Launched 20:44:58.276325 run iperf3-srv_10.42.42.10(pid=25576): Launched 20:44:58.404502 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 20:44:58.636583 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:44:58.983038 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25577): Launched 20:44:59.283224 run iperf3-srv_10.42.42.10(pid=25578): Launched 20:44:59.411802 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 20:44:59.643219 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:44:59.989231 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25579): Launched 20:45:00.288232 run iperf3-srv_10.42.42.10(pid=25580): Launched 20:45:00.416232 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 20:45:00.647442 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:45:01.014261 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25581): Launched 20:45:01.413665 run iperf3-srv_10.42.42.10(pid=25585): Launched 20:45:01.548032 tst iperf3m4.py:8: start network... 20:45:01.770849 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:45:02.300413 run create_hlr_db(pid=25586): Launched 20:45:02.453719 bus /gobi_6: Setting Powered False 20:45:03.517276 run create_hlr_db(pid=25586): Terminated: ok {rc=0} 20:45:03.983441 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25588): Launched 20:45:04.326451 run osmo-hlr_10.42.42.2(pid=25589): Launched 20:45:04.457502 run osmo-stp_10.42.42.5: Starting osmo-stp 20:45:05.048858 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25591): Launched 20:45:05.391340 run osmo-stp_10.42.42.5(pid=25592): Launched 20:45:05.520409 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:45:06.110935 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25594): Launched 20:45:06.240121 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:45:06.529946 run patchelf(pid=25595): Launched 20:45:06.718642 run osmo-stp_10.42.42.5(pid=25592): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25592)] 20:45:06.861646 run osmo-stp_10.42.42.5(pid=25592): stdout: | (launched: 2022-12-12_20:45:05.327232) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:45:07.006557 run osmo-stp_10.42.42.5(pid=25592): stderr: | 20221212204505525 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204505526 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204505526 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204505526 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204505527 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204505527 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204505527 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:45:07.151530 run osmo-stp_10.42.42.5(pid=25592): stdout: | (launched: 2022-12-12_20:45:05.327232) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:45:07.290784 run osmo-stp_10.42.42.5(pid=25592): stderr: | 20221212204505525 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204505526 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204505526 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204505526 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204505527 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204505527 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204505527 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:45:07.455961 run patchelf(pid=25595): Terminating (SIGINT) 20:45:07.646517 run patchelf(pid=25595): Terminated: ok {rc=0} 20:45:07.784085 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25592): Process ended prematurely: osmo-stp_10.42.42.5(pid=25592) [trial-2382↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25592)] [trial-2382↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8] 20:45:07.794394 tst iperf3m4.py:8: Test FAILED (11.6 sec) 20:45:07.823882 run osmo-hlr_10.42.42.2(pid=25589): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25589)] 20:45:07.875369 run osmo-hlr_10.42.42.2(pid=25589): stdout: | (launched: 2022-12-12_20:45:04.262225) 20:45:07.928409 run osmo-hlr_10.42.42.2(pid=25589): stderr: | 20221212204504467 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212204504467 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212204504467 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212204504467 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212204504467 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212204504467 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212204504480 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:sysmo+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212204504490 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212204504490 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212204504490 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:45:07.982531 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25575): Terminating (SIGTERM) 20:45:08.025756 run iperf3-srv_10.42.42.10(pid=25576): Terminating (SIGTERM) 20:45:08.068768 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25577): Terminating (SIGTERM) 20:45:08.112209 run iperf3-srv_10.42.42.10(pid=25578): Terminating (SIGTERM) 20:45:08.155335 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25579): Terminating (SIGTERM) 20:45:08.198668 run iperf3-srv_10.42.42.10(pid=25580): Terminating (SIGTERM) 20:45:08.241786 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25581): Terminating (SIGTERM) 20:45:08.285054 run iperf3-srv_10.42.42.10(pid=25585): Terminating (SIGTERM) 20:45:08.328113 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25588): Terminating (SIGTERM) 20:45:08.371239 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25591): Terminating (SIGTERM) 20:45:08.414335 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25594): Terminating (SIGTERM) 20:45:08.457817 --- ParallelTerminationStrategy: PID 25575 died... 20:45:08.478531 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25575): Terminated: ok {rc=0} 20:45:08.526235 --- ParallelTerminationStrategy: PID 25576 died... 20:45:08.546159 run iperf3-srv_10.42.42.10(pid=25576): Terminated {rc=256} 20:45:08.593587 --- ParallelTerminationStrategy: PID 25577 died... 20:45:08.613713 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25577): Terminated: ok {rc=0} 20:45:08.661615 --- ParallelTerminationStrategy: PID 25578 died... 20:45:08.681645 run iperf3-srv_10.42.42.10(pid=25578): Terminated {rc=256} 20:45:08.729335 --- ParallelTerminationStrategy: PID 25579 died... 20:45:08.749372 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25579): Terminated: ok {rc=0} 20:45:08.796566 --- ParallelTerminationStrategy: PID 25580 died... 20:45:08.816613 run iperf3-srv_10.42.42.10(pid=25580): Terminated {rc=256} 20:45:08.863838 --- ParallelTerminationStrategy: PID 25581 died... 20:45:08.883872 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25581): Terminated: ok {rc=0} 20:45:08.931179 --- ParallelTerminationStrategy: PID 25585 died... 20:45:08.951548 run iperf3-srv_10.42.42.10(pid=25585): Terminated {rc=256} 20:45:08.999022 --- ParallelTerminationStrategy: PID 25588 died... 20:45:09.019404 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25588): Terminated: ok {rc=0} 20:45:09.067010 --- ParallelTerminationStrategy: PID 25591 died... 20:45:09.087100 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25591): Terminated: ok {rc=0} 20:45:09.134919 --- ParallelTerminationStrategy: PID 25594 died... 20:45:09.155295 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25594): Terminated: ok {rc=0} 20:45:09.246137 bus /gobi_4: Setting Powered False 20:45:10.349255 bus /gobi_4: Setting Powered False 20:45:11.471316 bus /gobi_1: Setting Powered False 20:45:12.571458 bus /gobi_1: Setting Powered False 20:45:13.689994 bus /gobi_0: Setting Powered False 20:45:14.790887 bus /gobi_0: Setting Powered False 20:45:15.931781 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:sysmo+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 20:45:17.035899 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:45:17.049143 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 20:45:17.112461 tst ping.py: using LAC 31392 20:45:17.239607 tst ping.py: using RAC 27 20:45:17.369348 tst ping.py: using CellId 31392 20:45:17.494561 tst ping.py: using BVCI 31393 20:45:17.611287 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:45:17.622525 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:45:17.633609 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:45:17.645284 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:45:17.656643 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:45:17.668172 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:45:17.679892 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:45:17.691460 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:45:17.814525 tst ping.py:19: start network... 20:45:18.041754 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:45:18.564542 run create_hlr_db(pid=25596): Launched 20:45:18.700428 bus /gobi_6: Setting Powered False 20:45:19.766280 run create_hlr_db(pid=25596): Terminated: ok {rc=0} 20:45:20.214890 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25598): Launched 20:45:20.530868 run osmo-hlr_10.42.42.2(pid=25599): Launched 20:45:20.650924 run osmo-stp_10.42.42.5: Starting osmo-stp 20:45:21.221683 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25601): Launched 20:45:21.538950 run osmo-stp_10.42.42.5(pid=25602): Launched 20:45:21.659326 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:45:22.199902 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25604): Launched 20:45:22.328233 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:45:22.614133 run patchelf(pid=25605): Launched 20:45:22.800418 run osmo-stp_10.42.42.5(pid=25602): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25602)] 20:45:22.941065 run osmo-stp_10.42.42.5(pid=25602): stdout: | (launched: 2022-12-12_20:45:21.479027) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:45:23.084881 run osmo-stp_10.42.42.5(pid=25602): stderr: | 20221212204521654 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204521654 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204521655 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204521655 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204521656 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204521656 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204521656 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:45:23.227837 run osmo-stp_10.42.42.5(pid=25602): stdout: | (launched: 2022-12-12_20:45:21.479027) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:45:23.365694 run osmo-stp_10.42.42.5(pid=25602): stderr: | 20221212204521654 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204521654 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204521655 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204521655 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204521656 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204521656 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204521656 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:45:23.528115 run patchelf(pid=25605): Terminating (SIGINT) 20:45:23.715794 run patchelf(pid=25605): Terminated: ok {rc=0} 20:45:23.850881 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=25602): Process ended prematurely: osmo-stp_10.42.42.5(pid=25602) [trial-2382↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25602)] [trial-2382↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22] 20:45:23.860891 tst ping.py:22: Test FAILED (6.8 sec) 20:45:23.889697 run osmo-hlr_10.42.42.2(pid=25599): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25599)] 20:45:23.941283 run osmo-hlr_10.42.42.2(pid=25599): stdout: | (launched: 2022-12-12_20:45:20.471773) 20:45:23.994782 run osmo-hlr_10.42.42.2(pid=25599): stderr: | 20221212204520649 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212204520649 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212204520649 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212204520649 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212204520649 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212204520650 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212204520663 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:sysmo+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212204520671 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212204520672 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212204520672 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:45:24.048505 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25598): Terminating (SIGTERM) 20:45:24.091557 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25601): Terminating (SIGTERM) 20:45:24.134542 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25604): Terminating (SIGTERM) 20:45:24.177774 --- ParallelTerminationStrategy: PID 25598 died... 20:45:24.198452 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25598): Terminated: ok {rc=0} 20:45:24.245937 --- ParallelTerminationStrategy: PID 25601 died... 20:45:24.266073 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25601): Terminated: ok {rc=0} 20:45:24.313344 --- ParallelTerminationStrategy: PID 25604 died... 20:45:24.333392 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25604): Terminated: ok {rc=0} 20:45:24.423938 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:sysmo+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 20:45:25.515081 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:45:25.527621 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 20:45:25.587015 tst ping_idle_ping.py: using LAC 31393 20:45:25.719262 tst ping_idle_ping.py: using RAC 28 20:45:25.851593 tst ping_idle_ping.py: using CellId 31393 20:45:25.985079 tst ping_idle_ping.py: using BVCI 31394 20:45:26.107872 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:45:26.119459 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:45:26.130864 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:45:26.142172 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:45:26.153491 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:45:26.164681 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:45:26.176182 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:45:26.187445 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:45:26.308149 tst ping_idle_ping.py:24: start network... 20:45:26.534710 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:45:27.060676 run create_hlr_db(pid=25606): Launched 20:45:27.196537 bus /gobi_6: Setting Powered False 20:45:28.262778 run create_hlr_db(pid=25606): Terminated: ok {rc=0} 20:45:28.734444 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25608): Launched 20:45:29.075279 run osmo-hlr_10.42.42.2(pid=25609): Launched 20:45:29.204332 run osmo-stp_10.42.42.5: Starting osmo-stp 20:45:29.790504 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25611): Launched 20:45:30.130944 run osmo-stp_10.42.42.5(pid=25612): Launched 20:45:30.259668 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:45:30.849652 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25614): Launched 20:45:31.008686 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:45:31.290129 run patchelf(pid=25615): Launched 20:45:31.487409 run osmo-stp_10.42.42.5(pid=25612): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25612)] 20:45:31.627240 run osmo-stp_10.42.42.5(pid=25612): stdout: | (launched: 2022-12-12_20:45:30.067655) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:45:31.769181 run osmo-stp_10.42.42.5(pid=25612): stderr: | 20221212204530265 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204530265 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204530265 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204530266 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204530266 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204530266 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204530266 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:45:31.910268 run osmo-stp_10.42.42.5(pid=25612): stdout: | (launched: 2022-12-12_20:45:30.067655) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:45:32.044605 run osmo-stp_10.42.42.5(pid=25612): stderr: | 20221212204530265 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204530265 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204530265 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204530266 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204530266 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204530266 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204530266 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:45:32.206721 run patchelf(pid=25615): Terminating (SIGINT) 20:45:32.386850 run patchelf(pid=25615): Terminated: ok {rc=0} 20:45:32.516821 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=25612): Process ended prematurely: osmo-stp_10.42.42.5(pid=25612) [trial-2382↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25612)] [trial-2382↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 20:45:32.526255 tst ping_idle_ping.py:27: Test FAILED (7.0 sec) 20:45:32.554604 run osmo-hlr_10.42.42.2(pid=25609): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25609)] 20:45:32.605915 run osmo-hlr_10.42.42.2(pid=25609): stdout: | (launched: 2022-12-12_20:45:29.011736) 20:45:32.658115 run osmo-hlr_10.42.42.2(pid=25609): stderr: | 20221212204529214 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212204529214 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212204529214 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212204529214 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212204529214 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212204529214 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212204529226 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:sysmo+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212204529235 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212204529235 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212204529235 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:45:32.710967 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25608): Terminating (SIGTERM) 20:45:32.753111 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25611): Terminating (SIGTERM) 20:45:32.794962 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25614): Terminating (SIGTERM) 20:45:32.837283 --- ParallelTerminationStrategy: PID 25608 died... 20:45:32.857103 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25608): Terminated: ok {rc=0} 20:45:32.904380 --- ParallelTerminationStrategy: PID 25611 died... 20:45:32.923822 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25611): Terminated: ok {rc=0} 20:45:32.971172 --- ParallelTerminationStrategy: PID 25614 died... 20:45:32.990626 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25614): Terminated: ok {rc=0} 20:45:33.080129 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2382 gprs:sysmo+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 gprs:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 20:45:34.372911 tst gprs:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:45:34.380828 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 20:45:34.403844 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 20:45:34.444146 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 20:45:34.530753 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 20:45:34.551773 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 20:45:34.590715 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 20:45:35.183874 tst gprs:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2382 gprs:sysmo+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 20:45:35.242315 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:45:35.254101 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:45:35.317763 tst cs_paging_gprs_active.py: using LAC 31394 20:45:35.451832 tst cs_paging_gprs_active.py: using RAC 29 20:45:35.576551 tst cs_paging_gprs_active.py: using CellId 31394 20:45:35.699271 tst cs_paging_gprs_active.py: using BVCI 31395 20:45:35.816713 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:45:35.827891 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:45:35.838771 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:45:35.849791 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:45:35.860699 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:45:35.871780 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:45:35.882906 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:45:35.893860 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:45:35.904905 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:45:36.026980 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:45:36.148561 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 20:45:36.364478 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:45:36.687197 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25619): Launched 20:45:36.966288 run iperf3-srv_10.42.42.10(pid=25620): Launched 20:45:37.086188 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 20:45:37.301071 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:45:37.623113 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25621): Launched 20:45:37.901757 run iperf3-srv_10.42.42.10(pid=25622): Launched 20:45:38.022215 tst cs_paging_gprs_active.py:38: start network... 20:45:38.237787 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:45:38.735389 run create_hlr_db(pid=25623): Launched 20:45:38.857385 bus /gobi_6: Setting Powered False 20:45:39.920686 run create_hlr_db(pid=25623): Terminated: ok {rc=0} 20:45:40.387077 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25625): Launched 20:45:40.731113 run osmo-hlr_10.42.42.2(pid=25626): Launched 20:45:40.861796 run osmo-stp_10.42.42.5: Starting osmo-stp 20:45:41.451894 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25628): Launched 20:45:41.794142 run osmo-stp_10.42.42.5(pid=25629): Launched 20:45:41.925533 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:45:42.518974 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25631): Launched 20:45:42.649360 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:45:42.941559 run patchelf(pid=25632): Launched 20:45:43.132797 run osmo-stp_10.42.42.5(pid=25629): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25629)] 20:45:43.277704 run osmo-stp_10.42.42.5(pid=25629): stdout: | (launched: 2022-12-12_20:45:41.730168) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:45:43.424459 run osmo-stp_10.42.42.5(pid=25629): stderr: | 20221212204541926 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204541927 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204541927 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204541927 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204541928 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204541928 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204541928 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:45:43.571076 run osmo-stp_10.42.42.5(pid=25629): stdout: | (launched: 2022-12-12_20:45:41.730168) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:45:43.711945 run osmo-stp_10.42.42.5(pid=25629): stderr: | 20221212204541926 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204541927 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204541927 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204541927 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204541928 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204541928 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204541928 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:45:43.878948 run patchelf(pid=25632): Terminating (SIGINT) 20:45:44.072759 run patchelf(pid=25632): Terminated: ok {rc=0} 20:45:44.212192 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=25629): Process ended prematurely: osmo-stp_10.42.42.5(pid=25629) [trial-2382↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25629)] [trial-2382↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 20:45:44.222615 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 20:45:44.252010 run osmo-hlr_10.42.42.2(pid=25626): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25626)] 20:45:44.303587 run osmo-hlr_10.42.42.2(pid=25626): stdout: | (launched: 2022-12-12_20:45:40.666813) 20:45:44.356814 run osmo-hlr_10.42.42.2(pid=25626): stderr: | 20221212204540870 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212204540870 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212204540870 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212204540870 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212204540870 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212204540870 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212204540882 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:sysmo+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212204540891 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212204540891 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212204540891 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:45:44.410364 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25619): Terminating (SIGTERM) 20:45:44.453272 run iperf3-srv_10.42.42.10(pid=25620): Terminating (SIGTERM) 20:45:44.496159 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25621): Terminating (SIGTERM) 20:45:44.539711 run iperf3-srv_10.42.42.10(pid=25622): Terminating (SIGTERM) 20:45:44.582641 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25625): Terminating (SIGTERM) 20:45:44.625497 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25628): Terminating (SIGTERM) 20:45:44.668123 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25631): Terminating (SIGTERM) 20:45:44.711154 --- ParallelTerminationStrategy: PID 25619 died... 20:45:44.731795 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25619): Terminated: ok {rc=0} 20:45:44.779322 --- ParallelTerminationStrategy: PID 25620 died... 20:45:44.799225 run iperf3-srv_10.42.42.10(pid=25620): Terminated {rc=256} 20:45:44.846415 --- ParallelTerminationStrategy: PID 25621 died... 20:45:44.866459 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25621): Terminated: ok {rc=0} 20:45:44.913758 --- ParallelTerminationStrategy: PID 25622 died... 20:45:44.933773 run iperf3-srv_10.42.42.10(pid=25622): Terminated {rc=256} 20:45:44.981491 --- ParallelTerminationStrategy: PID 25625 died... 20:45:45.001643 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25625): Terminated: ok {rc=0} 20:45:45.049066 --- ParallelTerminationStrategy: PID 25628 died... 20:45:45.069163 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25628): Terminated: ok {rc=0} 20:45:45.116470 --- ParallelTerminationStrategy: PID 25631 died... 20:45:45.136598 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25631): Terminated: ok {rc=0} 20:45:45.226198 bus /gobi_0: Setting Powered False 20:45:46.325231 bus /gobi_0: Setting Powered False 20:45:47.442152 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:sysmo+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 20:45:48.598486 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:45:48.610498 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:45:48.671126 tst iperf3.py: using LAC 31395 20:45:48.796151 tst iperf3.py: using RAC 30 20:45:48.922361 tst iperf3.py: using CellId 31395 20:45:49.049405 tst iperf3.py: using BVCI 31396 20:45:49.167403 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:45:49.178660 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:45:49.189514 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:45:49.201214 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:45:49.212880 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:45:49.224408 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:45:49.236099 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:45:49.247637 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:45:49.259652 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:45:49.382117 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 20:45:49.615156 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:45:49.960211 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25633): Launched 20:45:50.262957 run iperf3-srv_10.42.42.10(pid=25634): Launched 20:45:50.391817 tst iperf3.py:8: start network... 20:45:50.624609 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:45:51.159304 run create_hlr_db(pid=25635): Launched 20:45:51.298112 bus /gobi_6: Setting Powered False 20:45:52.366192 run create_hlr_db(pid=25635): Terminated: ok {rc=0} 20:45:52.842865 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25637): Launched 20:45:53.188031 run osmo-hlr_10.42.42.2(pid=25638): Launched 20:45:53.317956 run osmo-stp_10.42.42.5: Starting osmo-stp 20:45:53.910814 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25640): Launched 20:45:54.255933 run osmo-stp_10.42.42.5(pid=25641): Launched 20:45:54.386707 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:45:54.980398 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25643): Launched 20:45:55.110870 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:45:55.402035 run patchelf(pid=25644): Launched 20:45:55.592347 run osmo-stp_10.42.42.5(pid=25641): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25641)] 20:45:55.736689 run osmo-stp_10.42.42.5(pid=25641): stdout: | (launched: 2022-12-12_20:45:54.191391) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:45:55.882873 run osmo-stp_10.42.42.5(pid=25641): stderr: | 20221212204554388 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204554388 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204554388 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204554388 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204554391 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204554391 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204554391 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:45:56.029451 run osmo-stp_10.42.42.5(pid=25641): stdout: | (launched: 2022-12-12_20:45:54.191391) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:45:56.169847 run osmo-stp_10.42.42.5(pid=25641): stderr: | 20221212204554388 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204554388 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204554388 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204554388 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204554391 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204554391 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204554391 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:45:56.335850 run patchelf(pid=25644): Terminating (SIGINT) 20:45:56.528162 run patchelf(pid=25644): Terminated: ok {rc=0} 20:45:56.666713 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25641): Process ended prematurely: osmo-stp_10.42.42.5(pid=25641) [trial-2382↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25641)] [trial-2382↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8] 20:45:56.677083 tst iperf3.py:8: Test FAILED (8.1 sec) 20:45:56.706233 run osmo-hlr_10.42.42.2(pid=25638): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25638)] 20:45:56.757724 run osmo-hlr_10.42.42.2(pid=25638): stdout: | (launched: 2022-12-12_20:45:53.123730) 20:45:56.811169 run osmo-hlr_10.42.42.2(pid=25638): stderr: | 20221212204553329 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212204553329 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212204553329 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212204553330 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212204553330 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212204553330 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212204553342 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:sysmo+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212204553353 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212204553353 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212204553353 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:45:56.864835 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25633): Terminating (SIGTERM) 20:45:56.907938 run iperf3-srv_10.42.42.10(pid=25634): Terminating (SIGTERM) 20:45:56.950855 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25637): Terminating (SIGTERM) 20:45:56.994366 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25640): Terminating (SIGTERM) 20:45:57.037488 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25643): Terminating (SIGTERM) 20:45:57.080723 --- ParallelTerminationStrategy: PID 25633 died... 20:45:57.101377 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25633): Terminated: ok {rc=0} 20:45:57.148862 --- ParallelTerminationStrategy: PID 25634 died... 20:45:57.169135 run iperf3-srv_10.42.42.10(pid=25634): Terminated {rc=256} 20:45:57.216519 --- ParallelTerminationStrategy: PID 25637 died... 20:45:57.236666 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25637): Terminated: ok {rc=0} 20:45:57.284103 --- ParallelTerminationStrategy: PID 25640 died... 20:45:57.304231 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25640): Terminated: ok {rc=0} 20:45:57.351949 --- ParallelTerminationStrategy: PID 25643 died... 20:45:57.372150 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25643): Terminated: ok {rc=0} 20:45:57.463699 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:sysmo+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 20:45:58.621538 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:45:58.633919 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:45:58.693562 tst iperf3m4.py: using LAC 31396 20:45:58.828648 tst iperf3m4.py: using RAC 31 20:45:58.963654 tst iperf3m4.py: using CellId 31396 20:45:59.100446 tst iperf3m4.py: using BVCI 31397 20:45:59.227663 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:45:59.239263 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:45:59.250836 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:45:59.262253 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:45:59.273579 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:45:59.284838 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:45:59.296272 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:45:59.307597 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:45:59.319103 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:45:59.447501 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:45:59.573478 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:45:59.694350 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:45:59.816796 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 20:46:00.048437 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:46:00.392707 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25645): Launched 20:46:00.691843 run iperf3-srv_10.42.42.10(pid=25646): Launched 20:46:00.819942 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 20:46:01.077449 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:46:01.433654 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25647): Launched 20:46:01.740650 run iperf3-srv_10.42.42.10(pid=25648): Launched 20:46:01.882394 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 20:46:02.120848 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:46:02.467035 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25649): Launched 20:46:02.765347 run iperf3-srv_10.42.42.10(pid=25650): Launched 20:46:02.894912 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 20:46:03.127316 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:46:03.473156 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25651): Launched 20:46:03.771653 run iperf3-srv_10.42.42.10(pid=25652): Launched 20:46:03.899289 tst iperf3m4.py:8: start network... 20:46:04.130294 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:46:04.662200 run create_hlr_db(pid=25653): Launched 20:46:04.801964 bus /gobi_6: Setting Powered False 20:46:05.870261 run create_hlr_db(pid=25653): Terminated: ok {rc=0} 20:46:06.324692 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25655): Launched 20:46:06.645104 run osmo-hlr_10.42.42.2(pid=25656): Launched 20:46:06.766494 run osmo-stp_10.42.42.5: Starting osmo-stp 20:46:07.339305 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25658): Launched 20:46:07.661605 run osmo-stp_10.42.42.5(pid=25659): Launched 20:46:07.783931 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:46:08.336065 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25661): Launched 20:46:08.457743 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:46:08.730191 run patchelf(pid=25662): Launched 20:46:08.907165 run osmo-stp_10.42.42.5(pid=25659): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25659)] 20:46:09.041981 run osmo-stp_10.42.42.5(pid=25659): stdout: | (launched: 2022-12-12_20:46:07.600857) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:46:09.178344 run osmo-stp_10.42.42.5(pid=25659): stderr: | 20221212204607777 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204607777 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204607777 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204607777 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204607778 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204607778 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204607778 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:46:09.314931 run osmo-stp_10.42.42.5(pid=25659): stdout: | (launched: 2022-12-12_20:46:07.600857) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:46:09.445776 run osmo-stp_10.42.42.5(pid=25659): stderr: | 20221212204607777 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204607777 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204607777 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204607777 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204607778 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204607778 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204607778 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:46:09.601127 run patchelf(pid=25662): Terminating (SIGINT) 20:46:09.780767 run patchelf(pid=25662): Terminated: ok {rc=0} 20:46:09.910186 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25659): Process ended prematurely: osmo-stp_10.42.42.5(pid=25659) [trial-2382↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25659)] [trial-2382↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8] 20:46:09.919735 tst iperf3m4.py:8: Test FAILED (11.3 sec) 20:46:09.947994 run osmo-hlr_10.42.42.2(pid=25656): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25656)] 20:46:09.997510 run osmo-hlr_10.42.42.2(pid=25656): stdout: | (launched: 2022-12-12_20:46:06.584321) 20:46:10.048288 run osmo-hlr_10.42.42.2(pid=25656): stderr: | 20221212204606766 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212204606766 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212204606766 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212204606766 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212204606766 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212204606766 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212204606778 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:sysmo+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212204606786 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212204606786 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212204606786 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:46:10.099690 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25645): Terminating (SIGTERM) 20:46:10.140628 run iperf3-srv_10.42.42.10(pid=25646): Terminating (SIGTERM) 20:46:10.182403 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25647): Terminating (SIGTERM) 20:46:10.227905 run iperf3-srv_10.42.42.10(pid=25648): Terminating (SIGTERM) 20:46:10.271288 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25649): Terminating (SIGTERM) 20:46:10.314723 run iperf3-srv_10.42.42.10(pid=25650): Terminating (SIGTERM) 20:46:10.357932 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25651): Terminating (SIGTERM) 20:46:10.401255 run iperf3-srv_10.42.42.10(pid=25652): Terminating (SIGTERM) 20:46:10.444275 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25655): Terminating (SIGTERM) 20:46:10.487607 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25658): Terminating (SIGTERM) 20:46:10.530745 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25661): Terminating (SIGTERM) 20:46:10.574144 --- ParallelTerminationStrategy: PID 25645 died... 20:46:10.594957 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25645): Terminated: ok {rc=0} 20:46:10.642951 --- ParallelTerminationStrategy: PID 25646 died... 20:46:10.663308 run iperf3-srv_10.42.42.10(pid=25646): Terminated {rc=256} 20:46:10.711130 --- ParallelTerminationStrategy: PID 25647 died... 20:46:10.731609 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25647): Terminated: ok {rc=0} 20:46:10.779701 --- ParallelTerminationStrategy: PID 25648 died... 20:46:10.799949 run iperf3-srv_10.42.42.10(pid=25648): Terminated {rc=256} 20:46:10.847913 --- ParallelTerminationStrategy: PID 25649 died... 20:46:10.868224 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25649): Terminated: ok {rc=0} 20:46:10.916305 --- ParallelTerminationStrategy: PID 25650 died... 20:46:10.936666 run iperf3-srv_10.42.42.10(pid=25650): Terminated {rc=256} 20:46:10.984717 --- ParallelTerminationStrategy: PID 25651 died... 20:46:11.005050 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25651): Terminated: ok {rc=0} 20:46:11.053272 --- ParallelTerminationStrategy: PID 25652 died... 20:46:11.073645 run iperf3-srv_10.42.42.10(pid=25652): Terminated {rc=256} 20:46:11.121501 --- ParallelTerminationStrategy: PID 25655 died... 20:46:11.141885 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25655): Terminated: ok {rc=0} 20:46:11.189862 --- ParallelTerminationStrategy: PID 25658 died... 20:46:11.210139 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25658): Terminated: ok {rc=0} 20:46:11.257890 --- ParallelTerminationStrategy: PID 25661 died... 20:46:11.278177 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25661): Terminated: ok {rc=0} 20:46:11.367524 bus /gobi_4: Setting Powered False 20:46:12.468130 bus /gobi_4: Setting Powered False 20:46:13.587751 bus /gobi_1: Setting Powered False 20:46:14.687945 bus /gobi_1: Setting Powered False 20:46:15.805938 bus /gobi_0: Setting Powered False 20:46:16.915544 bus /gobi_0: Setting Powered False 20:46:18.034579 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:sysmo+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 20:46:19.140257 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:46:19.152544 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:46:19.211947 tst ping.py: using LAC 31397 20:46:19.346308 tst ping.py: using RAC 32 20:46:19.471445 tst ping.py: using CellId 31397 20:46:19.596013 tst ping.py: using BVCI 31398 20:46:19.711878 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:46:19.723083 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:46:19.734003 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:46:19.745122 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:46:19.756107 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:46:19.767075 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:46:19.778339 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:46:19.789466 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:46:19.911644 tst ping.py:19: start network... 20:46:20.139458 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:46:20.663546 run create_hlr_db(pid=25663): Launched 20:46:20.800400 bus /gobi_6: Setting Powered False 20:46:21.862773 run create_hlr_db(pid=25663): Terminated: ok {rc=0} 20:46:22.313640 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25665): Launched 20:46:22.631579 run osmo-hlr_10.42.42.2(pid=25666): Launched 20:46:22.752067 run osmo-stp_10.42.42.5: Starting osmo-stp 20:46:23.312906 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25668): Launched 20:46:23.627494 run osmo-stp_10.42.42.5(pid=25669): Launched 20:46:23.747167 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:46:24.289766 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25671): Launched 20:46:24.409784 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:46:24.677845 run patchelf(pid=25672): Launched 20:46:24.852711 run osmo-stp_10.42.42.5(pid=25669): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25669)] 20:46:24.985719 run osmo-stp_10.42.42.5(pid=25669): stdout: | (launched: 2022-12-12_20:46:23.568423) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:46:25.120326 run osmo-stp_10.42.42.5(pid=25669): stderr: | 20221212204623744 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204623744 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204623744 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204623744 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204623745 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204623745 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204623745 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:46:25.254839 run osmo-stp_10.42.42.5(pid=25669): stdout: | (launched: 2022-12-12_20:46:23.568423) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:46:25.384174 run osmo-stp_10.42.42.5(pid=25669): stderr: | 20221212204623744 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204623744 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204623744 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204623744 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204623745 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204623745 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204623745 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:46:25.536381 run patchelf(pid=25672): Terminating (SIGINT) 20:46:25.712734 run patchelf(pid=25672): Terminated: ok {rc=0} 20:46:25.840313 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=25669): Process ended prematurely: osmo-stp_10.42.42.5(pid=25669) [trial-2382↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25669)] [trial-2382↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22] 20:46:25.849347 tst ping.py:22: Test FAILED (6.7 sec) 20:46:25.877236 run osmo-hlr_10.42.42.2(pid=25666): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25666)] 20:46:25.926983 run osmo-hlr_10.42.42.2(pid=25666): stdout: | (launched: 2022-12-12_20:46:22.571933) 20:46:25.978685 run osmo-hlr_10.42.42.2(pid=25666): stderr: | 20221212204622753 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212204622753 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212204622753 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212204622754 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212204622754 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212204622754 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212204622766 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:sysmo+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212204622774 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212204622774 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212204622774 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:46:26.030865 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25665): Terminating (SIGTERM) 20:46:26.072611 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25668): Terminating (SIGTERM) 20:46:26.114186 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25671): Terminating (SIGTERM) 20:46:26.155702 --- ParallelTerminationStrategy: PID 25665 died... 20:46:26.175503 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25665): Terminated: ok {rc=0} 20:46:26.221790 --- ParallelTerminationStrategy: PID 25668 died... 20:46:26.240874 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25668): Terminated: ok {rc=0} 20:46:26.286818 --- ParallelTerminationStrategy: PID 25671 died... 20:46:26.306619 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25671): Terminated: ok {rc=0} 20:46:26.392775 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:sysmo+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 20:46:27.482096 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:46:27.494956 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:46:27.555451 tst ping_idle_ping.py: using LAC 31398 20:46:27.691926 tst ping_idle_ping.py: using RAC 33 20:46:27.824536 tst ping_idle_ping.py: using CellId 31398 20:46:27.957296 tst ping_idle_ping.py: using BVCI 31399 20:46:28.081071 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:46:28.093223 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:46:28.104734 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:46:28.116461 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:46:28.128051 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:46:28.139443 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:46:28.151119 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:46:28.162628 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:46:28.284352 tst ping_idle_ping.py:24: start network... 20:46:28.514006 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:46:29.043369 run create_hlr_db(pid=25673): Launched 20:46:29.180504 bus /gobi_6: Setting Powered False 20:46:30.246989 run create_hlr_db(pid=25673): Terminated: ok {rc=0} 20:46:30.699100 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25675): Launched 20:46:31.026205 run osmo-hlr_10.42.42.2(pid=25676): Launched 20:46:31.299198 run osmo-stp_10.42.42.5: Starting osmo-stp 20:46:31.929582 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25678): Launched 20:46:32.286842 run osmo-stp_10.42.42.5(pid=25679): Launched 20:46:32.447503 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:46:32.994209 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25681): Launched 20:46:33.114836 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:46:33.382783 run patchelf(pid=25682): Launched 20:46:33.557480 run osmo-stp_10.42.42.5(pid=25679): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25679)] 20:46:33.690202 run osmo-stp_10.42.42.5(pid=25679): stdout: | (launched: 2022-12-12_20:46:32.221392) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:46:33.825251 run osmo-stp_10.42.42.5(pid=25679): stderr: | 20221212204632438 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204632438 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204632438 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204632439 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204632439 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204632439 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204632439 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:46:33.960251 run osmo-stp_10.42.42.5(pid=25679): stdout: | (launched: 2022-12-12_20:46:32.221392) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:46:34.089515 run osmo-stp_10.42.42.5(pid=25679): stderr: | 20221212204632438 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204632438 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204632438 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204632439 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204632439 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204632439 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204632439 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:46:34.242353 run patchelf(pid=25682): Terminating (SIGINT) 20:46:34.419220 run patchelf(pid=25682): Terminated: ok {rc=0} 20:46:34.547240 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=25679): Process ended prematurely: osmo-stp_10.42.42.5(pid=25679) [trial-2382↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25679)] [trial-2382↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 20:46:34.556441 tst ping_idle_ping.py:27: Test FAILED (7.1 sec) 20:46:34.584587 run osmo-hlr_10.42.42.2(pid=25676): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25676)] 20:46:34.634143 run osmo-hlr_10.42.42.2(pid=25676): stdout: | (launched: 2022-12-12_20:46:30.963184) 20:46:34.685805 run osmo-hlr_10.42.42.2(pid=25676): stderr: | 20221212204631198 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212204631198 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212204631198 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212204631198 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212204631198 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212204631198 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212204631215 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:sysmo+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212204631223 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212204631223 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212204631224 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:46:34.737981 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25675): Terminating (SIGTERM) 20:46:34.779645 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25678): Terminating (SIGTERM) 20:46:34.821229 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25681): Terminating (SIGTERM) 20:46:34.863034 --- ParallelTerminationStrategy: PID 25675 died... 20:46:34.882778 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25675): Terminated: ok {rc=0} 20:46:34.929167 --- ParallelTerminationStrategy: PID 25678 died... 20:46:34.948457 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25678): Terminated: ok {rc=0} 20:46:34.994465 --- ParallelTerminationStrategy: PID 25681 died... 20:46:35.013881 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25681): Terminated: ok {rc=0} 20:46:35.103474 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2382 gprs:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 20:46:36.395885 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:46:36.403021 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 20:46:36.424835 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 20:46:36.460583 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 20:46:36.515286 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 20:46:36.537210 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 20:46:36.572031 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 20:46:37.127258 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2382 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 20:46:37.132718 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:46:37.144051 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 20:46:37.201351 tst switch_tch_pdch.py: using LAC 31399 20:46:37.325999 tst switch_tch_pdch.py: using RAC 34 20:46:37.451018 tst switch_tch_pdch.py: using CellId 31399 20:46:37.574863 tst switch_tch_pdch.py: using BVCI 31400 20:46:37.690043 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:46:37.701455 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:46:37.712453 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:46:37.723831 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:46:37.735039 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:46:37.746467 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:46:37.758001 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:46:37.769376 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:46:37.892514 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:46:38.013328 tst switch_tch_pdch.py:51: start network... 20:46:38.222764 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:46:38.709333 run create_hlr_db(pid=25687): Launched 20:46:38.828735 bus /gobi_6: Setting Powered False 20:46:39.892217 run create_hlr_db(pid=25687): Terminated: ok {rc=0} 20:46:40.331704 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25689): Launched 20:46:40.646596 run osmo-hlr_10.42.42.2(pid=25690): Launched 20:46:40.765824 run osmo-stp_10.42.42.5: Starting osmo-stp 20:46:41.307894 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25692): Launched 20:46:41.622485 run osmo-stp_10.42.42.5(pid=25693): Launched 20:46:41.741447 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:46:42.283031 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25695): Launched 20:46:42.402263 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:46:42.668421 run patchelf(pid=25696): Launched 20:46:42.841928 run osmo-stp_10.42.42.5(pid=25693): ERR: Terminated: ERROR {rc=1} [trial-2382↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25693)] 20:46:42.973830 run osmo-stp_10.42.42.5(pid=25693): stdout: | (launched: 2022-12-12_20:46:41.563115) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:46:43.107985 run osmo-stp_10.42.42.5(pid=25693): stderr: | 20221212204641739 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204641739 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204641739 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204641740 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204641740 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204641740 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204641740 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:46:43.242610 run osmo-stp_10.42.42.5(pid=25693): stdout: | (launched: 2022-12-12_20:46:41.563115) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:46:43.370720 run osmo-stp_10.42.42.5(pid=25693): stderr: | 20221212204641739 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204641739 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204641739 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204641740 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204641740 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204641740 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204641740 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:46:43.522421 run patchelf(pid=25696): Terminating (SIGINT) 20:46:43.698612 run patchelf(pid=25696): Terminated: ok {rc=0} 20:46:43.825340 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=25693): Process ended prematurely: osmo-stp_10.42.42.5(pid=25693) [trial-2382↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25693)] [trial-2382↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 20:46:43.834236 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 20:46:43.861899 run osmo-hlr_10.42.42.2(pid=25690): ERR: Terminated: ERROR {rc=237} [trial-2382↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25690)] 20:46:43.911737 run osmo-hlr_10.42.42.2(pid=25690): stdout: | (launched: 2022-12-12_20:46:40.587024) 20:46:43.962574 run osmo-hlr_10.42.42.2(pid=25690): stderr: | 20221212204640766 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212204640766 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212204640766 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212204640766 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212204640766 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212204640766 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212204640778 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212204640787 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212204640787 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212204640787 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:46:44.013822 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25689): Terminating (SIGTERM) 20:46:44.054892 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25692): Terminating (SIGTERM) 20:46:44.095947 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25695): Terminating (SIGTERM) 20:46:44.137147 --- ParallelTerminationStrategy: PID 25689 died... 20:46:44.156864 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25689): Terminated: ok {rc=0} 20:46:44.202444 --- ParallelTerminationStrategy: PID 25692 died... 20:46:44.221387 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25692): Terminated: ok {rc=0} 20:46:44.267565 --- ParallelTerminationStrategy: PID 25695 died... 20:46:44.286747 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25695): Terminated: ok {rc=0} 20:46:44.373683 bus /gobi_0: Setting Powered False 20:46:45.474768 bus /gobi_0: Setting Powered False 20:46:46.602002 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2382 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 dynts:sysmo+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 20:46:47.848484 tst dynts:sysmo+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:46:47.855042 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 20:46:47.877321 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 20:46:47.913244 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 20:46:47.969850 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 20:46:47.992222 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 20:46:48.027753 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 20:46:48.583433 tst dynts:sysmo+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2382 dynts:sysmo+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 20:46:48.588646 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:46:48.600194 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 20:46:48.657564 tst switch_tch_pdch.py: using LAC 31400 20:46:48.789092 tst switch_tch_pdch.py: using RAC 35 20:46:48.921916 tst switch_tch_pdch.py: using CellId 31400 20:46:49.055697 tst switch_tch_pdch.py: using BVCI 31401 20:46:49.180573 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:46:49.192150 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:46:49.203500 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:46:49.214832 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:46:49.226101 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:46:49.237356 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:46:49.248752 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:46:49.260119 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 20:46:49.379000 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 20:46:49.501271 tst switch_tch_pdch.py:51: start network... 20:46:49.728560 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:46:50.223564 run create_hlr_db(pid=25700): Launched 20:46:50.350642 bus /gobi_6: Setting Powered False 20:46:51.413177 run create_hlr_db(pid=25700): Terminated: ok {rc=0} 20:46:51.844160 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25702): Launched 20:46:52.183851 run osmo-hlr_10.42.42.2(pid=25703): Launched 20:46:52.311517 run osmo-stp_10.42.42.5: Starting osmo-stp 20:46:52.862235 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25705): Launched 20:46:53.200864 run osmo-stp_10.42.42.5(pid=25706): Launched 20:46:53.328162 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:46:53.881544 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25708): Launched 20:46:54.011508 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:46:54.298751 run patchelf(pid=25709): Launched 20:46:54.485144 run osmo-stp_10.42.42.5(pid=25706): ERR: Terminated: ERROR {rc=1} [trial-2382↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25706)] 20:46:54.626828 run osmo-stp_10.42.42.5(pid=25706): stdout: | (launched: 2022-12-12_20:46:53.137783) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:46:54.770367 run osmo-stp_10.42.42.5(pid=25706): stderr: | 20221212204653333 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204653333 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204653334 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204653334 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204653334 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204653334 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204653334 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:46:54.914009 run osmo-stp_10.42.42.5(pid=25706): stdout: | (launched: 2022-12-12_20:46:53.137783) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:46:55.051470 run osmo-stp_10.42.42.5(pid=25706): stderr: | 20221212204653333 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204653333 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204653334 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204653334 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204653334 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204653334 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204653334 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:46:55.214885 run patchelf(pid=25709): Terminating (SIGINT) 20:46:55.402746 run patchelf(pid=25709): Terminated: ok {rc=0} 20:46:55.538237 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=25706): Process ended prematurely: osmo-stp_10.42.42.5(pid=25706) [trial-2382↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25706)] [trial-2382↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 20:46:55.547962 tst switch_tch_pdch.py:54: Test FAILED (7.0 sec) 20:46:55.576883 run osmo-hlr_10.42.42.2(pid=25703): ERR: Terminated: ERROR {rc=237} [trial-2382↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25703)] 20:46:55.628493 run osmo-hlr_10.42.42.2(pid=25703): stdout: | (launched: 2022-12-12_20:46:52.120431) 20:46:55.682003 run osmo-hlr_10.42.42.2(pid=25703): stderr: | 20221212204652323 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212204652323 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212204652323 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212204652323 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212204652323 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212204652323 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212204652335 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/dynts:sysmo+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212204652345 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212204652345 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212204652345 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:46:55.735689 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25702): Terminating (SIGTERM) 20:46:55.778827 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25705): Terminating (SIGTERM) 20:46:55.821948 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25708): Terminating (SIGTERM) 20:46:55.865291 --- ParallelTerminationStrategy: PID 25702 died... 20:46:55.885963 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25702): Terminated: ok {rc=0} 20:46:55.933605 --- ParallelTerminationStrategy: PID 25705 died... 20:46:55.953736 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25705): Terminated: ok {rc=0} 20:46:56.001753 --- ParallelTerminationStrategy: PID 25708 died... 20:46:56.021998 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25708): Terminated: ok {rc=0} 20:46:56.112793 bus /gobi_0: Setting Powered False 20:46:57.214739 bus /gobi_0: Setting Powered False 20:46:58.334338 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2382 dynts:sysmo+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 nitb_sms:oc2g --------------------------------------------------------------------- 20:46:59.577422 tst nitb_sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:46:59.581779 tst nitb_sms:oc2g: Verifying 1 x bts (candidates: 11) 20:46:59.603222 tst nitb_sms:oc2g: Verifying 1 x ip_address (candidates: 9) 20:46:59.610671 tst nitb_sms:oc2g: Verifying 2 x modem (candidates: 12) 20:46:59.664129 tst nitb_sms:oc2g: Reserving 1 x bts (candidates: 11) 20:46:59.685465 tst nitb_sms:oc2g: Reserving 1 x ip_address (candidates: 9) 20:46:59.692541 tst nitb_sms:oc2g: Reserving 2 x modem (candidates: 12) 20:47:00.232280 tst nitb_sms:oc2g: RESERVED RESOURCES for nitb_sms: bts OC-2G ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 nitb_sms:oc2g mo_mt_sms.py ---------------------------------------------- 20:47:00.237492 tst nitb_sms:oc2g: Using 1 x ip_address (candidates: 1) 20:47:00.248640 tst nitb_sms:oc2g: Using 1 x bts (candidates: 1) 20:47:00.284073 tst mo_mt_sms.py: using LAC 31401 20:47:00.417552 tst mo_mt_sms.py: using RAC 36 20:47:00.543232 tst mo_mt_sms.py: using CellId 31401 20:47:00.665504 tst mo_mt_sms.py: using BVCI 31402 20:47:00.782366 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 20:47:00.908351 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 20:47:01.046866 tst mo_mt_sms.py:9: start nitb and bts... 20:47:01.263875 run osmo-nitb_10.42.42.2: Starting osmo-nitb 20:47:01.923942 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25715): Launched 20:47:02.260760 run osmo-nitb_10.42.42.2(pid=25716): Launched 20:47:02.435417 run osmo-nitb_10.42.42.2(pid=25716): ERR: Terminated: ERROR {rc=2} [trial-2382↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25716)] 20:47:02.575739 run osmo-nitb_10.42.42.2(pid=25716): stdout: | (launched: 2022-12-12_20:47:02.200228) 20:47:02.717212 run osmo-nitb_10.42.42.2(pid=25716): stderr: | (launched: 2022-12-12_20:47:02.248569) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 20:47:02.858930 run osmo-nitb_10.42.42.2(pid=25716): stdout: | (launched: 2022-12-12_20:47:02.200228) 20:47:02.995611 run osmo-nitb_10.42.42.2(pid=25716): stderr: | (launched: 2022-12-12_20:47:02.248569) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7ff6b86c2268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=25716): Process ended prematurely: osmo-nitb_10.42.42.2(pid=25716) [trial-2382↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25716)] 20:47:03.379951 tst osmo-nitb_10.42.42.2(pid=25716): stdout: | (launched: 2022-12-12_20:47:02.200228) 20:47:03.515951 tst osmo-nitb_10.42.42.2(pid=25716): stderr: | (launched: 2022-12-12_20:47:02.248569) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 20:47:03.676598 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=25716): Process ended prematurely: osmo-nitb_10.42.42.2(pid=25716) [trial-2382↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25716)] [trial-2382↪nitb_sms:oc2g↪mo_mt_sms.py:11] 20:47:03.685807 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 20:47:03.692802 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25715): Terminating (SIGTERM) 20:47:03.904456 --- ParallelTerminationStrategy: PID 25715 died... 20:47:03.926339 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25715): Terminated: ok {rc=0} 20:47:04.016670 bus /sierra_3: Setting Powered False 20:47:05.120002 bus /sierra_3: Setting Powered False 20:47:06.239176 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 nitb_sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 sms:oc2g --------------------------------------------------------------------- 20:47:07.425850 tst sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:47:07.430358 tst sms:oc2g: Verifying 1 x bts (candidates: 11) 20:47:07.451746 tst sms:oc2g: Verifying 6 x ip_address (candidates: 9) 20:47:07.482099 tst sms:oc2g: Verifying 2 x modem (candidates: 12) 20:47:07.535844 tst sms:oc2g: Reserving 1 x bts (candidates: 11) 20:47:07.556578 tst sms:oc2g: Reserving 6 x ip_address (candidates: 9) 20:47:07.583907 tst sms:oc2g: Reserving 2 x modem (candidates: 12) 20:47:08.129621 tst sms:oc2g: RESERVED RESOURCES for sms: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 sms:oc2g mo_mt_sms.py ---------------------------------------------- 20:47:08.134586 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 20:47:08.145211 tst sms:oc2g: Using 1 x bts (candidates: 1) 20:47:08.179022 tst mo_mt_sms.py: using LAC 31402 20:47:08.301681 tst mo_mt_sms.py: using RAC 37 20:47:08.426372 tst mo_mt_sms.py: using CellId 31402 20:47:08.550885 tst mo_mt_sms.py: using BVCI 31403 20:47:08.666339 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 20:47:08.676918 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 20:47:08.687404 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 20:47:08.698189 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 20:47:08.709030 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 20:47:08.719647 tst sms:oc2g: Using 1 x modem (candidates: 2) 20:47:08.840621 tst sms:oc2g: Using 1 x modem (candidates: 2) 20:47:08.958275 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:47:09.446520 run create_hlr_db(pid=25720): Launched 20:47:09.565392 bus /sierra_2: Setting Powered False 20:47:10.627396 run create_hlr_db(pid=25720): Terminated: ok {rc=0} 20:47:11.088132 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25722): Launched 20:47:11.426666 run osmo-hlr_10.42.42.2(pid=25723): Launched 20:47:11.555867 run osmo-stp_10.42.42.5: Starting osmo-stp 20:47:12.138675 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25725): Launched 20:47:12.477184 run osmo-stp_10.42.42.5(pid=25726): Launched 20:47:12.607490 run osmo-msc_10.42.42.6: Starting osmo-msc 20:47:13.219785 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25728): Launched 20:47:13.561769 run osmo-msc_10.42.42.6(pid=25729): Launched 20:47:13.750008 run osmo-stp_10.42.42.5(pid=25726): ERR: Terminated: ERROR {rc=1} [trial-2382↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25726)] 20:47:13.892285 run osmo-stp_10.42.42.5(pid=25726): stdout: | (launched: 2022-12-12_20:47:12.413845) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:47:14.035925 run osmo-stp_10.42.42.5(pid=25726): stderr: | 20221212204712611 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204712611 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204712611 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204712612 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204712612 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204712612 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204712612 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:47:14.178407 run osmo-stp_10.42.42.5(pid=25726): stdout: | (launched: 2022-12-12_20:47:12.413845) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:47:14.313096 run osmo-stp_10.42.42.5(pid=25726): stderr: | 20221212204712611 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204712611 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204712611 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204712612 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204712612 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204712612 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204712612 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:47:14.474085 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=25726): Process ended prematurely: osmo-stp_10.42.42.5(pid=25726) [trial-2382↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25726)] [trial-2382↪sms:oc2g↪mo_mt_sms.py:16] 20:47:14.484022 tst mo_mt_sms.py:16: Test FAILED (6.3 sec) 20:47:14.512494 run osmo-hlr_10.42.42.2(pid=25723): ERR: Terminated: ERROR {rc=237} [trial-2382↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25723)] 20:47:14.564288 run osmo-hlr_10.42.42.2(pid=25723): stdout: | (launched: 2022-12-12_20:47:11.363055) 20:47:14.617718 run osmo-hlr_10.42.42.2(pid=25723): stderr: | 20221212204711567 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212204711567 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212204711568 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212204711568 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212204711568 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212204711568 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212204711580 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/sms:oc2g/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212204711591 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212204711591 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212204711591 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:47:14.692151 run osmo-msc_10.42.42.6(pid=25729): ERR: Terminated: ERROR {rc=2} [trial-2382↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25729)] 20:47:14.743771 run osmo-msc_10.42.42.6(pid=25729): stdout: | (launched: 2022-12-12_20:47:13.495284) 20:47:14.796914 run osmo-msc_10.42.42.6(pid=25729): stderr: | 20221212204713825 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212204713825 DLGLOBAL DEBUG validating counter group 0x7fe6fd6bcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212204713825 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212204713825 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212204713825 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212204713826 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212204713827 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212204713828 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212204713828 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212204713828 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:47:14.850559 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25722): Terminating (SIGTERM) 20:47:14.893548 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25725): Terminating (SIGTERM) 20:47:14.936650 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25728): Terminating (SIGTERM) 20:47:14.980395 --- ParallelTerminationStrategy: PID 25722 died... 20:47:15.001160 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25722): Terminated: ok {rc=0} 20:47:15.049632 --- ParallelTerminationStrategy: PID 25725 died... 20:47:15.070165 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25725): Terminated: ok {rc=0} 20:47:15.118219 --- ParallelTerminationStrategy: PID 25728 died... 20:47:15.138574 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25728): Terminated: ok {rc=0} 20:47:15.229074 bus /sierra_3: Setting Powered False 20:47:16.329625 bus /sierra_3: Setting Powered False 20:47:17.450625 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 nitb_ussd:oc2g --------------------------------------------------------------------- 20:47:18.672645 tst nitb_ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:47:18.676878 tst nitb_ussd:oc2g: Verifying 1 x bts (candidates: 11) 20:47:18.698529 tst nitb_ussd:oc2g: Verifying 1 x ip_address (candidates: 9) 20:47:18.706544 tst nitb_ussd:oc2g: Verifying 1 x modem (candidates: 12) 20:47:18.743224 tst nitb_ussd:oc2g: Reserving 1 x bts (candidates: 11) 20:47:18.764800 tst nitb_ussd:oc2g: Reserving 1 x ip_address (candidates: 9) 20:47:18.772256 tst nitb_ussd:oc2g: Reserving 1 x modem (candidates: 12) 20:47:19.291449 tst nitb_ussd:oc2g: RESERVED RESOURCES for nitb_ussd: bts OC-2G ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2382 nitb_ussd:oc2g assert_extension.py ---------------------------------------------- 20:47:19.297634 tst nitb_ussd:oc2g: Using 1 x ip_address (candidates: 1) 20:47:19.308452 tst nitb_ussd:oc2g: Using 1 x bts (candidates: 1) 20:47:19.343240 tst assert_extension.py: using LAC 31403 20:47:19.467772 tst assert_extension.py: using RAC 38 20:47:19.602008 tst assert_extension.py: using CellId 31403 20:47:19.735207 tst assert_extension.py: using BVCI 31404 20:47:19.859218 tst nitb_ussd:oc2g: Using 1 x modem (candidates: 1) 20:47:19.977337 tst assert_extension.py:10: start nitb and bts... 20:47:20.206627 run osmo-nitb_10.42.42.2: Starting osmo-nitb 20:47:20.892756 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25734): Launched 20:47:21.231226 run osmo-nitb_10.42.42.2(pid=25735): Launched 20:47:21.417160 run osmo-nitb_10.42.42.2(pid=25735): ERR: Terminated: ERROR {rc=2} [trial-2382↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25735)] 20:47:21.567403 run osmo-nitb_10.42.42.2(pid=25735): stdout: | (launched: 2022-12-12_20:47:21.168136) 20:47:21.719207 run osmo-nitb_10.42.42.2(pid=25735): stderr: | (launched: 2022-12-12_20:47:21.218280) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 20:47:21.870956 run osmo-nitb_10.42.42.2(pid=25735): stdout: | (launched: 2022-12-12_20:47:21.168136) 20:47:22.017313 run osmo-nitb_10.42.42.2(pid=25735): stderr: | (launched: 2022-12-12_20:47:21.218280) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7ff6b86c2268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=25735): Process ended prematurely: osmo-nitb_10.42.42.2(pid=25735) [trial-2382↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25735)] 20:47:22.358176 tst osmo-nitb_10.42.42.2(pid=25735): stdout: | (launched: 2022-12-12_20:47:21.168136) 20:47:22.495069 tst osmo-nitb_10.42.42.2(pid=25735): stderr: | (launched: 2022-12-12_20:47:21.218280) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 20:47:22.655981 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=25735): Process ended prematurely: osmo-nitb_10.42.42.2(pid=25735) [trial-2382↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25735)] [trial-2382↪nitb_ussd:oc2g↪assert_extension.py:12] 20:47:22.665215 tst assert_extension.py:12: Test FAILED (3.4 sec) 20:47:22.672445 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25734): Terminating (SIGTERM) 20:47:22.885960 --- ParallelTerminationStrategy: PID 25734 died... 20:47:22.907863 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25734): Terminated: ok {rc=0} 20:47:22.999615 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 nitb_ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 ussd:oc2g --------------------------------------------------------------------- 20:47:24.166226 tst ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:47:24.171043 tst ussd:oc2g: Verifying 1 x bts (candidates: 11) 20:47:24.193056 tst ussd:oc2g: Verifying 6 x ip_address (candidates: 9) 20:47:24.223536 tst ussd:oc2g: Verifying 1 x modem (candidates: 12) 20:47:24.259050 tst ussd:oc2g: Reserving 1 x bts (candidates: 11) 20:47:24.280538 tst ussd:oc2g: Reserving 6 x ip_address (candidates: 9) 20:47:24.308059 tst ussd:oc2g: Reserving 1 x modem (candidates: 12) 20:47:24.835166 tst ussd:oc2g: RESERVED RESOURCES for ussd: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2382 ussd:oc2g assert_extension.py ---------------------------------------------- 20:47:24.840417 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 20:47:24.851346 tst ussd:oc2g: Using 1 x bts (candidates: 1) 20:47:24.887376 tst assert_extension.py: using LAC 31404 20:47:25.010729 tst assert_extension.py: using RAC 39 20:47:25.135399 tst assert_extension.py: using CellId 31404 20:47:25.260539 tst assert_extension.py: using BVCI 31405 20:47:25.375901 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 20:47:25.386628 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 20:47:25.397133 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 20:47:25.407796 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 20:47:25.418667 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 20:47:25.429559 tst ussd:oc2g: Using 1 x modem (candidates: 1) 20:47:25.552394 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:47:26.077959 run create_hlr_db(pid=25739): Launched 20:47:26.214443 bus /sierra_2: Setting Powered False 20:47:27.280150 run create_hlr_db(pid=25739): Terminated: ok {rc=0} 20:47:27.728737 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25741): Launched 20:47:28.043650 run osmo-hlr_10.42.42.2(pid=25742): Launched 20:47:28.164246 run osmo-stp_10.42.42.5: Starting osmo-stp 20:47:28.716661 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25744): Launched 20:47:29.034011 run osmo-stp_10.42.42.5(pid=25745): Launched 20:47:29.153727 run osmo-msc_10.42.42.6: Starting osmo-msc 20:47:29.721237 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25747): Launched 20:47:30.038077 run osmo-msc_10.42.42.6(pid=25748): Launched 20:47:30.214138 run osmo-stp_10.42.42.5(pid=25745): ERR: Terminated: ERROR {rc=1} [trial-2382↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25745)] 20:47:30.347401 run osmo-stp_10.42.42.5(pid=25745): stdout: | (launched: 2022-12-12_20:47:28.974309) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:47:30.480334 run osmo-stp_10.42.42.5(pid=25745): stderr: | 20221212204729149 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204729149 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204729150 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204729150 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204729151 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204729151 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204729151 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:47:30.611364 run osmo-stp_10.42.42.5(pid=25745): stdout: | (launched: 2022-12-12_20:47:28.974309) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:47:30.736268 run osmo-stp_10.42.42.5(pid=25745): stderr: | 20221212204729149 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204729149 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204729150 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204729150 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204729151 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204729151 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204729151 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:47:30.893090 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=25745): Process ended prematurely: osmo-stp_10.42.42.5(pid=25745) [trial-2382↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25745)] [trial-2382↪ussd:oc2g↪assert_extension.py:17] 20:47:30.904830 tst assert_extension.py:17: Test FAILED (6.1 sec) 20:47:30.942762 run osmo-hlr_10.42.42.2(pid=25742): ERR: Terminated: ERROR {rc=237} [trial-2382↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25742)] 20:47:30.998638 run osmo-hlr_10.42.42.2(pid=25742): stdout: | (launched: 2022-12-12_20:47:27.983907) 20:47:31.051004 run osmo-hlr_10.42.42.2(pid=25742): stderr: | 20221212204728164 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212204728164 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212204728164 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212204728165 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212204728165 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212204728165 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212204728176 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/ussd:oc2g/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212204728186 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212204728186 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212204728186 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:47:31.123403 run osmo-msc_10.42.42.6(pid=25748): ERR: Terminated: ERROR {rc=2} [trial-2382↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25748)] 20:47:31.173836 run osmo-msc_10.42.42.6(pid=25748): stdout: | (launched: 2022-12-12_20:47:29.977894) 20:47:31.225725 run osmo-msc_10.42.42.6(pid=25748): stderr: | 20221212204730254 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212204730254 DLGLOBAL DEBUG validating counter group 0x7f79771f8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212204730254 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212204730254 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212204730255 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212204730255 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212204730256 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212204730257 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212204730257 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212204730257 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:47:31.278480 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25741): Terminating (SIGTERM) 20:47:31.321253 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25744): Terminating (SIGTERM) 20:47:31.364607 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25747): Terminating (SIGTERM) 20:47:31.406872 --- ParallelTerminationStrategy: PID 25741 died... 20:47:31.426742 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25741): Terminated: ok {rc=0} 20:47:31.473134 --- ParallelTerminationStrategy: PID 25744 died... 20:47:31.492773 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25744): Terminated: ok {rc=0} 20:47:31.539254 --- ParallelTerminationStrategy: PID 25747 died... 20:47:31.558982 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25747): Terminated: ok {rc=0} 20:47:31.646909 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 20:47:32.840785 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:47:32.847277 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 20:47:32.868413 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 20:47:32.895500 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 20:47:32.949409 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 20:47:32.971068 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 20:47:32.999008 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 20:47:33.549983 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 20:47:33.605218 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:47:33.616384 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 20:47:33.675444 tst mo_mt_call.py: using LAC 31405 20:47:33.799865 tst mo_mt_call.py: using RAC 40 20:47:33.925502 tst mo_mt_call.py: using CellId 31405 20:47:34.058842 tst mo_mt_call.py: using BVCI 31406 20:47:34.184107 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:47:34.196100 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:47:34.207750 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:47:34.219752 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:47:34.231747 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:47:34.243409 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 20:47:34.362076 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 20:47:34.480657 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:47:34.975885 run create_hlr_db(pid=25753): Launched 20:47:35.098230 bus /sierra_2: Setting Powered False 20:47:36.162439 run create_hlr_db(pid=25753): Terminated: ok {rc=0} 20:47:36.631021 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25755): Launched 20:47:36.975895 run osmo-hlr_10.42.42.2(pid=25756): Launched 20:47:37.107085 run osmo-stp_10.42.42.5: Starting osmo-stp 20:47:37.698645 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25758): Launched 20:47:38.045183 run osmo-stp_10.42.42.5(pid=25759): Launched 20:47:38.175448 run osmo-msc_10.42.42.6: Starting osmo-msc 20:47:38.794111 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25761): Launched 20:47:39.140202 run osmo-msc_10.42.42.6(pid=25762): Launched 20:47:39.331361 run osmo-stp_10.42.42.5(pid=25759): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25759)] 20:47:39.474680 run osmo-stp_10.42.42.5(pid=25759): stdout: | (launched: 2022-12-12_20:47:37.980236) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:47:39.617985 run osmo-stp_10.42.42.5(pid=25759): stderr: | 20221212204738175 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204738175 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204738175 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204738176 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204738176 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204738176 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204738176 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:47:39.759624 run osmo-stp_10.42.42.5(pid=25759): stdout: | (launched: 2022-12-12_20:47:37.980236) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:47:39.895517 run osmo-stp_10.42.42.5(pid=25759): stderr: | 20221212204738175 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204738175 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204738175 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204738176 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204738176 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204738176 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204738176 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:47:40.058735 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25759): Process ended prematurely: osmo-stp_10.42.42.5(pid=25759) [trial-2382↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25759)] [trial-2382↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 20:47:40.068421 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 20:47:40.097421 run osmo-hlr_10.42.42.2(pid=25756): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25756)] 20:47:40.148899 run osmo-hlr_10.42.42.2(pid=25756): stdout: | (launched: 2022-12-12_20:47:36.911808) 20:47:40.202296 run osmo-hlr_10.42.42.2(pid=25756): stderr: | 20221212204737111 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212204737111 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212204737111 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212204737111 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212204737111 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212204737111 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212204737124 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212204737132 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212204737132 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212204737132 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:47:40.276454 run osmo-msc_10.42.42.6(pid=25762): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25762)] 20:47:40.327922 run osmo-msc_10.42.42.6(pid=25762): stdout: | (launched: 2022-12-12_20:47:39.076072) 20:47:40.381729 run osmo-msc_10.42.42.6(pid=25762): stderr: | 20221212204739402 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212204739402 DLGLOBAL DEBUG validating counter group 0x7f377763cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212204739402 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212204739402 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212204739402 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212204739403 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212204739404 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212204739405 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212204739405 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212204739405 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:47:40.435481 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25755): Terminating (SIGTERM) 20:47:40.478245 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25758): Terminating (SIGTERM) 20:47:40.520937 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25761): Terminating (SIGTERM) 20:47:40.564004 --- ParallelTerminationStrategy: PID 25755 died... 20:47:40.584706 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25755): Terminated: ok {rc=0} 20:47:40.632703 --- ParallelTerminationStrategy: PID 25758 died... 20:47:40.653062 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25758): Terminated: ok {rc=0} 20:47:40.700284 --- ParallelTerminationStrategy: PID 25761 died... 20:47:40.720616 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25761): Terminated: ok {rc=0} 20:47:40.810783 bus /sierra_3: Setting Powered False 20:47:41.913822 bus /sierra_3: Setting Powered False 20:47:43.035052 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2382 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 20:47:44.185354 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:47:44.197217 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 20:47:44.253506 tst mo_mt_call_osmux.py: using LAC 31406 20:47:44.389023 tst mo_mt_call_osmux.py: using RAC 41 20:47:44.524582 tst mo_mt_call_osmux.py: using CellId 31406 20:47:44.658552 tst mo_mt_call_osmux.py: using BVCI 31407 20:47:44.783407 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:47:44.795117 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:47:44.806676 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:47:44.818197 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:47:44.829711 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:47:44.841297 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 20:47:44.960519 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 20:47:45.086164 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:47:45.618828 run create_hlr_db(pid=25764): Launched 20:47:45.756932 bus /sierra_2: Setting Powered False 20:47:46.823263 run create_hlr_db(pid=25764): Terminated: ok {rc=0} 20:47:47.324230 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25766): Launched 20:47:47.668800 run osmo-hlr_10.42.42.2(pid=25767): Launched 20:47:47.798750 run osmo-stp_10.42.42.5: Starting osmo-stp 20:47:48.388743 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25769): Launched 20:47:48.735273 run osmo-stp_10.42.42.5(pid=25770): Launched 20:47:48.864423 run osmo-msc_10.42.42.6: Starting osmo-msc 20:47:49.482784 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25772): Launched 20:47:49.826702 run osmo-msc_10.42.42.6(pid=25773): Launched 20:47:50.018511 run osmo-stp_10.42.42.5(pid=25770): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25770)] 20:47:50.162538 run osmo-stp_10.42.42.5(pid=25770): stdout: | (launched: 2022-12-12_20:47:48.670936) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:47:50.307192 run osmo-stp_10.42.42.5(pid=25770): stderr: | 20221212204748866 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204748866 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204748866 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204748867 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204748867 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204748868 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204748868 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:47:50.449974 run osmo-stp_10.42.42.5(pid=25770): stdout: | (launched: 2022-12-12_20:47:48.670936) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:47:50.585866 run osmo-stp_10.42.42.5(pid=25770): stderr: | 20221212204748866 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204748866 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204748866 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204748867 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204748867 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204748868 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204748868 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:47:50.748623 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25770): Process ended prematurely: osmo-stp_10.42.42.5(pid=25770) [trial-2382↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25770)] [trial-2382↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 20:47:50.758281 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 20:47:50.786450 run osmo-hlr_10.42.42.2(pid=25767): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25767)] 20:47:50.837792 run osmo-hlr_10.42.42.2(pid=25767): stdout: | (launched: 2022-12-12_20:47:47.604371) 20:47:50.890681 run osmo-hlr_10.42.42.2(pid=25767): stderr: | 20221212204747805 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212204747805 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212204747805 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212204747805 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212204747805 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212204747805 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212204747817 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212204747825 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212204747825 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212204747825 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:47:50.964335 run osmo-msc_10.42.42.6(pid=25773): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25773)] 20:47:51.015391 run osmo-msc_10.42.42.6(pid=25773): stdout: | (launched: 2022-12-12_20:47:49.762547) 20:47:51.068583 run osmo-msc_10.42.42.6(pid=25773): stderr: | 20221212204750087 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212204750087 DLGLOBAL DEBUG validating counter group 0x7f12abf47c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212204750087 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212204750087 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212204750087 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212204750088 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212204750089 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212204750090 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212204750090 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212204750090 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:47:51.122315 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25766): Terminating (SIGTERM) 20:47:51.164533 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25769): Terminating (SIGTERM) 20:47:51.206836 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25772): Terminating (SIGTERM) 20:47:51.249578 --- ParallelTerminationStrategy: PID 25766 died... 20:47:51.269758 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25766): Terminated: ok {rc=0} 20:47:51.317070 --- ParallelTerminationStrategy: PID 25769 died... 20:47:51.337146 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25769): Terminated: ok {rc=0} 20:47:51.384225 --- ParallelTerminationStrategy: PID 25772 died... 20:47:51.404151 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25772): Terminated: ok {rc=0} 20:47:51.494152 bus /sierra_3: Setting Powered False 20:47:52.596170 bus /sierra_3: Setting Powered False 20:47:53.714435 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 20:47:54.955242 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:47:54.962999 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 20:47:54.985242 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 20:47:55.012844 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 20:47:55.067615 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 20:47:55.089296 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 20:47:55.116681 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 20:47:55.666777 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 20:47:55.721757 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:47:55.733686 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 20:47:55.791235 tst mo_mt_call.py: using LAC 31407 20:47:55.926143 tst mo_mt_call.py: using RAC 42 20:47:56.062150 tst mo_mt_call.py: using CellId 31407 20:47:56.195726 tst mo_mt_call.py: using BVCI 31408 20:47:56.322328 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:47:56.334065 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:47:56.345572 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:47:56.356914 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:47:56.368839 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:47:56.380471 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 20:47:56.503544 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 20:47:56.623462 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:47:57.121254 run create_hlr_db(pid=25778): Launched 20:47:57.243818 bus /sierra_2: Setting Powered False 20:47:58.311371 run create_hlr_db(pid=25778): Terminated: ok {rc=0} 20:47:58.789588 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25780): Launched 20:47:59.135695 run osmo-hlr_10.42.42.2(pid=25781): Launched 20:47:59.266658 run osmo-stp_10.42.42.5: Starting osmo-stp 20:47:59.856817 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25783): Launched 20:48:00.200687 run osmo-stp_10.42.42.5(pid=25784): Launched 20:48:00.331057 run osmo-msc_10.42.42.6: Starting osmo-msc 20:48:00.955594 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25786): Launched 20:48:01.315992 run osmo-msc_10.42.42.6(pid=25787): Launched 20:48:01.575012 run osmo-stp_10.42.42.5(pid=25784): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25784)] 20:48:01.939417 run osmo-stp_10.42.42.5(pid=25784): stdout: | (launched: 2022-12-12_20:48:00.136744) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:48:02.115633 run osmo-stp_10.42.42.5(pid=25784): stderr: | 20221212204800331 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204800331 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204800331 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204800332 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204800332 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204800332 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204800332 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:48:02.260236 run osmo-stp_10.42.42.5(pid=25784): stdout: | (launched: 2022-12-12_20:48:00.136744) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:48:02.398808 run osmo-stp_10.42.42.5(pid=25784): stderr: | 20221212204800331 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204800331 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204800331 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204800332 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204800332 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204800332 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204800332 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:48:02.563940 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25784): Process ended prematurely: osmo-stp_10.42.42.5(pid=25784) [trial-2382↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25784)] [trial-2382↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 20:48:02.573681 tst mo_mt_call.py:8: Test FAILED (6.9 sec) 20:48:02.603356 run osmo-hlr_10.42.42.2(pid=25781): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25781)] 20:48:02.656074 run osmo-hlr_10.42.42.2(pid=25781): stdout: | (launched: 2022-12-12_20:47:59.071050) 20:48:02.710271 run osmo-hlr_10.42.42.2(pid=25781): stderr: | 20221212204759272 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212204759272 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212204759272 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212204759272 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212204759272 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212204759272 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212204759284 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212204759292 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212204759293 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212204759293 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:48:02.785563 run osmo-msc_10.42.42.6(pid=25787): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25787)] 20:48:02.838017 run osmo-msc_10.42.42.6(pid=25787): stdout: | (launched: 2022-12-12_20:48:01.249662) 20:48:02.892042 run osmo-msc_10.42.42.6(pid=25787): stderr: | 20221212204801731 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212204801731 DLGLOBAL DEBUG validating counter group 0x7efcaf8abc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212204801732 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212204801732 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212204801732 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212204801734 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212204801736 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212204801736 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212204801737 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212204801737 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:48:02.946347 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25780): Terminating (SIGTERM) 20:48:02.989590 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25783): Terminating (SIGTERM) 20:48:03.033054 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25786): Terminating (SIGTERM) 20:48:03.076493 --- ParallelTerminationStrategy: PID 25780 died... 20:48:03.097437 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25780): Terminated: ok {rc=0} 20:48:03.145186 --- ParallelTerminationStrategy: PID 25783 died... 20:48:03.165407 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25783): Terminated: ok {rc=0} 20:48:03.212686 --- ParallelTerminationStrategy: PID 25786 died... 20:48:03.233192 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25786): Terminated: ok {rc=0} 20:48:03.323852 bus /sierra_3: Setting Powered False 20:48:04.427909 bus /sierra_3: Setting Powered False 20:48:05.547024 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2382 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 20:48:06.701865 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:48:06.714360 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 20:48:06.773168 tst mo_mt_call_osmux.py: using LAC 31408 20:48:06.908497 tst mo_mt_call_osmux.py: using RAC 43 20:48:07.044254 tst mo_mt_call_osmux.py: using CellId 31408 20:48:07.182736 tst mo_mt_call_osmux.py: using BVCI 31409 20:48:07.308270 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:48:07.320039 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:48:07.331481 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:48:07.342979 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:48:07.354843 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:48:07.366428 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 20:48:07.488169 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 20:48:07.613683 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:48:08.148704 run create_hlr_db(pid=25789): Launched 20:48:08.287604 bus /sierra_2: Setting Powered False 20:48:09.355115 run create_hlr_db(pid=25789): Terminated: ok {rc=0} 20:48:09.811724 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25791): Launched 20:48:10.132659 run osmo-hlr_10.42.42.2(pid=25792): Launched 20:48:10.254947 run osmo-stp_10.42.42.5: Starting osmo-stp 20:48:10.821555 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25794): Launched 20:48:11.145369 run osmo-stp_10.42.42.5(pid=25795): Launched 20:48:11.267494 run osmo-msc_10.42.42.6: Starting osmo-msc 20:48:11.845201 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25797): Launched 20:48:12.166146 run osmo-msc_10.42.42.6(pid=25798): Launched 20:48:12.342665 run osmo-stp_10.42.42.5(pid=25795): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25795)] 20:48:12.476790 run osmo-stp_10.42.42.5(pid=25795): stdout: | (launched: 2022-12-12_20:48:11.084627) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:48:12.611275 run osmo-stp_10.42.42.5(pid=25795): stderr: | 20221212204811257 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204811257 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204811257 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204811258 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204811258 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204811258 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204811258 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:48:12.743641 run osmo-stp_10.42.42.5(pid=25795): stdout: | (launched: 2022-12-12_20:48:11.084627) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:48:12.870183 run osmo-stp_10.42.42.5(pid=25795): stderr: | 20221212204811257 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204811257 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204811257 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204811258 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204811258 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204811258 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204811258 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:48:13.021792 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25795): Process ended prematurely: osmo-stp_10.42.42.5(pid=25795) [trial-2382↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25795)] [trial-2382↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 20:48:13.030942 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 20:48:13.058650 run osmo-hlr_10.42.42.2(pid=25792): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25792)] 20:48:13.108141 run osmo-hlr_10.42.42.2(pid=25792): stdout: | (launched: 2022-12-12_20:48:10.072372) 20:48:13.159298 run osmo-hlr_10.42.42.2(pid=25792): stderr: | 20221212204810248 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212204810248 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212204810248 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212204810248 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212204810248 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212204810248 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212204810262 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212204810270 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212204810270 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212204810270 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:48:13.230860 run osmo-msc_10.42.42.6(pid=25798): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25798)] 20:48:13.280400 run osmo-msc_10.42.42.6(pid=25798): stdout: | (launched: 2022-12-12_20:48:12.105858) 20:48:13.331426 run osmo-msc_10.42.42.6(pid=25798): stderr: | 20221212204812379 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212204812380 DLGLOBAL DEBUG validating counter group 0x7f0504860c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212204812380 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212204812380 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212204812380 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212204812380 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212204812382 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212204812382 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212204812383 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212204812383 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:48:13.382830 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25791): Terminating (SIGTERM) 20:48:13.423777 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25794): Terminating (SIGTERM) 20:48:13.464594 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25797): Terminating (SIGTERM) 20:48:13.505559 --- ParallelTerminationStrategy: PID 25791 died... 20:48:13.525356 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25791): Terminated: ok {rc=0} 20:48:13.571230 --- ParallelTerminationStrategy: PID 25794 died... 20:48:13.590452 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25794): Terminated: ok {rc=0} 20:48:13.635938 --- ParallelTerminationStrategy: PID 25797 died... 20:48:13.655083 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25797): Terminated: ok {rc=0} 20:48:13.743677 bus /sierra_3: Setting Powered False 20:48:14.845163 bus /sierra_3: Setting Powered False 20:48:15.975066 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 20:48:17.223930 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:48:17.230849 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 20:48:17.254002 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 20:48:17.282517 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 20:48:17.335541 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 20:48:17.356234 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 20:48:17.383451 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 20:48:17.933908 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 20:48:17.985697 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:48:17.996879 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 20:48:18.056375 tst mo_mt_call.py: using LAC 31409 20:48:18.182037 tst mo_mt_call.py: using RAC 44 20:48:18.306613 tst mo_mt_call.py: using CellId 31409 20:48:18.431501 tst mo_mt_call.py: using BVCI 31410 20:48:18.547736 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:48:18.558984 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:48:18.570079 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:48:18.581431 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:48:18.592706 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:48:18.604050 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 20:48:18.724372 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 20:48:18.847053 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:48:19.382676 run create_hlr_db(pid=25803): Launched 20:48:19.523351 bus /sierra_2: Setting Powered False 20:48:20.591125 run create_hlr_db(pid=25803): Terminated: ok {rc=0} 20:48:21.049664 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25805): Launched 20:48:21.370968 run osmo-hlr_10.42.42.2(pid=25806): Launched 20:48:21.493010 run osmo-stp_10.42.42.5: Starting osmo-stp 20:48:22.052774 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25808): Launched 20:48:22.373042 run osmo-stp_10.42.42.5(pid=25809): Launched 20:48:22.494869 run osmo-msc_10.42.42.6: Starting osmo-msc 20:48:23.071518 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25811): Launched 20:48:23.417024 run osmo-msc_10.42.42.6(pid=25812): Launched 20:48:23.608183 run osmo-stp_10.42.42.5(pid=25809): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25809)] 20:48:23.752283 run osmo-stp_10.42.42.5(pid=25809): stdout: | (launched: 2022-12-12_20:48:22.312490) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:48:23.896324 run osmo-stp_10.42.42.5(pid=25809): stderr: | 20221212204822484 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204822484 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204822485 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204822485 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204822485 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204822486 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204822486 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:48:24.038823 run osmo-stp_10.42.42.5(pid=25809): stdout: | (launched: 2022-12-12_20:48:22.312490) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:48:24.175057 run osmo-stp_10.42.42.5(pid=25809): stderr: | 20221212204822484 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204822484 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204822485 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204822485 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204822485 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204822486 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204822486 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:48:24.338265 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25809): Process ended prematurely: osmo-stp_10.42.42.5(pid=25809) [trial-2382↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25809)] [trial-2382↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 20:48:24.348021 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 20:48:24.376734 run osmo-hlr_10.42.42.2(pid=25806): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25806)] 20:48:24.428539 run osmo-hlr_10.42.42.2(pid=25806): stdout: | (launched: 2022-12-12_20:48:21.310651) 20:48:24.482013 run osmo-hlr_10.42.42.2(pid=25806): stderr: | 20221212204821487 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212204821488 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212204821488 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212204821488 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212204821488 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212204821488 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212204821500 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212204821508 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212204821508 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212204821508 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:48:24.556323 run osmo-msc_10.42.42.6(pid=25812): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25812)] 20:48:24.607729 run osmo-msc_10.42.42.6(pid=25812): stdout: | (launched: 2022-12-12_20:48:23.352650) 20:48:24.660568 run osmo-msc_10.42.42.6(pid=25812): stderr: | 20221212204823678 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212204823678 DLGLOBAL DEBUG validating counter group 0x7f2dfc7d7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212204823678 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212204823678 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212204823678 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212204823678 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212204823680 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212204823680 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212204823681 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212204823681 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:48:24.714552 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25805): Terminating (SIGTERM) 20:48:24.757120 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25808): Terminating (SIGTERM) 20:48:24.799569 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25811): Terminating (SIGTERM) 20:48:24.842386 --- ParallelTerminationStrategy: PID 25805 died... 20:48:24.862828 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25805): Terminated: ok {rc=0} 20:48:24.910323 --- ParallelTerminationStrategy: PID 25808 died... 20:48:24.930468 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25808): Terminated: ok {rc=0} 20:48:24.977692 --- ParallelTerminationStrategy: PID 25811 died... 20:48:24.997709 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25811): Terminated: ok {rc=0} 20:48:25.088072 bus /sierra_3: Setting Powered False 20:48:26.190487 bus /sierra_3: Setting Powered False 20:48:27.311227 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2382 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 20:48:28.467162 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:48:28.479659 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 20:48:28.555796 tst mo_mt_call_osmux.py: using LAC 31410 20:48:28.696607 tst mo_mt_call_osmux.py: using RAC 45 20:48:28.831332 tst mo_mt_call_osmux.py: using CellId 31410 20:48:28.964791 tst mo_mt_call_osmux.py: using BVCI 31411 20:48:29.090015 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:48:29.101853 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:48:29.113340 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:48:29.125023 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:48:29.136473 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:48:29.148198 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 20:48:29.272175 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 20:48:29.392137 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:48:29.927746 run create_hlr_db(pid=25814): Launched 20:48:30.067115 bus /sierra_2: Setting Powered False 20:48:31.134895 run create_hlr_db(pid=25814): Terminated: ok {rc=0} 20:48:31.599717 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25816): Launched 20:48:31.944775 run osmo-hlr_10.42.42.2(pid=25817): Launched 20:48:32.147018 run osmo-stp_10.42.42.5: Starting osmo-stp 20:48:32.723830 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25819): Launched 20:48:33.045880 run osmo-stp_10.42.42.5(pid=25820): Launched 20:48:33.167128 run osmo-msc_10.42.42.6: Starting osmo-msc 20:48:33.744251 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25822): Launched 20:48:34.065643 run osmo-msc_10.42.42.6(pid=25823): Launched 20:48:34.243486 run osmo-stp_10.42.42.5(pid=25820): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25820)] 20:48:34.378832 run osmo-stp_10.42.42.5(pid=25820): stdout: | (launched: 2022-12-12_20:48:32.985504) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:48:34.513534 run osmo-stp_10.42.42.5(pid=25820): stderr: | 20221212204833159 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204833159 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204833160 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204833160 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204833161 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204833161 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204833161 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:48:34.647065 run osmo-stp_10.42.42.5(pid=25820): stdout: | (launched: 2022-12-12_20:48:32.985504) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:48:34.775486 run osmo-stp_10.42.42.5(pid=25820): stderr: | 20221212204833159 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204833159 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204833160 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204833160 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204833161 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204833161 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204833161 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:48:34.928449 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25820): Process ended prematurely: osmo-stp_10.42.42.5(pid=25820) [trial-2382↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25820)] [trial-2382↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 20:48:34.937611 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 20:48:34.965894 run osmo-hlr_10.42.42.2(pid=25817): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25817)] 20:48:35.015778 run osmo-hlr_10.42.42.2(pid=25817): stdout: | (launched: 2022-12-12_20:48:31.881306) 20:48:35.067610 run osmo-hlr_10.42.42.2(pid=25817): stderr: | 20221212204832191 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212204832191 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212204832191 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212204832191 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212204832191 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212204832191 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212204832208 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212204832216 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212204832217 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212204832217 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:48:35.139911 run osmo-msc_10.42.42.6(pid=25823): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25823)] 20:48:35.189515 run osmo-msc_10.42.42.6(pid=25823): stdout: | (launched: 2022-12-12_20:48:34.005693) 20:48:35.241155 run osmo-msc_10.42.42.6(pid=25823): stderr: | 20221212204834278 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212204834278 DLGLOBAL DEBUG validating counter group 0x7fe20b77bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212204834278 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212204834278 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212204834278 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212204834278 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212204834280 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212204834281 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212204834281 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212204834281 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:48:35.293368 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25816): Terminating (SIGTERM) 20:48:35.334565 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25819): Terminating (SIGTERM) 20:48:35.375969 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25822): Terminating (SIGTERM) 20:48:35.417500 --- ParallelTerminationStrategy: PID 25816 died... 20:48:35.437224 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25816): Terminated: ok {rc=0} 20:48:35.483448 --- ParallelTerminationStrategy: PID 25819 died... 20:48:35.502770 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25819): Terminated: ok {rc=0} 20:48:35.548571 --- ParallelTerminationStrategy: PID 25822 died... 20:48:35.567955 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25822): Terminated: ok {rc=0} 20:48:35.656881 bus /sierra_3: Setting Powered False 20:48:36.759552 bus /sierra_3: Setting Powered False 20:48:37.878141 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 20:48:39.116433 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:48:39.123509 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 20:48:39.144658 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 20:48:39.172129 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 20:48:39.226385 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 20:48:39.247915 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 20:48:39.275176 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 20:48:39.825188 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 20:48:39.878735 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:48:39.890398 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 20:48:39.950327 tst mo_mt_call.py: using LAC 31411 20:48:40.073373 tst mo_mt_call.py: using RAC 46 20:48:40.195554 tst mo_mt_call.py: using CellId 31411 20:48:40.318806 tst mo_mt_call.py: using BVCI 31412 20:48:40.434071 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:48:40.445508 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:48:40.456162 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:48:40.467412 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:48:40.478774 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:48:40.490169 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 20:48:40.607162 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 20:48:40.726379 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:48:41.214066 run create_hlr_db(pid=25829): Launched 20:48:41.334082 bus /sierra_2: Setting Powered False 20:48:42.396788 run create_hlr_db(pid=25829): Terminated: ok {rc=0} 20:48:42.857129 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25831): Launched 20:48:43.196460 run osmo-hlr_10.42.42.2(pid=25832): Launched 20:48:43.325298 run osmo-stp_10.42.42.5: Starting osmo-stp 20:48:43.906534 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25834): Launched 20:48:44.244673 run osmo-stp_10.42.42.5(pid=25835): Launched 20:48:44.372784 run osmo-msc_10.42.42.6: Starting osmo-msc 20:48:44.981601 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25837): Launched 20:48:45.321807 run osmo-msc_10.42.42.6(pid=25838): Launched 20:48:45.509909 run osmo-stp_10.42.42.5(pid=25835): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25835)] 20:48:45.651255 run osmo-stp_10.42.42.5(pid=25835): stdout: | (launched: 2022-12-12_20:48:44.181894) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:48:45.793021 run osmo-stp_10.42.42.5(pid=25835): stderr: | 20221212204844372 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204844372 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204844372 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204844373 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204844373 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204844373 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204844374 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:48:45.957617 run osmo-stp_10.42.42.5(pid=25835): stdout: | (launched: 2022-12-12_20:48:44.181894) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:48:46.088795 run osmo-stp_10.42.42.5(pid=25835): stderr: | 20221212204844372 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204844372 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204844372 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204844373 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204844373 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204844373 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204844374 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:48:46.243095 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25835): Process ended prematurely: osmo-stp_10.42.42.5(pid=25835) [trial-2382↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25835)] [trial-2382↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 20:48:46.253065 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 20:48:46.285093 run osmo-hlr_10.42.42.2(pid=25832): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25832)] 20:48:46.337391 run osmo-hlr_10.42.42.2(pid=25832): stdout: | (launched: 2022-12-12_20:48:43.133601) 20:48:46.391206 run osmo-hlr_10.42.42.2(pid=25832): stderr: | 20221212204843329 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212204843329 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212204843329 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212204843329 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212204843330 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212204843330 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212204843342 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212204843351 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212204843351 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212204843351 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:48:46.466343 run osmo-msc_10.42.42.6(pid=25838): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25838)] 20:48:46.518792 run osmo-msc_10.42.42.6(pid=25838): stdout: | (launched: 2022-12-12_20:48:45.258467) 20:48:46.572667 run osmo-msc_10.42.42.6(pid=25838): stderr: | 20221212204845582 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212204845582 DLGLOBAL DEBUG validating counter group 0x7f1b2e49dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212204845582 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212204845582 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212204845582 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212204845582 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212204845584 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212204845584 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212204845585 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212204845585 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:48:46.627566 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25831): Terminating (SIGTERM) 20:48:46.673070 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25834): Terminating (SIGTERM) 20:48:46.718694 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25837): Terminating (SIGTERM) 20:48:46.766158 --- ParallelTerminationStrategy: PID 25831 died... 20:48:46.786824 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25831): Terminated: ok {rc=0} 20:48:46.837020 --- ParallelTerminationStrategy: PID 25834 died... 20:48:46.858289 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25834): Terminated: ok {rc=0} 20:48:46.907083 --- ParallelTerminationStrategy: PID 25837 died... 20:48:46.927320 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25837): Terminated: ok {rc=0} 20:48:47.019395 bus /sierra_3: Setting Powered False 20:48:48.122304 bus /sierra_3: Setting Powered False 20:48:49.239630 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2382 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 20:48:50.393153 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:48:50.405277 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 20:48:50.463348 tst mo_mt_call_osmux.py: using LAC 31412 20:48:50.596277 tst mo_mt_call_osmux.py: using RAC 47 20:48:50.729130 tst mo_mt_call_osmux.py: using CellId 31412 20:48:50.861807 tst mo_mt_call_osmux.py: using BVCI 31413 20:48:50.986514 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:48:50.998091 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:48:51.009444 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:48:51.020887 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:48:51.032330 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:48:51.043802 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 20:48:51.164076 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 20:48:51.287350 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:48:51.810632 run create_hlr_db(pid=25840): Launched 20:48:51.947101 bus /sierra_2: Setting Powered False 20:48:53.013858 run create_hlr_db(pid=25840): Terminated: ok {rc=0} 20:48:53.482723 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25842): Launched 20:48:53.821681 run osmo-hlr_10.42.42.2(pid=25843): Launched 20:48:53.949647 run osmo-stp_10.42.42.5: Starting osmo-stp 20:48:54.531966 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25845): Launched 20:48:54.868492 run osmo-stp_10.42.42.5(pid=25846): Launched 20:48:54.996553 run osmo-msc_10.42.42.6: Starting osmo-msc 20:48:55.603723 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25848): Launched 20:48:55.941155 run osmo-msc_10.42.42.6(pid=25849): Launched 20:48:56.127906 run osmo-stp_10.42.42.5(pid=25846): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25846)] 20:48:56.268498 run osmo-stp_10.42.42.5(pid=25846): stdout: | (launched: 2022-12-12_20:48:54.806225) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:48:56.409697 run osmo-stp_10.42.42.5(pid=25846): stderr: | 20221212204854996 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204854996 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204854996 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204854997 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204854997 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204854997 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204854997 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:48:56.548453 run osmo-stp_10.42.42.5(pid=25846): stdout: | (launched: 2022-12-12_20:48:54.806225) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:48:56.682164 run osmo-stp_10.42.42.5(pid=25846): stderr: | 20221212204854996 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204854996 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204854996 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204854997 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204854997 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204854997 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204854997 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:48:56.841691 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25846): Process ended prematurely: osmo-stp_10.42.42.5(pid=25846) [trial-2382↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25846)] [trial-2382↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 20:48:56.851184 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 20:48:56.879510 run osmo-hlr_10.42.42.2(pid=25843): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25843)] 20:48:56.930222 run osmo-hlr_10.42.42.2(pid=25843): stdout: | (launched: 2022-12-12_20:48:53.758861) 20:48:56.983246 run osmo-hlr_10.42.42.2(pid=25843): stderr: | 20221212204853958 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212204853958 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212204853958 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212204853958 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212204853958 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212204853958 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212204853971 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212204853980 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212204853980 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212204853980 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:48:57.056935 run osmo-msc_10.42.42.6(pid=25849): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25849)] 20:48:57.107948 run osmo-msc_10.42.42.6(pid=25849): stdout: | (launched: 2022-12-12_20:48:55.878511) 20:48:57.160453 run osmo-msc_10.42.42.6(pid=25849): stderr: | 20221212204856199 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212204856199 DLGLOBAL DEBUG validating counter group 0x7fa88c4b1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212204856199 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212204856199 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212204856199 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212204856200 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212204856201 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212204856202 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212204856202 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212204856202 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:48:57.213339 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25842): Terminating (SIGTERM) 20:48:57.255730 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25845): Terminating (SIGTERM) 20:48:57.297976 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25848): Terminating (SIGTERM) 20:48:57.340633 --- ParallelTerminationStrategy: PID 25842 died... 20:48:57.361029 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25842): Terminated: ok {rc=0} 20:48:57.407839 --- ParallelTerminationStrategy: PID 25845 died... 20:48:57.427772 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25845): Terminated: ok {rc=0} 20:48:57.474542 --- ParallelTerminationStrategy: PID 25848 died... 20:48:57.494409 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25848): Terminated: ok {rc=0} 20:48:57.583106 bus /sierra_3: Setting Powered False 20:48:58.682361 bus /sierra_3: Setting Powered False 20:48:59.798407 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 20:49:01.060662 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:49:01.068545 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 20:49:01.091186 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 20:49:01.119703 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 20:49:01.175978 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 20:49:01.209553 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 20:49:01.256175 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 20:49:01.775414 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 20:49:01.830674 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:49:01.843178 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 20:49:01.901381 tst mo_mt_call.py: using LAC 31413 20:49:02.028803 tst mo_mt_call.py: using RAC 48 20:49:02.156754 tst mo_mt_call.py: using CellId 31413 20:49:02.285233 tst mo_mt_call.py: using BVCI 31414 20:49:02.402068 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:49:02.413315 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:49:02.424193 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:49:02.435576 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:49:02.446977 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:49:02.458334 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 20:49:02.581065 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 20:49:02.704220 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:49:03.228550 run create_hlr_db(pid=25855): Launched 20:49:03.365851 bus /sierra_2: Setting Powered False 20:49:04.432736 run create_hlr_db(pid=25855): Terminated: ok {rc=0} 20:49:04.900079 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25857): Launched 20:49:05.239241 run osmo-hlr_10.42.42.2(pid=25858): Launched 20:49:05.367717 run osmo-stp_10.42.42.5: Starting osmo-stp 20:49:05.948190 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25860): Launched 20:49:06.286958 run osmo-stp_10.42.42.5(pid=25861): Launched 20:49:06.415132 run osmo-msc_10.42.42.6: Starting osmo-msc 20:49:07.023177 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25863): Launched 20:49:07.362326 run osmo-msc_10.42.42.6(pid=25864): Launched 20:49:07.549430 run osmo-stp_10.42.42.5(pid=25861): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25861)] 20:49:07.690357 run osmo-stp_10.42.42.5(pid=25861): stdout: | (launched: 2022-12-12_20:49:06.224032) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:49:07.831902 run osmo-stp_10.42.42.5(pid=25861): stderr: | 20221212204906414 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204906414 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204906415 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204906415 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204906415 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204906416 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204906416 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:49:07.984389 run osmo-stp_10.42.42.5(pid=25861): stdout: | (launched: 2022-12-12_20:49:06.224032) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:49:08.118026 run osmo-stp_10.42.42.5(pid=25861): stderr: | 20221212204906414 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204906414 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204906415 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204906415 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204906415 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204906416 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204906416 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:49:08.276721 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25861): Process ended prematurely: osmo-stp_10.42.42.5(pid=25861) [trial-2382↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25861)] [trial-2382↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 20:49:08.286557 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 20:49:08.314889 run osmo-hlr_10.42.42.2(pid=25858): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25858)] 20:49:08.366314 run osmo-hlr_10.42.42.2(pid=25858): stdout: | (launched: 2022-12-12_20:49:05.176208) 20:49:08.419046 run osmo-hlr_10.42.42.2(pid=25858): stderr: | 20221212204905374 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212204905374 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212204905374 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212204905374 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212204905374 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212204905374 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212204905388 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212204905399 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212204905399 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212204905399 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:49:08.492586 run osmo-msc_10.42.42.6(pid=25864): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25864)] 20:49:08.543648 run osmo-msc_10.42.42.6(pid=25864): stdout: | (launched: 2022-12-12_20:49:07.299268) 20:49:08.596253 run osmo-msc_10.42.42.6(pid=25864): stderr: | 20221212204907622 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212204907623 DLGLOBAL DEBUG validating counter group 0x7fd04cefdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212204907623 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212204907623 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212204907623 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212204907623 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212204907626 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212204907627 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212204907627 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212204907627 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:49:08.649270 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25857): Terminating (SIGTERM) 20:49:08.692133 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25860): Terminating (SIGTERM) 20:49:08.734799 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25863): Terminating (SIGTERM) 20:49:08.777742 --- ParallelTerminationStrategy: PID 25857 died... 20:49:08.798141 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25857): Terminated: ok {rc=0} 20:49:08.845351 --- ParallelTerminationStrategy: PID 25860 died... 20:49:08.865347 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25860): Terminated: ok {rc=0} 20:49:08.912390 --- ParallelTerminationStrategy: PID 25863 died... 20:49:08.932375 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25863): Terminated: ok {rc=0} 20:49:09.022282 bus /sierra_3: Setting Powered False 20:49:10.123117 bus /sierra_3: Setting Powered False 20:49:11.241672 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2382 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 20:49:12.387186 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:49:12.398971 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 20:49:12.455124 tst mo_mt_call_osmux.py: using LAC 31414 20:49:12.579178 tst mo_mt_call_osmux.py: using RAC 49 20:49:12.701210 tst mo_mt_call_osmux.py: using CellId 31414 20:49:12.825212 tst mo_mt_call_osmux.py: using BVCI 31415 20:49:12.940051 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:49:12.951190 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:49:12.962272 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:49:12.973520 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:49:12.984736 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:49:12.996172 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 20:49:13.118159 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 20:49:13.236096 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:49:13.717529 run create_hlr_db(pid=25866): Launched 20:49:13.836925 bus /sierra_2: Setting Powered False 20:49:14.899300 run create_hlr_db(pid=25866): Terminated: ok {rc=0} 20:49:15.335437 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25868): Launched 20:49:15.647956 run osmo-hlr_10.42.42.2(pid=25869): Launched 20:49:15.766859 run osmo-stp_10.42.42.5: Starting osmo-stp 20:49:16.418608 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25871): Launched 20:49:16.757696 run osmo-stp_10.42.42.5(pid=25872): Launched 20:49:17.009763 run osmo-msc_10.42.42.6: Starting osmo-msc 20:49:17.642063 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25874): Launched 20:49:17.978907 run osmo-msc_10.42.42.6(pid=25875): Launched 20:49:18.165205 run osmo-stp_10.42.42.5(pid=25872): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25872)] 20:49:18.305983 run osmo-stp_10.42.42.5(pid=25872): stdout: | (launched: 2022-12-12_20:49:16.692523) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:49:18.447750 run osmo-stp_10.42.42.5(pid=25872): stderr: | 20221212204916946 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204916946 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204916947 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204916947 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204916947 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204916947 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204916948 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:49:18.601272 run osmo-stp_10.42.42.5(pid=25872): stdout: | (launched: 2022-12-12_20:49:16.692523) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:49:18.733222 run osmo-stp_10.42.42.5(pid=25872): stderr: | 20221212204916946 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204916946 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204916947 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204916947 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204916947 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204916947 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204916948 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:49:18.891415 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25872): Process ended prematurely: osmo-stp_10.42.42.5(pid=25872) [trial-2382↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25872)] [trial-2382↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 20:49:18.901157 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 20:49:18.929544 run osmo-hlr_10.42.42.2(pid=25869): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25869)] 20:49:18.980716 run osmo-hlr_10.42.42.2(pid=25869): stdout: | (launched: 2022-12-12_20:49:15.589768) 20:49:19.033748 run osmo-hlr_10.42.42.2(pid=25869): stderr: | 20221212204915764 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212204915764 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212204915764 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212204915764 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212204915764 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212204915764 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212204915776 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212204915784 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212204915785 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212204915785 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:49:19.108048 run osmo-msc_10.42.42.6(pid=25875): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25875)] 20:49:19.160099 run osmo-msc_10.42.42.6(pid=25875): stdout: | (launched: 2022-12-12_20:49:17.916549) 20:49:19.213060 run osmo-msc_10.42.42.6(pid=25875): stderr: | 20221212204918244 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212204918244 DLGLOBAL DEBUG validating counter group 0x7fd7ce6c0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212204918245 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212204918245 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212204918245 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212204918245 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212204918247 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212204918247 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212204918247 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212204918247 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:49:19.266252 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25868): Terminating (SIGTERM) 20:49:19.308700 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25871): Terminating (SIGTERM) 20:49:19.351440 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25874): Terminating (SIGTERM) 20:49:19.394371 --- ParallelTerminationStrategy: PID 25868 died... 20:49:19.415105 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25868): Terminated: ok {rc=0} 20:49:19.462541 --- ParallelTerminationStrategy: PID 25871 died... 20:49:19.482509 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25871): Terminated: ok {rc=0} 20:49:19.529638 --- ParallelTerminationStrategy: PID 25874 died... 20:49:19.549620 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25874): Terminated: ok {rc=0} 20:49:19.638734 bus /sierra_3: Setting Powered False 20:49:20.739850 bus /sierra_3: Setting Powered False 20:49:21.858467 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 20:49:23.100377 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:49:23.107694 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 20:49:23.130468 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 20:49:23.159123 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 20:49:23.210334 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 20:49:23.230910 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 20:49:23.257569 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 20:49:23.807903 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 20:49:23.864004 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:49:23.875877 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 20:49:23.934266 tst mo_mt_call.py: using LAC 31415 20:49:24.065832 tst mo_mt_call.py: using RAC 50 20:49:24.195203 tst mo_mt_call.py: using CellId 31415 20:49:24.326828 tst mo_mt_call.py: using BVCI 31416 20:49:24.448816 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:49:24.460470 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:49:24.471881 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:49:24.483275 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:49:24.494680 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:49:24.506185 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:49:24.622572 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:49:24.742782 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:49:25.254508 run create_hlr_db(pid=25880): Launched 20:49:25.389498 bus /sierra_2: Setting Powered False 20:49:26.455385 run create_hlr_db(pid=25880): Terminated: ok {rc=0} 20:49:26.897218 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25882): Launched 20:49:27.208444 run osmo-hlr_10.42.42.2(pid=25883): Launched 20:49:27.327538 run osmo-stp_10.42.42.5: Starting osmo-stp 20:49:27.863835 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25885): Launched 20:49:28.175504 run osmo-stp_10.42.42.5(pid=25886): Launched 20:49:28.294257 run osmo-msc_10.42.42.6: Starting osmo-msc 20:49:28.854664 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25888): Launched 20:49:29.166021 run osmo-msc_10.42.42.6(pid=25889): Launched 20:49:29.339689 run osmo-stp_10.42.42.5(pid=25886): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25886)] 20:49:29.471971 run osmo-stp_10.42.42.5(pid=25886): stdout: | (launched: 2022-12-12_20:49:28.118792) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:49:29.603504 run osmo-stp_10.42.42.5(pid=25886): stderr: | 20221212204928287 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204928287 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204928287 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204928287 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204928288 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204928288 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204928288 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:49:29.733979 run osmo-stp_10.42.42.5(pid=25886): stdout: | (launched: 2022-12-12_20:49:28.118792) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:49:29.858699 run osmo-stp_10.42.42.5(pid=25886): stderr: | 20221212204928287 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204928287 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204928287 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204928287 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204928288 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204928288 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204928288 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:49:30.007437 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25886): Process ended prematurely: osmo-stp_10.42.42.5(pid=25886) [trial-2382↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25886)] [trial-2382↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 20:49:30.016522 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 20:49:30.044021 run osmo-hlr_10.42.42.2(pid=25883): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25883)] 20:49:30.093933 run osmo-hlr_10.42.42.2(pid=25883): stdout: | (launched: 2022-12-12_20:49:27.151648) 20:49:30.145120 run osmo-hlr_10.42.42.2(pid=25883): stderr: | 20221212204927326 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212204927326 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212204927326 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212204927326 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212204927326 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212204927326 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212204927338 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212204927346 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212204927347 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212204927347 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:49:30.215934 run osmo-msc_10.42.42.6(pid=25889): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25889)] 20:49:30.265376 run osmo-msc_10.42.42.6(pid=25889): stdout: | (launched: 2022-12-12_20:49:29.109257) 20:49:30.316701 run osmo-msc_10.42.42.6(pid=25889): stderr: | 20221212204929379 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212204929380 DLGLOBAL DEBUG validating counter group 0x7f1d88262c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212204929380 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212204929380 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212204929380 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212204929380 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212204929382 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212204929382 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212204929382 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212204929383 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:49:30.368216 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25882): Terminating (SIGTERM) 20:49:30.409543 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25885): Terminating (SIGTERM) 20:49:30.450547 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25888): Terminating (SIGTERM) 20:49:30.491671 --- ParallelTerminationStrategy: PID 25882 died... 20:49:30.511144 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25882): Terminated: ok {rc=0} 20:49:30.557440 --- ParallelTerminationStrategy: PID 25885 died... 20:49:30.576642 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25885): Terminated: ok {rc=0} 20:49:30.622617 --- ParallelTerminationStrategy: PID 25888 died... 20:49:30.641727 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25888): Terminated: ok {rc=0} 20:49:30.730239 bus /sierra_3: Setting Powered False 20:49:31.834284 bus /sierra_3: Setting Powered False 20:49:32.961600 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2382 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 20:49:34.115342 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:49:34.127615 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 20:49:34.186382 tst mo_mt_call_osmux.py: using LAC 31416 20:49:34.317765 tst mo_mt_call_osmux.py: using RAC 51 20:49:34.451199 tst mo_mt_call_osmux.py: using CellId 31416 20:49:34.583999 tst mo_mt_call_osmux.py: using BVCI 31417 20:49:34.705438 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:49:34.717091 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:49:34.728468 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:49:34.739911 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:49:34.751310 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:49:34.762819 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:49:34.880376 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:49:34.996626 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:49:35.479745 run create_hlr_db(pid=25895): Launched 20:49:35.599838 bus /sierra_2: Setting Powered False 20:49:36.662996 run create_hlr_db(pid=25895): Terminated: ok {rc=0} 20:49:37.094723 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25897): Launched 20:49:37.406304 run osmo-hlr_10.42.42.2(pid=25898): Launched 20:49:37.524687 run osmo-stp_10.42.42.5: Starting osmo-stp 20:49:38.057316 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25900): Launched 20:49:38.368681 run osmo-stp_10.42.42.5(pid=25901): Launched 20:49:38.487794 run osmo-msc_10.42.42.6: Starting osmo-msc 20:49:39.048891 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25903): Launched 20:49:39.360701 run osmo-msc_10.42.42.6(pid=25904): Launched 20:49:39.534733 run osmo-stp_10.42.42.5(pid=25901): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25901)] 20:49:39.666887 run osmo-stp_10.42.42.5(pid=25901): stdout: | (launched: 2022-12-12_20:49:38.311827) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:49:39.798495 run osmo-stp_10.42.42.5(pid=25901): stderr: | 20221212204938479 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204938479 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204938479 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204938480 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204938480 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204938480 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204938480 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:49:39.928190 run osmo-stp_10.42.42.5(pid=25901): stdout: | (launched: 2022-12-12_20:49:38.311827) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:49:40.052436 run osmo-stp_10.42.42.5(pid=25901): stderr: | 20221212204938479 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204938479 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204938479 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204938480 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204938480 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204938480 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204938480 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:49:40.201288 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25901): Process ended prematurely: osmo-stp_10.42.42.5(pid=25901) [trial-2382↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25901)] [trial-2382↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 20:49:40.210092 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 20:49:40.237388 run osmo-hlr_10.42.42.2(pid=25898): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25898)] 20:49:40.286083 run osmo-hlr_10.42.42.2(pid=25898): stdout: | (launched: 2022-12-12_20:49:37.349348) 20:49:40.336423 run osmo-hlr_10.42.42.2(pid=25898): stderr: | 20221212204937524 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212204937524 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212204937524 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212204937524 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212204937524 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212204937525 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212204937536 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212204937545 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212204937545 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212204937545 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:49:40.406759 run osmo-msc_10.42.42.6(pid=25904): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25904)] 20:49:40.455377 run osmo-msc_10.42.42.6(pid=25904): stdout: | (launched: 2022-12-12_20:49:39.303597) 20:49:40.505794 run osmo-msc_10.42.42.6(pid=25904): stderr: | 20221212204939572 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212204939572 DLGLOBAL DEBUG validating counter group 0x7f491d035c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212204939572 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212204939572 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212204939572 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212204939572 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212204939575 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212204939575 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212204939575 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212204939575 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:49:40.556641 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25897): Terminating (SIGTERM) 20:49:40.597161 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25900): Terminating (SIGTERM) 20:49:40.637539 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25903): Terminating (SIGTERM) 20:49:40.678911 --- ParallelTerminationStrategy: PID 25897 died... 20:49:40.698355 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25897): Terminated: ok {rc=0} 20:49:40.743576 --- ParallelTerminationStrategy: PID 25900 died... 20:49:40.762518 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25900): Terminated: ok {rc=0} 20:49:40.807398 --- ParallelTerminationStrategy: PID 25903 died... 20:49:40.826218 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25903): Terminated: ok {rc=0} 20:49:40.912595 bus /sierra_3: Setting Powered False 20:49:42.012450 bus /sierra_3: Setting Powered False 20:49:43.129970 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 voice:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 20:49:44.370330 tst voice:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:49:44.376269 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 20:49:44.397402 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 20:49:44.424662 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 20:49:44.477243 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 20:49:44.498259 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 20:49:44.525322 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 20:49:45.075660 tst voice:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 20:49:45.127677 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:49:45.138708 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:49:45.194853 tst mo_mt_call.py: using LAC 31417 20:49:45.328060 tst mo_mt_call.py: using RAC 52 20:49:45.459910 tst mo_mt_call.py: using CellId 31417 20:49:45.592256 tst mo_mt_call.py: using BVCI 31418 20:49:45.714551 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:49:45.726169 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:49:45.737272 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:49:45.748294 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:49:45.759459 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:49:45.770644 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 20:49:45.908153 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 20:49:46.029681 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:49:46.603690 run create_hlr_db(pid=25909): Launched 20:49:46.762758 bus /sierra_2: Setting Powered False 20:49:47.824550 run create_hlr_db(pid=25909): Terminated: ok {rc=0} 20:49:48.279332 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25911): Launched 20:49:48.613506 run osmo-hlr_10.42.42.2(pid=25912): Launched 20:49:48.740586 run osmo-stp_10.42.42.5: Starting osmo-stp 20:49:49.319063 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25914): Launched 20:49:49.653933 run osmo-stp_10.42.42.5(pid=25915): Launched 20:49:49.780431 run osmo-msc_10.42.42.6: Starting osmo-msc 20:49:50.382220 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25917): Launched 20:49:50.716518 run osmo-msc_10.42.42.6(pid=25918): Launched 20:49:50.902300 run osmo-stp_10.42.42.5(pid=25915): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25915)] 20:49:51.042626 run osmo-stp_10.42.42.5(pid=25915): stdout: | (launched: 2022-12-12_20:49:49.593225) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:49:51.183794 run osmo-stp_10.42.42.5(pid=25915): stderr: | 20221212204949784 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204949784 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204949785 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204949785 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204949786 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204949786 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204949786 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:49:51.322879 run osmo-stp_10.42.42.5(pid=25915): stdout: | (launched: 2022-12-12_20:49:49.593225) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:49:51.456730 run osmo-stp_10.42.42.5(pid=25915): stderr: | 20221212204949784 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212204949784 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212204949785 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212204949785 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212204949786 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212204949786 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212204949786 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:49:51.616201 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25915): Process ended prematurely: osmo-stp_10.42.42.5(pid=25915) [trial-2382↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25915)] [trial-2382↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 20:49:51.625728 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 20:49:51.653854 run osmo-hlr_10.42.42.2(pid=25912): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25912)] 20:49:51.704823 run osmo-hlr_10.42.42.2(pid=25912): stdout: | (launched: 2022-12-12_20:49:48.552799) 20:49:51.757709 run osmo-hlr_10.42.42.2(pid=25912): stderr: | 20221212204948750 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212204948750 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212204948750 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212204948750 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212204948750 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212204948750 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212204948762 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212204948773 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212204948774 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212204948774 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:49:51.831106 run osmo-msc_10.42.42.6(pid=25918): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25918)] 20:49:51.882314 run osmo-msc_10.42.42.6(pid=25918): stdout: | (launched: 2022-12-12_20:49:50.655775) 20:49:51.934785 run osmo-msc_10.42.42.6(pid=25918): stderr: | 20221212204950976 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212204950976 DLGLOBAL DEBUG validating counter group 0x7fb3f3dbcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212204950976 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212204950976 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212204950976 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212204950977 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212204950978 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212204950979 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212204950979 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212204950979 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:49:51.987438 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25911): Terminating (SIGTERM) 20:49:52.029586 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25914): Terminating (SIGTERM) 20:49:52.071972 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25917): Terminating (SIGTERM) 20:49:52.115213 --- ParallelTerminationStrategy: PID 25911 died... 20:49:52.135734 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25911): Terminated: ok {rc=0} 20:49:52.183293 --- ParallelTerminationStrategy: PID 25914 died... 20:49:52.203273 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25914): Terminated: ok {rc=0} 20:49:52.250590 --- ParallelTerminationStrategy: PID 25917 died... 20:49:52.270537 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25917): Terminated: ok {rc=0} 20:49:52.359872 bus /sierra_3: Setting Powered False 20:49:53.461581 bus /sierra_3: Setting Powered False 20:49:54.579569 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2382 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 20:49:55.732660 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:49:55.744856 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:49:55.803256 tst mo_mt_call_osmux.py: using LAC 31418 20:49:55.935859 tst mo_mt_call_osmux.py: using RAC 53 20:49:56.068461 tst mo_mt_call_osmux.py: using CellId 31418 20:49:56.200470 tst mo_mt_call_osmux.py: using BVCI 31419 20:49:56.322632 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:49:56.334124 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:49:56.345258 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:49:56.356302 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:49:56.367424 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:49:56.378589 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 20:49:56.495798 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 20:49:56.617856 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:49:57.137546 run create_hlr_db(pid=25920): Launched 20:49:57.273884 bus /sierra_2: Setting Powered False 20:49:58.341174 run create_hlr_db(pid=25920): Terminated: ok {rc=0} 20:49:58.787138 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25922): Launched 20:49:59.098894 run osmo-hlr_10.42.42.2(pid=25923): Launched 20:49:59.217936 run osmo-stp_10.42.42.5: Starting osmo-stp 20:49:59.772859 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25925): Launched 20:50:00.084387 run osmo-stp_10.42.42.5(pid=25926): Launched 20:50:00.202412 run osmo-msc_10.42.42.6: Starting osmo-msc 20:50:00.768461 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25928): Launched 20:50:01.102590 run osmo-msc_10.42.42.6(pid=25929): Launched 20:50:01.507953 run osmo-stp_10.42.42.5(pid=25926): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25926)] 20:50:01.739004 run osmo-stp_10.42.42.5(pid=25926): stdout: | (launched: 2022-12-12_20:50:00.027005) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:50:01.973322 run osmo-stp_10.42.42.5(pid=25926): stderr: | 20221212205000194 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205000194 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205000194 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205000195 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205000195 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205000195 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205000195 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:50:02.107283 run osmo-stp_10.42.42.5(pid=25926): stdout: | (launched: 2022-12-12_20:50:00.027005) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:50:02.235807 run osmo-stp_10.42.42.5(pid=25926): stderr: | 20221212205000194 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205000194 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205000194 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205000195 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205000195 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205000195 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205000195 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:50:02.388878 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25926): Process ended prematurely: osmo-stp_10.42.42.5(pid=25926) [trial-2382↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25926)] [trial-2382↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 20:50:02.399402 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 20:50:02.426940 run osmo-hlr_10.42.42.2(pid=25923): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25923)] 20:50:02.476686 run osmo-hlr_10.42.42.2(pid=25923): stdout: | (launched: 2022-12-12_20:49:59.041936) 20:50:02.528084 run osmo-hlr_10.42.42.2(pid=25923): stderr: | 20221212204959217 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212204959217 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212204959217 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212204959217 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212204959217 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212204959217 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212204959233 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212204959243 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212204959243 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212204959243 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:50:02.599569 run osmo-msc_10.42.42.6(pid=25929): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25929)] 20:50:02.648922 run osmo-msc_10.42.42.6(pid=25929): stdout: | (launched: 2022-12-12_20:50:01.040540) 20:50:02.700019 run osmo-msc_10.42.42.6(pid=25929): stderr: | 20221212205001551 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212205001551 DLGLOBAL DEBUG validating counter group 0x7f2e157c4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212205001551 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212205001551 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212205001551 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212205001551 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212205001560 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212205001561 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212205001561 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212205001561 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:50:02.751588 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25922): Terminating (SIGTERM) 20:50:02.792284 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25925): Terminating (SIGTERM) 20:50:02.833463 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25928): Terminating (SIGTERM) 20:50:02.874679 --- ParallelTerminationStrategy: PID 25922 died... 20:50:02.894308 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25922): Terminated: ok {rc=0} 20:50:02.939783 --- ParallelTerminationStrategy: PID 25925 died... 20:50:02.958839 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25925): Terminated: ok {rc=0} 20:50:03.004288 --- ParallelTerminationStrategy: PID 25928 died... 20:50:03.023447 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25928): Terminated: ok {rc=0} 20:50:03.110984 bus /sierra_3: Setting Powered False 20:50:04.212275 bus /sierra_3: Setting Powered False 20:50:05.330432 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 voice:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 emergency:oc2g --------------------------------------------------------------------- 20:50:06.568669 tst emergency:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:50:06.573775 tst emergency:oc2g: Verifying 1 x bts (candidates: 11) 20:50:06.594778 tst emergency:oc2g: Verifying 6 x ip_address (candidates: 9) 20:50:06.622037 tst emergency:oc2g: Verifying 4 x modem (candidates: 12) 20:50:06.709859 tst emergency:oc2g: Reserving 1 x bts (candidates: 11) 20:50:06.731009 tst emergency:oc2g: Reserving 6 x ip_address (candidates: 9) 20:50:06.758202 tst emergency:oc2g: Reserving 4 x modem (candidates: 12) 20:50:07.341928 tst emergency:oc2g: RESERVED RESOURCES for emergency: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2382 emergency:oc2g emergency_mo_mt_call.py ---------------------------------------------- 20:50:07.347052 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 20:50:07.358088 tst emergency:oc2g: Using 1 x bts (candidates: 1) 20:50:07.393816 tst emergency_mo_mt_call.py: using LAC 31419 20:50:07.524541 tst emergency_mo_mt_call.py: using RAC 54 20:50:07.653653 tst emergency_mo_mt_call.py: using CellId 31419 20:50:07.782580 tst emergency_mo_mt_call.py: using BVCI 31420 20:50:07.903601 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 20:50:07.914813 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 20:50:07.925811 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 20:50:07.936667 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 20:50:07.947658 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 20:50:07.958575 tst emergency:oc2g: Using 1 x modem (candidates: 4) 20:50:08.074162 tst emergency:oc2g: Using 1 x modem (candidates: 4) 20:50:08.192202 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:50:08.703892 run create_hlr_db(pid=25938): Launched 20:50:08.837460 bus /sierra_2: Setting Powered False 20:50:09.898533 run create_hlr_db(pid=25938): Terminated: ok {rc=0} 20:50:10.358361 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25940): Launched 20:50:10.687379 run osmo-hlr_10.42.42.2(pid=25941): Launched 20:50:10.811485 run osmo-stp_10.42.42.5: Starting osmo-stp 20:50:11.377645 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25943): Launched 20:50:11.707955 run osmo-stp_10.42.42.5(pid=25944): Launched 20:50:11.841820 tst emergency_mo_mt_call.py: using MSISDN 7967 20:50:12.010475 run osmo-msc_10.42.42.6: Starting osmo-msc 20:50:12.600677 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25946): Launched 20:50:12.928718 run osmo-msc_10.42.42.6(pid=25947): Launched 20:50:13.112545 run osmo-stp_10.42.42.5(pid=25944): ERR: Terminated: ERROR {rc=1} [trial-2382↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25944)] 20:50:13.250832 run osmo-stp_10.42.42.5(pid=25944): stdout: | (launched: 2022-12-12_20:50:11.647749) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:50:13.390320 run osmo-stp_10.42.42.5(pid=25944): stderr: | 20221212205011838 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205011838 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205011838 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205011839 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205011839 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205011839 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205011839 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:50:13.527611 run osmo-stp_10.42.42.5(pid=25944): stdout: | (launched: 2022-12-12_20:50:11.647749) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:50:13.659281 run osmo-stp_10.42.42.5(pid=25944): stderr: | 20221212205011838 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205011838 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205011838 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205011839 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205011839 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205011839 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205011839 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:50:13.815983 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=25944): Process ended prematurely: osmo-stp_10.42.42.5(pid=25944) [trial-2382↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25944)] [trial-2382↪emergency:oc2g↪emergency_mo_mt_call.py:19] 20:50:13.824867 tst emergency_mo_mt_call.py:19: Test FAILED (6.5 sec) 20:50:13.852808 run osmo-hlr_10.42.42.2(pid=25941): ERR: Terminated: ERROR {rc=237} [trial-2382↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25941)] 20:50:13.903925 run osmo-hlr_10.42.42.2(pid=25941): stdout: | (launched: 2022-12-12_20:50:10.627422) 20:50:13.957093 run osmo-hlr_10.42.42.2(pid=25941): stderr: | 20221212205010820 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212205010820 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212205010820 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212205010820 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212205010820 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212205010820 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212205010832 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/emergency:oc2g/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212205010842 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212205010842 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212205010842 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:50:14.031209 run osmo-msc_10.42.42.6(pid=25947): ERR: Terminated: ERROR {rc=2} [trial-2382↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25947)] 20:50:14.082522 run osmo-msc_10.42.42.6(pid=25947): stdout: | (launched: 2022-12-12_20:50:12.868864) 20:50:14.135647 run osmo-msc_10.42.42.6(pid=25947): stderr: | 20221212205013186 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212205013187 DLGLOBAL DEBUG validating counter group 0x7f1c0b5b3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212205013187 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212205013187 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212205013187 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212205013187 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212205013189 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212205013189 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212205013190 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212205013190 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:50:14.189078 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25940): Terminating (SIGTERM) 20:50:14.231387 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25943): Terminating (SIGTERM) 20:50:14.273885 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25946): Terminating (SIGTERM) 20:50:14.316769 --- ParallelTerminationStrategy: PID 25940 died... 20:50:14.336898 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25940): Terminated: ok {rc=0} 20:50:14.384130 --- ParallelTerminationStrategy: PID 25943 died... 20:50:14.404107 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25943): Terminated: ok {rc=0} 20:50:14.450982 --- ParallelTerminationStrategy: PID 25946 died... 20:50:14.470864 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25946): Terminated: ok {rc=0} 20:50:14.559945 bus /sierra_3: Setting Powered False 20:50:15.659807 bus /sierra_3: Setting Powered False 20:50:16.777649 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2382 emergency:oc2g emergency_preemptive_call.py ---------------------------------------------- 20:50:17.867752 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 20:50:17.879541 tst emergency:oc2g: Using 1 x bts (candidates: 1) 20:50:17.917799 tst emergency_preemptive_call.py: using LAC 31420 20:50:18.046354 tst emergency_preemptive_call.py: using RAC 55 20:50:18.176107 tst emergency_preemptive_call.py: using CellId 31420 20:50:18.304568 tst emergency_preemptive_call.py: using BVCI 31421 20:50:18.423499 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 20:50:18.434576 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 20:50:18.445558 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 20:50:18.456482 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 20:50:18.467383 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 20:50:18.478251 tst emergency:oc2g: Using 1 x modem (candidates: 4) 20:50:18.600652 tst emergency:oc2g: Using 1 x modem (candidates: 4) 20:50:18.717435 tst emergency:oc2g: Using 1 x modem (candidates: 4) 20:50:18.838485 tst emergency:oc2g: Using 1 x modem (candidates: 4) 20:50:18.955423 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:50:19.432301 run create_hlr_db(pid=25949): Launched 20:50:19.550505 bus /sierra_2: Setting Powered False 20:50:20.611850 run create_hlr_db(pid=25949): Terminated: ok {rc=0} 20:50:21.060904 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25951): Launched 20:50:21.390452 run osmo-hlr_10.42.42.2(pid=25952): Launched 20:50:21.515936 run osmo-stp_10.42.42.5: Starting osmo-stp 20:50:22.083866 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25954): Launched 20:50:22.412157 run osmo-stp_10.42.42.5(pid=25955): Launched 20:50:22.548245 tst emergency_preemptive_call.py: using MSISDN 7968 20:50:22.715668 run osmo-msc_10.42.42.6: Starting osmo-msc 20:50:23.303216 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25957): Launched 20:50:23.631096 run osmo-msc_10.42.42.6(pid=25958): Launched 20:50:23.814277 run osmo-stp_10.42.42.5(pid=25955): ERR: Terminated: ERROR {rc=1} [trial-2382↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25955)] 20:50:23.952302 run osmo-stp_10.42.42.5(pid=25955): stdout: | (launched: 2022-12-12_20:50:22.352447) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:50:24.091503 run osmo-stp_10.42.42.5(pid=25955): stderr: | 20221212205022542 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205022542 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205022542 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205022543 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205022543 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205022543 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205022543 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:50:24.229281 run osmo-stp_10.42.42.5(pid=25955): stdout: | (launched: 2022-12-12_20:50:22.352447) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:50:24.359526 run osmo-stp_10.42.42.5(pid=25955): stderr: | 20221212205022542 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205022542 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205022542 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205022543 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205022543 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205022543 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205022543 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:50:24.515556 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=25955): Process ended prematurely: osmo-stp_10.42.42.5(pid=25955) [trial-2382↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25955)] [trial-2382↪emergency:oc2g↪emergency_preemptive_call.py:32] 20:50:24.524235 tst emergency_preemptive_call.py:32: Test FAILED (6.6 sec) 20:50:24.552125 run osmo-hlr_10.42.42.2(pid=25952): ERR: Terminated: ERROR {rc=237} [trial-2382↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25952)] 20:50:24.603219 run osmo-hlr_10.42.42.2(pid=25952): stdout: | (launched: 2022-12-12_20:50:21.330625) 20:50:24.655901 run osmo-hlr_10.42.42.2(pid=25952): stderr: | 20221212205021525 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212205021525 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212205021525 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212205021525 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212205021525 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212205021525 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212205021538 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/emergency:oc2g/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212205021547 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212205021547 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212205021547 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:50:24.729518 run osmo-msc_10.42.42.6(pid=25958): ERR: Terminated: ERROR {rc=2} [trial-2382↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25958)] 20:50:24.780472 run osmo-msc_10.42.42.6(pid=25958): stdout: | (launched: 2022-12-12_20:50:23.571329) 20:50:24.832890 run osmo-msc_10.42.42.6(pid=25958): stderr: | 20221212205023892 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212205023892 DLGLOBAL DEBUG validating counter group 0x7f873812cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212205023892 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212205023892 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212205023893 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212205023893 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212205023895 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212205023895 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212205023895 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212205023895 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:50:24.885836 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25951): Terminating (SIGTERM) 20:50:24.927847 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25954): Terminating (SIGTERM) 20:50:24.970040 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25957): Terminating (SIGTERM) 20:50:25.012503 --- ParallelTerminationStrategy: PID 25951 died... 20:50:25.032874 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25951): Terminated: ok {rc=0} 20:50:25.079629 --- ParallelTerminationStrategy: PID 25954 died... 20:50:25.099774 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25954): Terminated: ok {rc=0} 20:50:25.146739 --- ParallelTerminationStrategy: PID 25957 died... 20:50:25.166764 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25957): Terminated: ok {rc=0} 20:50:25.255832 bus /sierra_9: Setting Powered False 20:50:26.354095 bus /sierra_9: Setting Powered False 20:50:27.471851 bus /sierra_8: Setting Powered False 20:50:28.574662 bus /sierra_8: Setting Powered False 20:50:29.691400 bus /sierra_3: Setting Powered False 20:50:30.790603 bus /sierra_3: Setting Powered False 20:50:31.923499 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 emergency:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 gprs:oc2g --------------------------------------------------------------------- 20:50:33.188193 tst gprs:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:50:33.192315 tst gprs:oc2g: Verifying 1 x bts (candidates: 11) 20:50:33.212486 tst gprs:oc2g: Verifying 9 x ip_address (candidates: 9) 20:50:33.251503 tst gprs:oc2g: Verifying 4 x modem (candidates: 12) 20:50:33.337199 tst gprs:oc2g: Reserving 1 x bts (candidates: 11) 20:50:33.358479 tst gprs:oc2g: Reserving 9 x ip_address (candidates: 9) 20:50:33.398336 tst gprs:oc2g: Reserving 4 x modem (candidates: 12) 20:50:33.988573 tst gprs:oc2g: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2382 gprs:oc2g cs_paging_gprs_active.py ---------------------------------------------- 20:50:34.043485 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:50:34.054610 tst gprs:oc2g: Using 1 x bts (candidates: 1) 20:50:34.089441 tst cs_paging_gprs_active.py: using LAC 31421 20:50:34.214120 tst cs_paging_gprs_active.py: using RAC 56 20:50:34.337059 tst cs_paging_gprs_active.py: using CellId 31421 20:50:34.460330 tst cs_paging_gprs_active.py: using BVCI 31422 20:50:34.573969 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:50:34.584540 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:50:34.594864 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:50:34.605498 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:50:34.615841 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:50:34.626356 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:50:34.636926 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:50:34.647465 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:50:34.658140 tst gprs:oc2g: Using 1 x modem (candidates: 4) 20:50:34.774375 tst gprs:oc2g: Using 1 x modem (candidates: 4) 20:50:34.893789 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 20:50:35.121150 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:50:35.458094 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25963): Launched 20:50:35.749392 run iperf3-srv_10.42.42.10(pid=25964): Launched 20:50:35.875653 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 20:50:36.104375 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:50:36.442246 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25965): Launched 20:50:36.733168 run iperf3-srv_10.42.42.10(pid=25966): Launched 20:50:36.859181 tst cs_paging_gprs_active.py:38: start network... 20:50:37.086647 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:50:37.607053 run create_hlr_db(pid=25967): Launched 20:50:37.744187 bus /sierra_2: Setting Powered False 20:50:38.810927 run create_hlr_db(pid=25967): Terminated: ok {rc=0} 20:50:39.254692 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25969): Launched 20:50:39.589401 run osmo-hlr_10.42.42.2(pid=25970): Launched 20:50:39.720100 run osmo-stp_10.42.42.5: Starting osmo-stp 20:50:40.298914 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25972): Launched 20:50:40.632431 run osmo-stp_10.42.42.5(pid=25973): Launched 20:50:40.761282 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:50:41.337908 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25975): Launched 20:50:41.466148 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:50:41.749552 run patchelf(pid=25976): Launched 20:50:41.936232 run osmo-stp_10.42.42.5(pid=25973): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25973)] 20:50:42.077369 run osmo-stp_10.42.42.5(pid=25973): stdout: | (launched: 2022-12-12_20:50:40.571648) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:50:42.221205 run osmo-stp_10.42.42.5(pid=25973): stderr: | 20221212205040760 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205040760 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205040761 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205040761 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205040762 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205040762 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205040762 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:50:42.364186 run osmo-stp_10.42.42.5(pid=25973): stdout: | (launched: 2022-12-12_20:50:40.571648) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:50:42.501658 run osmo-stp_10.42.42.5(pid=25973): stderr: | 20221212205040760 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205040760 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205040761 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205040761 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205040762 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205040762 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205040762 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:50:42.664784 run patchelf(pid=25976): Terminating (SIGINT) 20:50:42.854217 run patchelf(pid=25976): Terminated: ok {rc=0} 20:50:42.991064 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=25973): Process ended prematurely: osmo-stp_10.42.42.5(pid=25973) [trial-2382↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25973)] [trial-2382↪gprs:oc2g↪cs_paging_gprs_active.py:38] 20:50:43.001099 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 20:50:43.030207 run osmo-hlr_10.42.42.2(pid=25970): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:oc2g↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25970)] 20:50:43.081315 run osmo-hlr_10.42.42.2(pid=25970): stdout: | (launched: 2022-12-12_20:50:39.528356) 20:50:43.134564 run osmo-hlr_10.42.42.2(pid=25970): stderr: | 20221212205039722 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212205039722 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212205039722 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212205039722 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212205039722 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212205039722 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212205039735 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:oc2g/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212205039743 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212205039744 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212205039744 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:50:43.187810 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25963): Terminating (SIGTERM) 20:50:43.230034 run iperf3-srv_10.42.42.10(pid=25964): Terminating (SIGTERM) 20:50:43.272279 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25965): Terminating (SIGTERM) 20:50:43.314723 run iperf3-srv_10.42.42.10(pid=25966): Terminating (SIGTERM) 20:50:43.356917 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25969): Terminating (SIGTERM) 20:50:43.399357 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25972): Terminating (SIGTERM) 20:50:43.441612 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25975): Terminating (SIGTERM) 20:50:43.484096 --- ParallelTerminationStrategy: PID 25963 died... 20:50:43.504238 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25963): Terminated: ok {rc=0} 20:50:43.551109 --- ParallelTerminationStrategy: PID 25964 died... 20:50:43.570821 run iperf3-srv_10.42.42.10(pid=25964): Terminated {rc=256} 20:50:43.617110 --- ParallelTerminationStrategy: PID 25965 died... 20:50:43.636746 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25965): Terminated: ok {rc=0} 20:50:43.683197 --- ParallelTerminationStrategy: PID 25966 died... 20:50:43.702861 run iperf3-srv_10.42.42.10(pid=25966): Terminated {rc=256} 20:50:43.749213 --- ParallelTerminationStrategy: PID 25969 died... 20:50:43.768769 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25969): Terminated: ok {rc=0} 20:50:43.815571 --- ParallelTerminationStrategy: PID 25972 died... 20:50:43.835424 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25972): Terminated: ok {rc=0} 20:50:43.882044 --- ParallelTerminationStrategy: PID 25975 died... 20:50:43.901823 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25975): Terminated: ok {rc=0} 20:50:43.990067 bus /gobi_0: Setting Powered False 20:50:45.090489 bus /gobi_0: Setting Powered False 20:50:46.213308 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:oc2g iperf3.py ---------------------------------------------- 20:50:47.359148 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:50:47.370247 tst gprs:oc2g: Using 1 x bts (candidates: 1) 20:50:47.405651 tst iperf3.py: using LAC 31422 20:50:47.537338 tst iperf3.py: using RAC 57 20:50:47.667915 tst iperf3.py: using CellId 31422 20:50:47.799871 tst iperf3.py: using BVCI 31423 20:50:47.924363 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:50:47.935576 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:50:47.946646 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:50:47.957471 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:50:47.968137 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:50:47.978851 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:50:47.989732 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:50:48.001144 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:50:48.012041 tst gprs:oc2g: Using 1 x modem (candidates: 4) 20:50:48.132664 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 20:50:48.344316 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:50:48.657780 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25977): Launched 20:50:48.932140 run iperf3-srv_10.42.42.10(pid=25978): Launched 20:50:49.049627 tst iperf3.py:8: start network... 20:50:49.259152 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:50:49.743469 run create_hlr_db(pid=25979): Launched 20:50:49.864493 bus /gobi_6: Setting Powered False 20:50:50.927420 run create_hlr_db(pid=25979): Terminated: ok {rc=0} 20:50:51.383285 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25981): Launched 20:50:51.718843 run osmo-hlr_10.42.42.2(pid=25982): Launched 20:50:51.846791 run osmo-stp_10.42.42.5: Starting osmo-stp 20:50:52.422884 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25984): Launched 20:50:52.757579 run osmo-stp_10.42.42.5(pid=25985): Launched 20:50:52.885739 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:50:53.467627 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25987): Launched 20:50:53.595495 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:50:53.878720 run patchelf(pid=25988): Launched 20:50:54.064372 run osmo-stp_10.42.42.5(pid=25985): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25985)] 20:50:54.206045 run osmo-stp_10.42.42.5(pid=25985): stdout: | (launched: 2022-12-12_20:50:52.696567) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:50:54.348335 run osmo-stp_10.42.42.5(pid=25985): stderr: | 20221212205052886 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205052887 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205052887 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205052887 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205052888 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205052888 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205052888 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:50:54.491236 run osmo-stp_10.42.42.5(pid=25985): stdout: | (launched: 2022-12-12_20:50:52.696567) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:50:54.628172 run osmo-stp_10.42.42.5(pid=25985): stderr: | 20221212205052886 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205052887 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205052887 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205052887 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205052888 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205052888 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205052888 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:50:54.791164 run patchelf(pid=25988): Terminating (SIGINT) 20:50:54.979413 run patchelf(pid=25988): Terminated: ok {rc=0} 20:50:55.115209 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25985): Process ended prematurely: osmo-stp_10.42.42.5(pid=25985) [trial-2382↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25985)] [trial-2382↪gprs:oc2g↪iperf3.py:8] 20:50:55.125376 tst iperf3.py:8: Test FAILED (7.8 sec) 20:50:55.154429 run osmo-hlr_10.42.42.2(pid=25982): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:oc2g↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25982)] 20:50:55.205545 run osmo-hlr_10.42.42.2(pid=25982): stdout: | (launched: 2022-12-12_20:50:51.658087) 20:50:55.258308 run osmo-hlr_10.42.42.2(pid=25982): stderr: | 20221212205051853 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212205051853 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212205051853 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212205051853 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212205051853 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212205051853 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212205051865 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:oc2g/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212205051874 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212205051874 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212205051874 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:50:55.311503 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25977): Terminating (SIGTERM) 20:50:55.353712 run iperf3-srv_10.42.42.10(pid=25978): Terminating (SIGTERM) 20:50:55.396183 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25981): Terminating (SIGTERM) 20:50:55.438700 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25984): Terminating (SIGTERM) 20:50:55.480827 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25987): Terminating (SIGTERM) 20:50:55.523537 --- ParallelTerminationStrategy: PID 25977 died... 20:50:55.544007 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25977): Terminated: ok {rc=0} 20:50:55.591187 --- ParallelTerminationStrategy: PID 25978 died... 20:50:55.611010 run iperf3-srv_10.42.42.10(pid=25978): Terminated {rc=256} 20:50:55.657934 --- ParallelTerminationStrategy: PID 25981 died... 20:50:55.678062 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25981): Terminated: ok {rc=0} 20:50:55.724684 --- ParallelTerminationStrategy: PID 25984 died... 20:50:55.744678 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25984): Terminated: ok {rc=0} 20:50:55.791362 --- ParallelTerminationStrategy: PID 25987 died... 20:50:55.811442 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25987): Terminated: ok {rc=0} 20:50:55.899961 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:oc2g iperf3m4.py ---------------------------------------------- 20:50:57.055295 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:50:57.067126 tst gprs:oc2g: Using 1 x bts (candidates: 1) 20:50:57.104845 tst iperf3m4.py: using LAC 31423 20:50:57.237848 tst iperf3m4.py: using RAC 58 20:50:57.371293 tst iperf3m4.py: using CellId 31423 20:50:57.505351 tst iperf3m4.py: using BVCI 31424 20:50:57.628400 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:50:57.639618 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:50:57.650737 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:50:57.662459 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:50:57.674491 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:50:57.686027 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:50:57.697832 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:50:57.709421 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:50:57.721086 tst gprs:oc2g: Using 1 x modem (candidates: 4) 20:50:57.843641 tst gprs:oc2g: Using 1 x modem (candidates: 4) 20:50:57.965973 tst gprs:oc2g: Using 1 x modem (candidates: 4) 20:50:58.084842 tst gprs:oc2g: Using 1 x modem (candidates: 4) 20:50:58.201621 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 20:50:58.411074 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:50:58.725693 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25989): Launched 20:50:58.996656 run iperf3-srv_10.42.42.10(pid=25990): Launched 20:50:59.114407 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 20:50:59.324468 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:50:59.637258 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25991): Launched 20:50:59.908019 run iperf3-srv_10.42.42.10(pid=25992): Launched 20:51:00.025689 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 20:51:00.234793 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:51:00.547715 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25993): Launched 20:51:00.819313 run iperf3-srv_10.42.42.10(pid=25994): Launched 20:51:00.976666 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 20:51:01.209590 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:51:01.561531 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25995): Launched 20:51:01.871968 run iperf3-srv_10.42.42.10(pid=25996): Launched 20:51:02.014414 tst iperf3m4.py:8: start network... 20:51:02.244936 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:51:02.766463 run create_hlr_db(pid=25997): Launched 20:51:02.901746 bus /gobi_6: Setting Powered False 20:51:03.968937 run create_hlr_db(pid=25997): Terminated: ok {rc=0} 20:51:04.434536 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25999): Launched 20:51:04.770237 run osmo-hlr_10.42.42.2(pid=26000): Launched 20:51:04.901282 run osmo-stp_10.42.42.5: Starting osmo-stp 20:51:05.475518 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26002): Launched 20:51:05.812291 run osmo-stp_10.42.42.5(pid=26003): Launched 20:51:05.939771 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:51:06.518532 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26005): Launched 20:51:06.646349 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:51:06.929975 run patchelf(pid=26006): Launched 20:51:07.115601 run osmo-stp_10.42.42.5(pid=26003): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26003)] 20:51:07.256481 run osmo-stp_10.42.42.5(pid=26003): stdout: | (launched: 2022-12-12_20:51:05.751413) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:51:07.399214 run osmo-stp_10.42.42.5(pid=26003): stderr: | 20221212205105942 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205105943 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205105943 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205105943 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205105944 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205105944 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205105944 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:51:07.541980 run osmo-stp_10.42.42.5(pid=26003): stdout: | (launched: 2022-12-12_20:51:05.751413) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:51:07.679181 run osmo-stp_10.42.42.5(pid=26003): stderr: | 20221212205105942 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205105943 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205105943 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205105943 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205105944 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205105944 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205105944 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:51:07.841701 run patchelf(pid=26006): Terminating (SIGINT) 20:51:08.030243 run patchelf(pid=26006): Terminated: ok {rc=0} 20:51:08.166414 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26003): Process ended prematurely: osmo-stp_10.42.42.5(pid=26003) [trial-2382↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26003)] [trial-2382↪gprs:oc2g↪iperf3m4.py:8] 20:51:08.176481 tst iperf3m4.py:8: Test FAILED (11.2 sec) 20:51:08.205721 run osmo-hlr_10.42.42.2(pid=26000): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:oc2g↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26000)] 20:51:08.256922 run osmo-hlr_10.42.42.2(pid=26000): stdout: | (launched: 2022-12-12_20:51:04.709334) 20:51:08.309837 run osmo-hlr_10.42.42.2(pid=26000): stderr: | 20221212205104905 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212205104905 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212205104905 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212205104905 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212205104905 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212205104905 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212205104916 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:oc2g/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212205104925 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212205104925 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212205104925 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:51:08.363275 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25989): Terminating (SIGTERM) 20:51:08.406085 run iperf3-srv_10.42.42.10(pid=25990): Terminating (SIGTERM) 20:51:08.449087 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25991): Terminating (SIGTERM) 20:51:08.491886 run iperf3-srv_10.42.42.10(pid=25992): Terminating (SIGTERM) 20:51:08.534590 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25993): Terminating (SIGTERM) 20:51:08.577444 run iperf3-srv_10.42.42.10(pid=25994): Terminating (SIGTERM) 20:51:08.620011 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25995): Terminating (SIGTERM) 20:51:08.663336 run iperf3-srv_10.42.42.10(pid=25996): Terminating (SIGTERM) 20:51:08.706134 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25999): Terminating (SIGTERM) 20:51:08.749020 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26002): Terminating (SIGTERM) 20:51:08.791894 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26005): Terminating (SIGTERM) 20:51:08.834960 --- ParallelTerminationStrategy: PID 25989 died... 20:51:08.855661 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25989): Terminated: ok {rc=0} 20:51:08.903458 --- ParallelTerminationStrategy: PID 25990 died... 20:51:08.923511 run iperf3-srv_10.42.42.10(pid=25990): Terminated {rc=256} 20:51:08.970504 --- ParallelTerminationStrategy: PID 25991 died... 20:51:08.990524 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25991): Terminated: ok {rc=0} 20:51:09.037580 --- ParallelTerminationStrategy: PID 25992 died... 20:51:09.057507 run iperf3-srv_10.42.42.10(pid=25992): Terminated {rc=256} 20:51:09.104313 --- ParallelTerminationStrategy: PID 25993 died... 20:51:09.124754 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25993): Terminated: ok {rc=0} 20:51:09.171876 --- ParallelTerminationStrategy: PID 25994 died... 20:51:09.191847 run iperf3-srv_10.42.42.10(pid=25994): Terminated {rc=256} 20:51:09.239071 --- ParallelTerminationStrategy: PID 25995 died... 20:51:09.259096 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25995): Terminated: ok {rc=0} 20:51:09.306109 --- ParallelTerminationStrategy: PID 25996 died... 20:51:09.326106 run iperf3-srv_10.42.42.10(pid=25996): Terminated {rc=256} 20:51:09.373117 --- ParallelTerminationStrategy: PID 25999 died... 20:51:09.393213 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25999): Terminated: ok {rc=0} 20:51:09.440102 --- ParallelTerminationStrategy: PID 26002 died... 20:51:09.460098 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26002): Terminated: ok {rc=0} 20:51:09.506986 --- ParallelTerminationStrategy: PID 26005 died... 20:51:09.527106 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26005): Terminated: ok {rc=0} 20:51:09.615955 bus /gobi_4: Setting Powered False 20:51:10.715687 bus /gobi_4: Setting Powered False 20:51:11.832497 bus /gobi_1: Setting Powered False 20:51:12.931635 bus /gobi_1: Setting Powered False 20:51:14.048638 bus /gobi_0: Setting Powered False 20:51:15.147979 bus /gobi_0: Setting Powered False 20:51:16.264597 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:oc2g ping.py ---------------------------------------------- 20:51:17.371081 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:51:17.382563 tst gprs:oc2g: Using 1 x bts (candidates: 1) 20:51:17.419342 tst ping.py: using LAC 31424 20:51:17.551347 tst ping.py: using RAC 59 20:51:17.682755 tst ping.py: using CellId 31424 20:51:17.811962 tst ping.py: using BVCI 31425 20:51:17.932848 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:51:17.943831 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:51:17.954714 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:51:17.966076 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:51:17.977307 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:51:17.988580 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:51:18.000016 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:51:18.011244 tst gprs:oc2g: Using 1 x modem (candidates: 4) 20:51:18.132813 tst ping.py:19: start network... 20:51:18.354445 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:51:18.862987 run create_hlr_db(pid=26007): Launched 20:51:18.995915 bus /gobi_6: Setting Powered False 20:51:20.060329 run create_hlr_db(pid=26007): Terminated: ok {rc=0} 20:51:20.499168 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26009): Launched 20:51:20.807522 run osmo-hlr_10.42.42.2(pid=26010): Launched 20:51:20.925354 run osmo-stp_10.42.42.5: Starting osmo-stp 20:51:21.468528 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26012): Launched 20:51:21.776314 run osmo-stp_10.42.42.5(pid=26013): Launched 20:51:21.931303 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:51:22.474450 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26015): Launched 20:51:22.591727 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:51:22.851149 run patchelf(pid=26016): Launched 20:51:23.022352 run osmo-stp_10.42.42.5(pid=26013): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26013)] 20:51:23.152601 run osmo-stp_10.42.42.5(pid=26013): stdout: | (launched: 2022-12-12_20:51:21.719955) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:51:23.284359 run osmo-stp_10.42.42.5(pid=26013): stderr: | 20221212205121890 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205121890 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205121890 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205121891 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205121891 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205121891 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205121892 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:51:23.416093 run osmo-stp_10.42.42.5(pid=26013): stdout: | (launched: 2022-12-12_20:51:21.719955) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:51:23.542173 run osmo-stp_10.42.42.5(pid=26013): stderr: | 20221212205121890 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205121890 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205121890 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205121891 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205121891 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205121891 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205121892 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:51:23.691262 run patchelf(pid=26016): Terminating (SIGINT) 20:51:23.864213 run patchelf(pid=26016): Terminated: ok {rc=0} 20:51:23.988867 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=26013): Process ended prematurely: osmo-stp_10.42.42.5(pid=26013) [trial-2382↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26013)] [trial-2382↪gprs:oc2g↪ping.py:22] 20:51:23.997792 tst ping.py:22: Test FAILED (6.6 sec) 20:51:24.025739 run osmo-hlr_10.42.42.2(pid=26010): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:oc2g↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26010)] 20:51:24.074682 run osmo-hlr_10.42.42.2(pid=26010): stdout: | (launched: 2022-12-12_20:51:20.751312) 20:51:24.125861 run osmo-hlr_10.42.42.2(pid=26010): stderr: | 20221212205120924 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212205120924 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212205120924 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212205120924 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212205120924 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212205120924 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212205120937 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:oc2g/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212205120945 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212205120945 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212205120945 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:51:24.177328 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26009): Terminating (SIGTERM) 20:51:24.218057 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26012): Terminating (SIGTERM) 20:51:24.258689 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26015): Terminating (SIGTERM) 20:51:24.299610 --- ParallelTerminationStrategy: PID 26009 died... 20:51:24.319245 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26009): Terminated: ok {rc=0} 20:51:24.364808 --- ParallelTerminationStrategy: PID 26012 died... 20:51:24.384425 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26012): Terminated: ok {rc=0} 20:51:24.429883 --- ParallelTerminationStrategy: PID 26015 died... 20:51:24.449263 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26015): Terminated: ok {rc=0} 20:51:24.537057 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:oc2g ping_idle_ping.py ---------------------------------------------- 20:51:25.628481 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:51:25.640311 tst gprs:oc2g: Using 1 x bts (candidates: 1) 20:51:25.677645 tst ping_idle_ping.py: using LAC 31425 20:51:25.807540 tst ping_idle_ping.py: using RAC 60 20:51:25.938582 tst ping_idle_ping.py: using CellId 31425 20:51:26.070815 tst ping_idle_ping.py: using BVCI 31426 20:51:26.193878 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:51:26.204923 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:51:26.215853 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:51:26.226814 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:51:26.237655 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:51:26.248482 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:51:26.259447 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:51:26.270331 tst gprs:oc2g: Using 1 x modem (candidates: 4) 20:51:26.387759 tst ping_idle_ping.py:24: start network... 20:51:26.595239 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:51:27.074940 run create_hlr_db(pid=26017): Launched 20:51:27.194882 bus /gobi_6: Setting Powered False 20:51:28.256377 run create_hlr_db(pid=26017): Terminated: ok {rc=0} 20:51:28.707008 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26019): Launched 20:51:29.038938 run osmo-hlr_10.42.42.2(pid=26020): Launched 20:51:29.165470 run osmo-stp_10.42.42.5: Starting osmo-stp 20:51:29.734356 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26022): Launched 20:51:30.066471 run osmo-stp_10.42.42.5(pid=26023): Launched 20:51:30.194756 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:51:30.765651 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26025): Launched 20:51:30.898310 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:51:31.205739 run patchelf(pid=26026): Launched 20:51:31.394033 run osmo-stp_10.42.42.5(pid=26023): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26023)] 20:51:31.536842 run osmo-stp_10.42.42.5(pid=26023): stdout: | (launched: 2022-12-12_20:51:30.006390) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:51:31.681574 run osmo-stp_10.42.42.5(pid=26023): stderr: | 20221212205130195 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205130195 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205130196 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205130196 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205130196 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205130197 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205130197 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:51:31.825763 run osmo-stp_10.42.42.5(pid=26023): stdout: | (launched: 2022-12-12_20:51:30.006390) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:51:31.963922 run osmo-stp_10.42.42.5(pid=26023): stderr: | 20221212205130195 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205130195 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205130196 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205130196 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205130196 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205130197 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205130197 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:51:32.128928 run patchelf(pid=26026): Terminating (SIGINT) 20:51:32.316363 run patchelf(pid=26026): Terminated: ok {rc=0} 20:51:32.450110 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=26023): Process ended prematurely: osmo-stp_10.42.42.5(pid=26023) [trial-2382↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26023)] [trial-2382↪gprs:oc2g↪ping_idle_ping.py:27] 20:51:32.459806 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 20:51:32.488300 run osmo-hlr_10.42.42.2(pid=26020): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:oc2g↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26020)] 20:51:32.539067 run osmo-hlr_10.42.42.2(pid=26020): stdout: | (launched: 2022-12-12_20:51:28.978811) 20:51:32.591647 run osmo-hlr_10.42.42.2(pid=26020): stderr: | 20221212205129174 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212205129174 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212205129174 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212205129174 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212205129174 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212205129174 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212205129186 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:oc2g/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212205129195 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212205129196 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212205129196 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:51:32.644796 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26019): Terminating (SIGTERM) 20:51:32.687325 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26022): Terminating (SIGTERM) 20:51:32.729940 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26025): Terminating (SIGTERM) 20:51:32.772566 --- ParallelTerminationStrategy: PID 26019 died... 20:51:32.793116 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26019): Terminated: ok {rc=0} 20:51:32.840078 --- ParallelTerminationStrategy: PID 26022 died... 20:51:32.859982 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26022): Terminated: ok {rc=0} 20:51:32.907260 --- ParallelTerminationStrategy: PID 26025 died... 20:51:32.927235 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26025): Terminated: ok {rc=0} 20:51:33.015959 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2382 gprs:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 gprs:oc2g+mod-bts0-egprs --------------------------------------------------------------------- 20:51:34.319186 tst gprs:oc2g+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:51:34.326349 tst gprs:oc2g+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 20:51:34.348111 tst gprs:oc2g+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 20:51:34.387172 tst gprs:oc2g+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 20:51:34.474089 tst gprs:oc2g+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 20:51:34.494328 tst gprs:oc2g+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 20:51:34.532513 tst gprs:oc2g+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 20:51:35.123413 tst gprs:oc2g+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2382 gprs:oc2g+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 20:51:35.173371 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:51:35.183897 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 20:51:35.218561 tst cs_paging_gprs_active.py: using LAC 31426 20:51:35.337341 tst cs_paging_gprs_active.py: using RAC 61 20:51:35.458168 tst cs_paging_gprs_active.py: using CellId 31426 20:51:35.578510 tst cs_paging_gprs_active.py: using BVCI 31427 20:51:35.691458 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:51:35.702171 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:51:35.712821 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:51:35.723776 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:51:35.734670 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:51:35.745530 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:51:35.756472 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:51:35.766981 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:51:35.778179 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:51:35.895266 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:51:36.010562 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 20:51:36.217609 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:51:36.525518 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26031): Launched 20:51:36.793468 run iperf3-srv_10.42.42.10(pid=26032): Launched 20:51:36.909319 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 20:51:37.116446 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:51:37.425464 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26033): Launched 20:51:37.693917 run iperf3-srv_10.42.42.10(pid=26034): Launched 20:51:37.809532 tst cs_paging_gprs_active.py:38: start network... 20:51:38.015323 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:51:38.493115 run create_hlr_db(pid=26035): Launched 20:51:38.611336 bus /gobi_6: Setting Powered False 20:51:39.672371 run create_hlr_db(pid=26035): Terminated: ok {rc=0} 20:51:40.120918 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26037): Launched 20:51:40.450480 run osmo-hlr_10.42.42.2(pid=26038): Launched 20:51:40.577964 run osmo-stp_10.42.42.5: Starting osmo-stp 20:51:41.150785 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26040): Launched 20:51:41.481965 run osmo-stp_10.42.42.5(pid=26041): Launched 20:51:41.610228 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:51:42.151672 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26043): Launched 20:51:42.269684 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:51:42.531105 run patchelf(pid=26044): Launched 20:51:42.702472 run osmo-stp_10.42.42.5(pid=26041): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26041)] 20:51:42.833160 run osmo-stp_10.42.42.5(pid=26041): stdout: | (launched: 2022-12-12_20:51:41.421224) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:51:42.965277 run osmo-stp_10.42.42.5(pid=26041): stderr: | 20221212205141609 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205141609 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205141610 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205141610 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205141611 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205141611 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205141611 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:51:43.097405 run osmo-stp_10.42.42.5(pid=26041): stdout: | (launched: 2022-12-12_20:51:41.421224) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:51:43.224191 run osmo-stp_10.42.42.5(pid=26041): stderr: | 20221212205141609 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205141609 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205141610 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205141610 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205141611 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205141611 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205141611 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:51:43.374124 run patchelf(pid=26044): Terminating (SIGINT) 20:51:43.547199 run patchelf(pid=26044): Terminated: ok {rc=0} 20:51:43.672182 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=26041): Process ended prematurely: osmo-stp_10.42.42.5(pid=26041) [trial-2382↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26041)] [trial-2382↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 20:51:43.681772 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 20:51:43.709557 run osmo-hlr_10.42.42.2(pid=26038): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26038)] 20:51:43.758761 run osmo-hlr_10.42.42.2(pid=26038): stdout: | (launched: 2022-12-12_20:51:40.391158) 20:51:43.809490 run osmo-hlr_10.42.42.2(pid=26038): stderr: | 20221212205140586 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212205140586 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212205140586 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212205140586 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212205140586 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212205140586 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212205140598 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:oc2g+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212205140607 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212205140608 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212205140608 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:51:43.860943 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26031): Terminating (SIGTERM) 20:51:43.902192 run iperf3-srv_10.42.42.10(pid=26032): Terminating (SIGTERM) 20:51:43.942967 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26033): Terminating (SIGTERM) 20:51:43.983771 run iperf3-srv_10.42.42.10(pid=26034): Terminating (SIGTERM) 20:51:44.024105 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26037): Terminating (SIGTERM) 20:51:44.065354 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26040): Terminating (SIGTERM) 20:51:44.106080 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26043): Terminating (SIGTERM) 20:51:44.147139 --- ParallelTerminationStrategy: PID 26031 died... 20:51:44.166503 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26031): Terminated: ok {rc=0} 20:51:44.212411 --- ParallelTerminationStrategy: PID 26032 died... 20:51:44.231204 run iperf3-srv_10.42.42.10(pid=26032): Terminated {rc=256} 20:51:44.276348 --- ParallelTerminationStrategy: PID 26033 died... 20:51:44.295771 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26033): Terminated: ok {rc=0} 20:51:44.341231 --- ParallelTerminationStrategy: PID 26034 died... 20:51:44.360464 run iperf3-srv_10.42.42.10(pid=26034): Terminated {rc=256} 20:51:44.405641 --- ParallelTerminationStrategy: PID 26037 died... 20:51:44.424448 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26037): Terminated: ok {rc=0} 20:51:44.469269 --- ParallelTerminationStrategy: PID 26040 died... 20:51:44.488127 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26040): Terminated: ok {rc=0} 20:51:44.533035 --- ParallelTerminationStrategy: PID 26043 died... 20:51:44.552086 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26043): Terminated: ok {rc=0} 20:51:44.640349 bus /gobi_0: Setting Powered False 20:51:45.740466 bus /gobi_0: Setting Powered False 20:51:46.857335 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:oc2g+mod-bts0-egprs iperf3.py ---------------------------------------------- 20:51:48.009431 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:51:48.021237 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 20:51:48.063229 tst iperf3.py: using LAC 31427 20:51:48.183949 tst iperf3.py: using RAC 62 20:51:48.302929 tst iperf3.py: using CellId 31427 20:51:48.422719 tst iperf3.py: using BVCI 31428 20:51:48.536601 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:51:48.547323 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:51:48.557953 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:51:48.569359 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:51:48.580637 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:51:48.591928 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:51:48.603308 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:51:48.614742 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:51:48.626218 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:51:48.745074 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 20:51:48.951869 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:51:49.259679 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26045): Launched 20:51:49.526163 run iperf3-srv_10.42.42.10(pid=26046): Launched 20:51:49.650007 tst iperf3.py:8: start network... 20:51:49.871216 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:51:50.380915 run create_hlr_db(pid=26047): Launched 20:51:50.515403 bus /gobi_6: Setting Powered False 20:51:51.577888 run create_hlr_db(pid=26047): Terminated: ok {rc=0} 20:51:52.030768 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26049): Launched 20:51:52.361800 run osmo-hlr_10.42.42.2(pid=26050): Launched 20:51:52.487039 run osmo-stp_10.42.42.5: Starting osmo-stp 20:51:53.052037 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26052): Launched 20:51:53.381919 run osmo-stp_10.42.42.5(pid=26053): Launched 20:51:53.506849 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:51:54.072496 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26055): Launched 20:51:54.198583 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:51:54.476504 run patchelf(pid=26056): Launched 20:51:54.658740 run osmo-stp_10.42.42.5(pid=26053): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26053)] 20:51:54.797941 run osmo-stp_10.42.42.5(pid=26053): stdout: | (launched: 2022-12-12_20:51:53.321928) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:51:54.938362 run osmo-stp_10.42.42.5(pid=26053): stderr: | 20221212205153511 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205153511 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205153512 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205153512 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205153513 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205153513 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205153513 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:51:55.079528 run osmo-stp_10.42.42.5(pid=26053): stdout: | (launched: 2022-12-12_20:51:53.321928) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:51:55.215159 run osmo-stp_10.42.42.5(pid=26053): stderr: | 20221212205153511 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205153511 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205153512 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205153512 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205153513 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205153513 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205153513 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:51:55.375401 run patchelf(pid=26056): Terminating (SIGINT) 20:51:55.559341 run patchelf(pid=26056): Terminated: ok {rc=0} 20:51:55.692118 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26053): Process ended prematurely: osmo-stp_10.42.42.5(pid=26053) [trial-2382↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26053)] [trial-2382↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8] 20:51:55.702443 tst iperf3.py:8: Test FAILED (7.7 sec) 20:51:55.731028 run osmo-hlr_10.42.42.2(pid=26050): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:oc2g+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26050)] 20:51:55.782339 run osmo-hlr_10.42.42.2(pid=26050): stdout: | (launched: 2022-12-12_20:51:52.301385) 20:51:55.835257 run osmo-hlr_10.42.42.2(pid=26050): stderr: | 20221212205152497 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212205152497 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212205152497 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212205152497 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212205152497 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212205152497 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212205152510 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:oc2g+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212205152519 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212205152519 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212205152519 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:51:55.888524 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26045): Terminating (SIGTERM) 20:51:55.931098 run iperf3-srv_10.42.42.10(pid=26046): Terminating (SIGTERM) 20:51:55.973801 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26049): Terminating (SIGTERM) 20:51:56.016588 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26052): Terminating (SIGTERM) 20:51:56.059355 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26055): Terminating (SIGTERM) 20:51:56.102591 --- ParallelTerminationStrategy: PID 26045 died... 20:51:56.123045 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26045): Terminated: ok {rc=0} 20:51:56.170729 --- ParallelTerminationStrategy: PID 26046 died... 20:51:56.190741 run iperf3-srv_10.42.42.10(pid=26046): Terminated {rc=256} 20:51:56.237733 --- ParallelTerminationStrategy: PID 26049 died... 20:51:56.257813 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26049): Terminated: ok {rc=0} 20:51:56.305429 --- ParallelTerminationStrategy: PID 26052 died... 20:51:56.325617 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26052): Terminated: ok {rc=0} 20:51:56.373086 --- ParallelTerminationStrategy: PID 26055 died... 20:51:56.393271 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26055): Terminated: ok {rc=0} 20:51:56.482984 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:oc2g+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 20:51:57.636836 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:51:57.648812 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 20:51:57.689785 tst iperf3m4.py: using LAC 31428 20:51:57.818693 tst iperf3m4.py: using RAC 63 20:51:57.945883 tst iperf3m4.py: using CellId 31428 20:51:58.073037 tst iperf3m4.py: using BVCI 31429 20:51:58.193969 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:51:58.205544 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:51:58.216752 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:51:58.227858 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:51:58.238831 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:51:58.249845 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:51:58.261085 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:51:58.272044 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:51:58.283171 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:51:58.406826 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:51:58.524298 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:51:58.644334 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:51:58.759447 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 20:51:58.967342 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:51:59.276267 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26057): Launched 20:51:59.542804 run iperf3-srv_10.42.42.10(pid=26058): Launched 20:51:59.658304 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 20:51:59.863398 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:52:00.170402 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26059): Launched 20:52:00.438356 run iperf3-srv_10.42.42.10(pid=26060): Launched 20:52:00.554850 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 20:52:00.759631 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:52:01.098209 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26061): Launched 20:52:01.386791 run iperf3-srv_10.42.42.10(pid=26062): Launched 20:52:01.519189 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 20:52:01.729535 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:52:02.045760 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26063): Launched 20:52:02.336832 run iperf3-srv_10.42.42.10(pid=26064): Launched 20:52:02.460053 tst iperf3m4.py:8: start network... 20:52:02.681306 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:52:03.191152 run create_hlr_db(pid=26065): Launched 20:52:03.309209 bus /gobi_6: Setting Powered False 20:52:04.370888 run create_hlr_db(pid=26065): Terminated: ok {rc=0} 20:52:04.818655 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26067): Launched 20:52:05.147715 run osmo-hlr_10.42.42.2(pid=26068): Launched 20:52:05.274042 run osmo-stp_10.42.42.5: Starting osmo-stp 20:52:05.839629 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26070): Launched 20:52:06.167875 run osmo-stp_10.42.42.5(pid=26071): Launched 20:52:06.293023 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:52:06.860290 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26073): Launched 20:52:06.987540 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:52:07.266728 run patchelf(pid=26074): Launched 20:52:07.451063 run osmo-stp_10.42.42.5(pid=26071): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26071)] 20:52:07.590154 run osmo-stp_10.42.42.5(pid=26071): stdout: | (launched: 2022-12-12_20:52:06.107746) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:52:07.730609 run osmo-stp_10.42.42.5(pid=26071): stderr: | 20221212205206298 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205206298 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205206298 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205206298 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205206299 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205206299 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205206299 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:52:07.871083 run osmo-stp_10.42.42.5(pid=26071): stdout: | (launched: 2022-12-12_20:52:06.107746) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:52:08.006145 run osmo-stp_10.42.42.5(pid=26071): stderr: | 20221212205206298 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205206298 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205206298 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205206298 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205206299 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205206299 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205206299 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:52:08.166630 run patchelf(pid=26074): Terminating (SIGINT) 20:52:08.351159 run patchelf(pid=26074): Terminated: ok {rc=0} 20:52:08.484812 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26071): Process ended prematurely: osmo-stp_10.42.42.5(pid=26071) [trial-2382↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26071)] [trial-2382↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8] 20:52:08.495160 tst iperf3m4.py:8: Test FAILED (10.9 sec) 20:52:08.524037 run osmo-hlr_10.42.42.2(pid=26068): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26068)] 20:52:08.574675 run osmo-hlr_10.42.42.2(pid=26068): stdout: | (launched: 2022-12-12_20:52:05.087600) 20:52:08.627395 run osmo-hlr_10.42.42.2(pid=26068): stderr: | 20221212205205283 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212205205283 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212205205283 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212205205283 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212205205283 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212205205283 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212205205298 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:oc2g+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212205205307 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212205205307 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212205205307 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:52:08.680439 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26057): Terminating (SIGTERM) 20:52:08.722950 run iperf3-srv_10.42.42.10(pid=26058): Terminating (SIGTERM) 20:52:08.765566 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26059): Terminating (SIGTERM) 20:52:08.808108 run iperf3-srv_10.42.42.10(pid=26060): Terminating (SIGTERM) 20:52:08.850597 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26061): Terminating (SIGTERM) 20:52:08.893111 run iperf3-srv_10.42.42.10(pid=26062): Terminating (SIGTERM) 20:52:08.935634 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26063): Terminating (SIGTERM) 20:52:08.977986 run iperf3-srv_10.42.42.10(pid=26064): Terminating (SIGTERM) 20:52:09.020527 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26067): Terminating (SIGTERM) 20:52:09.063173 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26070): Terminating (SIGTERM) 20:52:09.105844 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26073): Terminating (SIGTERM) 20:52:09.148675 --- ParallelTerminationStrategy: PID 26057 died... 20:52:09.169041 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26057): Terminated: ok {rc=0} 20:52:09.216446 --- ParallelTerminationStrategy: PID 26058 died... 20:52:09.236386 run iperf3-srv_10.42.42.10(pid=26058): Terminated {rc=256} 20:52:09.283138 --- ParallelTerminationStrategy: PID 26059 died... 20:52:09.303095 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26059): Terminated: ok {rc=0} 20:52:09.349927 --- ParallelTerminationStrategy: PID 26060 died... 20:52:09.369816 run iperf3-srv_10.42.42.10(pid=26060): Terminated {rc=256} 20:52:09.416476 --- ParallelTerminationStrategy: PID 26061 died... 20:52:09.436404 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26061): Terminated: ok {rc=0} 20:52:09.483336 --- ParallelTerminationStrategy: PID 26062 died... 20:52:09.503337 run iperf3-srv_10.42.42.10(pid=26062): Terminated {rc=256} 20:52:09.550014 --- ParallelTerminationStrategy: PID 26063 died... 20:52:09.569899 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26063): Terminated: ok {rc=0} 20:52:09.616826 --- ParallelTerminationStrategy: PID 26064 died... 20:52:09.636744 run iperf3-srv_10.42.42.10(pid=26064): Terminated {rc=256} 20:52:09.683598 --- ParallelTerminationStrategy: PID 26067 died... 20:52:09.703586 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26067): Terminated: ok {rc=0} 20:52:09.750460 --- ParallelTerminationStrategy: PID 26070 died... 20:52:09.770508 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26070): Terminated: ok {rc=0} 20:52:09.817378 --- ParallelTerminationStrategy: PID 26073 died... 20:52:09.837382 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26073): Terminated: ok {rc=0} 20:52:09.926702 bus /gobi_4: Setting Powered False 20:52:11.028542 bus /gobi_4: Setting Powered False 20:52:12.146412 bus /gobi_1: Setting Powered False 20:52:13.242755 bus /gobi_1: Setting Powered False 20:52:14.359762 bus /gobi_0: Setting Powered False 20:52:15.458248 bus /gobi_0: Setting Powered False 20:52:16.583918 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:oc2g+mod-bts0-egprs ping.py ---------------------------------------------- 20:52:17.686703 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:52:17.697961 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 20:52:17.739055 tst ping.py: using LAC 31429 20:52:17.856219 tst ping.py: using RAC 64 20:52:17.973040 tst ping.py: using CellId 31429 20:52:18.089310 tst ping.py: using BVCI 31430 20:52:18.199085 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:52:18.209897 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:52:18.220447 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:52:18.231392 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:52:18.242184 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:52:18.253543 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:52:18.264595 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:52:18.275590 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:52:18.390913 tst ping.py:19: start network... 20:52:18.592200 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:52:19.057333 run create_hlr_db(pid=26075): Launched 20:52:19.172836 bus /gobi_6: Setting Powered False 20:52:20.233538 run create_hlr_db(pid=26075): Terminated: ok {rc=0} 20:52:20.675666 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26077): Launched 20:52:21.001971 run osmo-hlr_10.42.42.2(pid=26078): Launched 20:52:21.126484 run osmo-stp_10.42.42.5: Starting osmo-stp 20:52:21.686195 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26080): Launched 20:52:22.010292 run osmo-stp_10.42.42.5(pid=26081): Launched 20:52:22.133463 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:52:22.693559 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26083): Launched 20:52:22.817783 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:52:23.092317 run patchelf(pid=26084): Launched 20:52:23.275271 run osmo-stp_10.42.42.5(pid=26081): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26081)] 20:52:23.412445 run osmo-stp_10.42.42.5(pid=26081): stdout: | (launched: 2022-12-12_20:52:21.950968) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:52:23.551582 run osmo-stp_10.42.42.5(pid=26081): stderr: | 20221212205222139 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205222139 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205222139 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205222140 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205222140 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205222140 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205222140 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:52:23.691161 run osmo-stp_10.42.42.5(pid=26081): stdout: | (launched: 2022-12-12_20:52:21.950968) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:52:23.824299 run osmo-stp_10.42.42.5(pid=26081): stderr: | 20221212205222139 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205222139 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205222139 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205222140 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205222140 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205222140 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205222140 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:52:23.981855 run patchelf(pid=26084): Terminating (SIGINT) 20:52:24.164236 run patchelf(pid=26084): Terminated: ok {rc=0} 20:52:24.295886 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=26081): Process ended prematurely: osmo-stp_10.42.42.5(pid=26081) [trial-2382↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26081)] [trial-2382↪gprs:oc2g+mod-bts0-egprs↪ping.py:22] 20:52:24.305530 tst ping.py:22: Test FAILED (6.6 sec) 20:52:24.334104 run osmo-hlr_10.42.42.2(pid=26078): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:oc2g+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26078)] 20:52:24.385441 run osmo-hlr_10.42.42.2(pid=26078): stdout: | (launched: 2022-12-12_20:52:20.943332) 20:52:24.438745 run osmo-hlr_10.42.42.2(pid=26078): stderr: | 20221212205221137 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212205221137 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212205221137 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212205221137 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212205221137 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212205221137 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212205221151 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:oc2g+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212205221162 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212205221162 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212205221162 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:52:24.492381 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26077): Terminating (SIGTERM) 20:52:24.535464 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26080): Terminating (SIGTERM) 20:52:24.578595 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26083): Terminating (SIGTERM) 20:52:24.622268 --- ParallelTerminationStrategy: PID 26077 died... 20:52:24.643062 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26077): Terminated: ok {rc=0} 20:52:24.691062 --- ParallelTerminationStrategy: PID 26080 died... 20:52:24.711180 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26080): Terminated: ok {rc=0} 20:52:24.758242 --- ParallelTerminationStrategy: PID 26083 died... 20:52:24.778373 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26083): Terminated: ok {rc=0} 20:52:24.867680 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:oc2g+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 20:52:25.959722 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:52:25.972576 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 20:52:26.012288 tst ping_idle_ping.py: using LAC 31430 20:52:26.140661 tst ping_idle_ping.py: using RAC 65 20:52:26.268557 tst ping_idle_ping.py: using CellId 31430 20:52:26.397825 tst ping_idle_ping.py: using BVCI 31431 20:52:26.515497 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:52:26.526847 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:52:26.538078 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:52:26.549316 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:52:26.560324 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:52:26.571406 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:52:26.582678 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:52:26.593932 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:52:26.714280 tst ping_idle_ping.py:24: start network... 20:52:26.916521 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:52:27.387860 run create_hlr_db(pid=26085): Launched 20:52:27.504601 bus /gobi_6: Setting Powered False 20:52:28.569712 run create_hlr_db(pid=26085): Terminated: ok {rc=0} 20:52:29.022517 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26087): Launched 20:52:29.348782 run osmo-hlr_10.42.42.2(pid=26088): Launched 20:52:29.473694 run osmo-stp_10.42.42.5: Starting osmo-stp 20:52:30.034343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26090): Launched 20:52:30.360859 run osmo-stp_10.42.42.5(pid=26091): Launched 20:52:30.485072 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:52:31.061516 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26093): Launched 20:52:31.197389 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:52:31.478576 run patchelf(pid=26094): Launched 20:52:31.666299 run osmo-stp_10.42.42.5(pid=26091): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26091)] 20:52:31.802804 run osmo-stp_10.42.42.5(pid=26091): stdout: | (launched: 2022-12-12_20:52:30.301532) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:52:31.941329 run osmo-stp_10.42.42.5(pid=26091): stderr: | 20221212205230490 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205230491 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205230491 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205230491 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205230492 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205230492 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205230492 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:52:32.075904 run osmo-stp_10.42.42.5(pid=26091): stdout: | (launched: 2022-12-12_20:52:30.301532) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:52:32.205734 run osmo-stp_10.42.42.5(pid=26091): stderr: | 20221212205230490 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205230491 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205230491 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205230491 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205230492 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205230492 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205230492 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:52:32.355768 run patchelf(pid=26094): Terminating (SIGINT) 20:52:32.528265 run patchelf(pid=26094): Terminated: ok {rc=0} 20:52:32.652846 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=26091): Process ended prematurely: osmo-stp_10.42.42.5(pid=26091) [trial-2382↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26091)] [trial-2382↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27] 20:52:32.662083 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 20:52:32.689972 run osmo-hlr_10.42.42.2(pid=26088): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26088)] 20:52:32.739069 run osmo-hlr_10.42.42.2(pid=26088): stdout: | (launched: 2022-12-12_20:52:29.289802) 20:52:32.790432 run osmo-hlr_10.42.42.2(pid=26088): stderr: | 20221212205229484 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212205229484 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212205229484 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212205229484 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212205229484 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212205229484 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212205229497 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:oc2g+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212205229507 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212205229507 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212205229507 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:52:32.841642 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26087): Terminating (SIGTERM) 20:52:32.882683 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26090): Terminating (SIGTERM) 20:52:32.924007 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26093): Terminating (SIGTERM) 20:52:32.965519 --- ParallelTerminationStrategy: PID 26087 died... 20:52:32.985095 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26087): Terminated: ok {rc=0} 20:52:33.030804 --- ParallelTerminationStrategy: PID 26090 died... 20:52:33.049838 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26090): Terminated: ok {rc=0} 20:52:33.095353 --- ParallelTerminationStrategy: PID 26093 died... 20:52:33.114527 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26093): Terminated: ok {rc=0} 20:52:33.202707 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2382 gprs:oc2g+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 gprs:oc2g+mod-bts0-dynts-ipa --------------------------------------------------------------------- 20:52:34.502670 tst gprs:oc2g+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:52:34.508943 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 20:52:34.529994 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 20:52:34.568615 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 20:52:34.652593 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 20:52:34.673134 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 20:52:34.711523 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 20:52:35.305421 tst gprs:oc2g+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2382 gprs:oc2g+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 20:52:35.355709 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:52:35.366545 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 20:52:35.420338 tst cs_paging_gprs_active.py: using LAC 31431 20:52:35.541311 tst cs_paging_gprs_active.py: using RAC 66 20:52:35.660340 tst cs_paging_gprs_active.py: using CellId 31431 20:52:35.779091 tst cs_paging_gprs_active.py: using BVCI 31432 20:52:35.891152 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:52:35.902077 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:52:35.912540 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:52:35.923398 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:52:35.934154 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:52:35.945095 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:52:35.955963 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:52:35.966698 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:52:35.977358 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:52:36.095355 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:52:36.212382 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 20:52:36.421575 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:52:36.732851 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26099): Launched 20:52:37.002512 run iperf3-srv_10.42.42.10(pid=26100): Launched 20:52:37.118541 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 20:52:37.327091 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:52:37.637986 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26101): Launched 20:52:37.910233 run iperf3-srv_10.42.42.10(pid=26102): Launched 20:52:38.028217 tst cs_paging_gprs_active.py:38: start network... 20:52:38.236855 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:52:38.717725 run create_hlr_db(pid=26103): Launched 20:52:38.836337 bus /gobi_6: Setting Powered False 20:52:39.898164 run create_hlr_db(pid=26103): Terminated: ok {rc=0} 20:52:40.352047 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26105): Launched 20:52:40.684537 run osmo-hlr_10.42.42.2(pid=26106): Launched 20:52:40.811284 run osmo-stp_10.42.42.5: Starting osmo-stp 20:52:41.381721 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26108): Launched 20:52:41.711685 run osmo-stp_10.42.42.5(pid=26109): Launched 20:52:41.837386 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:52:42.408373 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26111): Launched 20:52:42.534053 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:52:42.814268 run patchelf(pid=26112): Launched 20:52:42.999137 run osmo-stp_10.42.42.5(pid=26109): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26109)] 20:52:43.139269 run osmo-stp_10.42.42.5(pid=26109): stdout: | (launched: 2022-12-12_20:52:41.651402) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:52:43.281335 run osmo-stp_10.42.42.5(pid=26109): stderr: | 20221212205241840 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205241840 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205241841 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205241841 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205241842 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205241842 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205241842 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:52:43.422439 run osmo-stp_10.42.42.5(pid=26109): stdout: | (launched: 2022-12-12_20:52:41.651402) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:52:43.557704 run osmo-stp_10.42.42.5(pid=26109): stderr: | 20221212205241840 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205241840 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205241841 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205241841 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205241842 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205241842 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205241842 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:52:43.718471 run patchelf(pid=26112): Terminating (SIGINT) 20:52:43.904460 run patchelf(pid=26112): Terminated: ok {rc=0} 20:52:44.038625 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=26109): Process ended prematurely: osmo-stp_10.42.42.5(pid=26109) [trial-2382↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26109)] [trial-2382↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 20:52:44.048642 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 20:52:44.077634 run osmo-hlr_10.42.42.2(pid=26106): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26106)] 20:52:44.128723 run osmo-hlr_10.42.42.2(pid=26106): stdout: | (launched: 2022-12-12_20:52:40.623306) 20:52:44.181888 run osmo-hlr_10.42.42.2(pid=26106): stderr: | 20221212205240819 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212205240819 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212205240819 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212205240819 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212205240819 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212205240819 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212205240832 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:oc2g+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212205240842 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212205240842 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212205240842 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:52:44.235153 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26099): Terminating (SIGTERM) 20:52:44.278450 run iperf3-srv_10.42.42.10(pid=26100): Terminating (SIGTERM) 20:52:44.322475 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26101): Terminating (SIGTERM) 20:52:44.365310 run iperf3-srv_10.42.42.10(pid=26102): Terminating (SIGTERM) 20:52:44.407609 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26105): Terminating (SIGTERM) 20:52:44.450194 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26108): Terminating (SIGTERM) 20:52:44.492572 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26111): Terminating (SIGTERM) 20:52:44.535209 --- ParallelTerminationStrategy: PID 26099 died... 20:52:44.555623 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26099): Terminated: ok {rc=0} 20:52:44.602969 --- ParallelTerminationStrategy: PID 26100 died... 20:52:44.622828 run iperf3-srv_10.42.42.10(pid=26100): Terminated {rc=256} 20:52:44.669516 --- ParallelTerminationStrategy: PID 26101 died... 20:52:44.689355 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26101): Terminated: ok {rc=0} 20:52:44.735916 --- ParallelTerminationStrategy: PID 26102 died... 20:52:44.755749 run iperf3-srv_10.42.42.10(pid=26102): Terminated {rc=256} 20:52:44.803182 --- ParallelTerminationStrategy: PID 26105 died... 20:52:44.823241 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26105): Terminated: ok {rc=0} 20:52:44.869941 --- ParallelTerminationStrategy: PID 26108 died... 20:52:44.889798 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26108): Terminated: ok {rc=0} 20:52:44.936251 --- ParallelTerminationStrategy: PID 26111 died... 20:52:44.955938 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26111): Terminated: ok {rc=0} 20:52:45.044224 bus /gobi_0: Setting Powered False 20:52:46.144545 bus /gobi_0: Setting Powered False 20:52:47.266479 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:oc2g+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 20:52:48.416799 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:52:48.428328 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 20:52:48.487031 tst iperf3.py: using LAC 31432 20:52:48.609782 tst iperf3.py: using RAC 67 20:52:48.730915 tst iperf3.py: using CellId 31432 20:52:48.854433 tst iperf3.py: using BVCI 31433 20:52:48.968884 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:52:48.979780 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:52:48.990331 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:52:49.001224 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:52:49.012252 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:52:49.023085 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:52:49.034147 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:52:49.044811 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:52:49.055778 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:52:49.178033 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 20:52:49.402455 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:52:49.733974 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26113): Launched 20:52:50.020367 run iperf3-srv_10.42.42.10(pid=26114): Launched 20:52:50.144587 tst iperf3.py:8: start network... 20:52:50.368501 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:52:50.879385 run create_hlr_db(pid=26115): Launched 20:52:51.012943 bus /gobi_6: Setting Powered False 20:52:52.078202 run create_hlr_db(pid=26115): Terminated: ok {rc=0} 20:52:52.517481 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26117): Launched 20:52:52.827540 run osmo-hlr_10.42.42.2(pid=26118): Launched 20:52:52.944521 run osmo-stp_10.42.42.5: Starting osmo-stp 20:52:53.490976 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26120): Launched 20:52:53.797135 run osmo-stp_10.42.42.5(pid=26121): Launched 20:52:53.914270 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:52:54.443232 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26123): Launched 20:52:54.560900 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:52:54.820358 run patchelf(pid=26124): Launched 20:52:54.991254 run osmo-stp_10.42.42.5(pid=26121): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26121)] 20:52:55.120617 run osmo-stp_10.42.42.5(pid=26121): stdout: | (launched: 2022-12-12_20:52:53.741395) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:52:55.252612 run osmo-stp_10.42.42.5(pid=26121): stderr: | 20221212205253908 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205253908 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205253908 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205253909 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205253909 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205253909 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205253910 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:52:55.384013 run osmo-stp_10.42.42.5(pid=26121): stdout: | (launched: 2022-12-12_20:52:53.741395) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:52:55.509813 run osmo-stp_10.42.42.5(pid=26121): stderr: | 20221212205253908 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205253908 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205253908 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205253909 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205253909 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205253909 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205253910 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:52:55.658934 run patchelf(pid=26124): Terminating (SIGINT) 20:52:55.830744 run patchelf(pid=26124): Terminated: ok {rc=0} 20:52:55.955195 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26121): Process ended prematurely: osmo-stp_10.42.42.5(pid=26121) [trial-2382↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26121)] [trial-2382↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8] 20:52:55.964668 tst iperf3.py:8: Test FAILED (7.6 sec) 20:52:55.992186 run osmo-hlr_10.42.42.2(pid=26118): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26118)] 20:52:56.040832 run osmo-hlr_10.42.42.2(pid=26118): stdout: | (launched: 2022-12-12_20:52:52.771027) 20:52:56.091314 run osmo-hlr_10.42.42.2(pid=26118): stderr: | 20221212205252944 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212205252944 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212205252944 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212205252944 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212205252944 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212205252944 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212205252957 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:oc2g+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212205252965 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212205252966 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212205252966 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:52:56.142393 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26113): Terminating (SIGTERM) 20:52:56.182859 run iperf3-srv_10.42.42.10(pid=26114): Terminating (SIGTERM) 20:52:56.223175 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26117): Terminating (SIGTERM) 20:52:56.263552 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26120): Terminating (SIGTERM) 20:52:56.303845 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26123): Terminating (SIGTERM) 20:52:56.344414 --- ParallelTerminationStrategy: PID 26113 died... 20:52:56.363812 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26113): Terminated: ok {rc=0} 20:52:56.409423 --- ParallelTerminationStrategy: PID 26114 died... 20:52:56.428391 run iperf3-srv_10.42.42.10(pid=26114): Terminated {rc=256} 20:52:56.473221 --- ParallelTerminationStrategy: PID 26117 died... 20:52:56.492100 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26117): Terminated: ok {rc=0} 20:52:56.537358 --- ParallelTerminationStrategy: PID 26120 died... 20:52:56.556177 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26120): Terminated: ok {rc=0} 20:52:56.601210 --- ParallelTerminationStrategy: PID 26123 died... 20:52:56.620085 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26123): Terminated: ok {rc=0} 20:52:56.708117 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:oc2g+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 20:52:57.856903 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:52:57.868460 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 20:52:57.925735 tst iperf3m4.py: using LAC 31433 20:52:58.057056 tst iperf3m4.py: using RAC 68 20:52:58.187570 tst iperf3m4.py: using CellId 31433 20:52:58.316011 tst iperf3m4.py: using BVCI 31434 20:52:58.438827 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:52:58.450492 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:52:58.461862 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:52:58.473206 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:52:58.484435 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:52:58.495602 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:52:58.507213 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:52:58.518387 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:52:58.529744 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:52:58.646979 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:52:58.766763 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:52:58.888101 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:52:59.006388 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 20:52:59.213537 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:52:59.523519 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26125): Launched 20:52:59.792189 run iperf3-srv_10.42.42.10(pid=26126): Launched 20:52:59.908347 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 20:53:00.115187 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:53:00.425631 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26127): Launched 20:53:00.696361 run iperf3-srv_10.42.42.10(pid=26128): Launched 20:53:00.812762 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 20:53:01.064562 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:53:01.416337 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26129): Launched 20:53:01.711182 run iperf3-srv_10.42.42.10(pid=26130): Launched 20:53:01.843007 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 20:53:02.054103 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:53:02.366754 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26131): Launched 20:53:02.635602 run iperf3-srv_10.42.42.10(pid=26132): Launched 20:53:02.752318 tst iperf3m4.py:8: start network... 20:53:02.960153 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:53:03.441187 run create_hlr_db(pid=26133): Launched 20:53:03.559207 bus /gobi_6: Setting Powered False 20:53:04.620490 run create_hlr_db(pid=26133): Terminated: ok {rc=0} 20:53:05.051127 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26135): Launched 20:53:05.360330 run osmo-hlr_10.42.42.2(pid=26136): Launched 20:53:05.478010 run osmo-stp_10.42.42.5: Starting osmo-stp 20:53:06.021321 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26138): Launched 20:53:06.329391 run osmo-stp_10.42.42.5(pid=26139): Launched 20:53:06.447875 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:53:06.981743 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26141): Launched 20:53:07.099558 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:53:07.360157 run patchelf(pid=26142): Launched 20:53:07.531285 run osmo-stp_10.42.42.5(pid=26139): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26139)] 20:53:07.661832 run osmo-stp_10.42.42.5(pid=26139): stdout: | (launched: 2022-12-12_20:53:06.273139) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:53:07.793369 run osmo-stp_10.42.42.5(pid=26139): stderr: | 20221212205306440 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205306441 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205306441 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205306441 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205306442 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205306442 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205306442 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:53:07.925357 run osmo-stp_10.42.42.5(pid=26139): stdout: | (launched: 2022-12-12_20:53:06.273139) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:53:08.051740 run osmo-stp_10.42.42.5(pid=26139): stderr: | 20221212205306440 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205306441 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205306441 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205306441 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205306442 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205306442 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205306442 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:53:08.201786 run patchelf(pid=26142): Terminating (SIGINT) 20:53:08.374880 run patchelf(pid=26142): Terminated: ok {rc=0} 20:53:08.499629 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26139): Process ended prematurely: osmo-stp_10.42.42.5(pid=26139) [trial-2382↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26139)] [trial-2382↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8] 20:53:08.509060 tst iperf3m4.py:8: Test FAILED (10.7 sec) 20:53:08.537279 run osmo-hlr_10.42.42.2(pid=26136): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26136)] 20:53:08.586457 run osmo-hlr_10.42.42.2(pid=26136): stdout: | (launched: 2022-12-12_20:53:05.304030) 20:53:08.637046 run osmo-hlr_10.42.42.2(pid=26136): stderr: | 20221212205305479 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212205305479 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212205305479 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212205305479 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212205305479 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212205305479 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212205305491 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:oc2g+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212205305502 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212205305502 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212205305502 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:53:08.687973 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26125): Terminating (SIGTERM) 20:53:08.728781 run iperf3-srv_10.42.42.10(pid=26126): Terminating (SIGTERM) 20:53:08.769595 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26127): Terminating (SIGTERM) 20:53:08.810416 run iperf3-srv_10.42.42.10(pid=26128): Terminating (SIGTERM) 20:53:08.851030 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26129): Terminating (SIGTERM) 20:53:08.891691 run iperf3-srv_10.42.42.10(pid=26130): Terminating (SIGTERM) 20:53:08.932160 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26131): Terminating (SIGTERM) 20:53:08.972893 run iperf3-srv_10.42.42.10(pid=26132): Terminating (SIGTERM) 20:53:09.013330 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26135): Terminating (SIGTERM) 20:53:09.054050 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26138): Terminating (SIGTERM) 20:53:09.094629 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26141): Terminating (SIGTERM) 20:53:09.135237 --- ParallelTerminationStrategy: PID 26125 died... 20:53:09.154483 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26125): Terminated: ok {rc=0} 20:53:09.200115 --- ParallelTerminationStrategy: PID 26126 died... 20:53:09.219037 run iperf3-srv_10.42.42.10(pid=26126): Terminated {rc=256} 20:53:09.264094 --- ParallelTerminationStrategy: PID 26127 died... 20:53:09.283220 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26127): Terminated: ok {rc=0} 20:53:09.329184 --- ParallelTerminationStrategy: PID 26128 died... 20:53:09.348042 run iperf3-srv_10.42.42.10(pid=26128): Terminated {rc=256} 20:53:09.393181 --- ParallelTerminationStrategy: PID 26129 died... 20:53:09.411831 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26129): Terminated: ok {rc=0} 20:53:09.456602 --- ParallelTerminationStrategy: PID 26130 died... 20:53:09.475419 run iperf3-srv_10.42.42.10(pid=26130): Terminated {rc=256} 20:53:09.520149 --- ParallelTerminationStrategy: PID 26131 died... 20:53:09.538889 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26131): Terminated: ok {rc=0} 20:53:09.583750 --- ParallelTerminationStrategy: PID 26132 died... 20:53:09.602569 run iperf3-srv_10.42.42.10(pid=26132): Terminated {rc=256} 20:53:09.647174 --- ParallelTerminationStrategy: PID 26135 died... 20:53:09.665935 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26135): Terminated: ok {rc=0} 20:53:09.710785 --- ParallelTerminationStrategy: PID 26138 died... 20:53:09.729783 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26138): Terminated: ok {rc=0} 20:53:09.775110 --- ParallelTerminationStrategy: PID 26141 died... 20:53:09.793944 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26141): Terminated: ok {rc=0} 20:53:09.880897 bus /gobi_4: Setting Powered False 20:53:10.982260 bus /gobi_4: Setting Powered False 20:53:12.100018 bus /gobi_1: Setting Powered False 20:53:13.200538 bus /gobi_1: Setting Powered False 20:53:14.315393 bus /gobi_0: Setting Powered False 20:53:15.414894 bus /gobi_0: Setting Powered False 20:53:16.535087 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:oc2g+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 20:53:17.643215 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:53:17.654515 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 20:53:17.712360 tst ping.py: using LAC 31434 20:53:17.834758 tst ping.py: using RAC 69 20:53:17.956025 tst ping.py: using CellId 31434 20:53:18.077812 tst ping.py: using BVCI 31435 20:53:18.198985 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:53:18.210609 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:53:18.221992 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:53:18.233494 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:53:18.244625 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:53:18.255934 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:53:18.267265 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:53:18.278442 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:53:18.397716 tst ping.py:19: start network... 20:53:18.616369 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:53:19.119855 run create_hlr_db(pid=26143): Launched 20:53:19.244734 bus /gobi_6: Setting Powered False 20:53:20.308904 run create_hlr_db(pid=26143): Terminated: ok {rc=0} 20:53:20.742512 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26145): Launched 20:53:21.045605 run osmo-hlr_10.42.42.2(pid=26147): Launched 20:53:21.162506 run osmo-stp_10.42.42.5: Starting osmo-stp 20:53:21.704180 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26149): Launched 20:53:22.006721 run osmo-stp_10.42.42.5(pid=26150): Launched 20:53:22.122497 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:53:22.645282 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26152): Launched 20:53:22.761176 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:53:23.017171 run patchelf(pid=26153): Launched 20:53:23.188130 run osmo-stp_10.42.42.5(pid=26150): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26150)] 20:53:23.316880 run osmo-stp_10.42.42.5(pid=26150): stdout: | (launched: 2022-12-12_20:53:21.951532) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:53:23.447305 run osmo-stp_10.42.42.5(pid=26150): stderr: | 20221212205322119 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205322120 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205322120 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205322120 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205322121 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205322121 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205322121 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:53:23.577947 run osmo-stp_10.42.42.5(pid=26150): stdout: | (launched: 2022-12-12_20:53:21.951532) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:53:23.702732 run osmo-stp_10.42.42.5(pid=26150): stderr: | 20221212205322119 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205322120 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205322120 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205322120 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205322121 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205322121 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205322121 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:53:23.850761 run patchelf(pid=26153): Terminating (SIGINT) 20:53:24.021670 run patchelf(pid=26153): Terminated: ok {rc=0} 20:53:24.145449 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=26150): Process ended prematurely: osmo-stp_10.42.42.5(pid=26150) [trial-2382↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26150)] [trial-2382↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22] 20:53:24.154420 tst ping.py:22: Test FAILED (6.5 sec) 20:53:24.181750 run osmo-hlr_10.42.42.2(pid=26147): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26147)] 20:53:24.230826 run osmo-hlr_10.42.42.2(pid=26147): stdout: | (launched: 2022-12-12_20:53:20.990274) 20:53:24.281298 run osmo-hlr_10.42.42.2(pid=26147): stderr: | 20221212205321161 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212205321161 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212205321161 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212205321161 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212205321161 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212205321161 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212205321174 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:oc2g+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212205321182 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212205321183 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212205321183 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:53:24.332340 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26145): Terminating (SIGTERM) 20:53:24.373149 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26149): Terminating (SIGTERM) 20:53:24.413740 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26152): Terminating (SIGTERM) 20:53:24.454645 --- ParallelTerminationStrategy: PID 26145 died... 20:53:24.474067 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26145): Terminated: ok {rc=0} 20:53:24.519297 --- ParallelTerminationStrategy: PID 26149 died... 20:53:24.538193 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26149): Terminated: ok {rc=0} 20:53:24.583267 --- ParallelTerminationStrategy: PID 26152 died... 20:53:24.602029 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26152): Terminated: ok {rc=0} 20:53:24.687728 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:oc2g+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 20:53:25.772150 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:53:25.783518 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 20:53:25.841596 tst ping_idle_ping.py: using LAC 31435 20:53:25.963701 tst ping_idle_ping.py: using RAC 70 20:53:26.086796 tst ping_idle_ping.py: using CellId 31435 20:53:26.209581 tst ping_idle_ping.py: using BVCI 31436 20:53:26.330224 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:53:26.341827 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:53:26.353248 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:53:26.364433 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:53:26.375612 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:53:26.386894 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:53:26.398154 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:53:26.409367 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:53:26.526361 tst ping_idle_ping.py:24: start network... 20:53:26.730550 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:53:27.202866 run create_hlr_db(pid=26154): Launched 20:53:27.328508 bus /gobi_6: Setting Powered False 20:53:28.389473 run create_hlr_db(pid=26154): Terminated: ok {rc=0} 20:53:28.812162 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26156): Launched 20:53:29.115477 run osmo-hlr_10.42.42.2(pid=26157): Launched 20:53:29.230509 run osmo-stp_10.42.42.5: Starting osmo-stp 20:53:29.768636 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26159): Launched 20:53:30.070883 run osmo-stp_10.42.42.5(pid=26160): Launched 20:53:30.186121 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:53:30.708414 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26162): Launched 20:53:30.824529 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:53:31.099099 run patchelf(pid=26163): Launched 20:53:31.316478 run osmo-stp_10.42.42.5(pid=26160): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26160)] 20:53:31.448453 run osmo-stp_10.42.42.5(pid=26160): stdout: | (launched: 2022-12-12_20:53:30.015410) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:53:31.582367 run osmo-stp_10.42.42.5(pid=26160): stderr: | 20221212205330183 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205330183 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205330184 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205330184 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205330184 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205330185 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205330185 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:53:31.715847 run osmo-stp_10.42.42.5(pid=26160): stdout: | (launched: 2022-12-12_20:53:30.015410) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:53:31.843424 run osmo-stp_10.42.42.5(pid=26160): stderr: | 20221212205330183 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205330183 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205330184 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205330184 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205330184 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205330185 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205330185 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:53:31.994088 run patchelf(pid=26163): Terminating (SIGINT) 20:53:32.168356 run patchelf(pid=26163): Terminated: ok {rc=0} 20:53:32.293764 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=26160): Process ended prematurely: osmo-stp_10.42.42.5(pid=26160) [trial-2382↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26160)] [trial-2382↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 20:53:32.303282 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 20:53:32.330517 run osmo-hlr_10.42.42.2(pid=26157): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26157)] 20:53:32.378834 run osmo-hlr_10.42.42.2(pid=26157): stdout: | (launched: 2022-12-12_20:53:29.059732) 20:53:32.429370 run osmo-hlr_10.42.42.2(pid=26157): stderr: | 20221212205329233 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212205329233 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212205329233 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212205329233 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212205329233 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212205329233 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212205329243 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:oc2g+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212205329252 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212205329252 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212205329252 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:53:32.479949 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26156): Terminating (SIGTERM) 20:53:32.520465 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26159): Terminating (SIGTERM) 20:53:32.561077 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26162): Terminating (SIGTERM) 20:53:32.602377 --- ParallelTerminationStrategy: PID 26156 died... 20:53:32.621847 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26156): Terminated: ok {rc=0} 20:53:32.666981 --- ParallelTerminationStrategy: PID 26159 died... 20:53:32.686066 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26159): Terminated: ok {rc=0} 20:53:32.730746 --- ParallelTerminationStrategy: PID 26162 died... 20:53:32.749917 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26162): Terminated: ok {rc=0} 20:53:32.837577 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2382 gprs:oc2g+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 gprs:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 20:53:34.132806 tst gprs:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:53:34.139409 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 20:53:34.160471 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 20:53:34.198758 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 20:53:34.284536 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 20:53:34.304902 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 20:53:34.342711 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 20:53:34.936098 tst gprs:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2382 gprs:oc2g+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 20:53:34.985992 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:53:34.996855 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:53:35.053059 tst cs_paging_gprs_active.py: using LAC 31436 20:53:35.174631 tst cs_paging_gprs_active.py: using RAC 71 20:53:35.297485 tst cs_paging_gprs_active.py: using CellId 31436 20:53:35.419180 tst cs_paging_gprs_active.py: using BVCI 31437 20:53:35.533901 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:53:35.544669 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:53:35.555286 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:53:35.565839 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:53:35.576210 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:53:35.586778 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:53:35.597505 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:53:35.607948 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:53:35.618812 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:53:35.739317 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:53:35.862041 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 20:53:36.087715 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:53:36.421731 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26167): Launched 20:53:36.712206 run iperf3-srv_10.42.42.10(pid=26168): Launched 20:53:36.837395 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 20:53:37.062874 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:53:37.398577 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26169): Launched 20:53:37.686779 run iperf3-srv_10.42.42.10(pid=26170): Launched 20:53:37.812618 tst cs_paging_gprs_active.py:38: start network... 20:53:38.037037 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:53:38.552685 run create_hlr_db(pid=26171): Launched 20:53:38.680311 bus /gobi_6: Setting Powered False 20:53:39.745786 run create_hlr_db(pid=26171): Terminated: ok {rc=0} 20:53:40.188815 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26173): Launched 20:53:40.498050 run osmo-hlr_10.42.42.2(pid=26174): Launched 20:53:40.616369 run osmo-stp_10.42.42.5: Starting osmo-stp 20:53:41.149237 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26176): Launched 20:53:41.459057 run osmo-stp_10.42.42.5(pid=26177): Launched 20:53:41.576685 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:53:42.108928 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26179): Launched 20:53:42.226961 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:53:42.488304 run patchelf(pid=26180): Launched 20:53:42.660353 run osmo-stp_10.42.42.5(pid=26177): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26177)] 20:53:42.790778 run osmo-stp_10.42.42.5(pid=26177): stdout: | (launched: 2022-12-12_20:53:41.402533) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:53:42.923448 run osmo-stp_10.42.42.5(pid=26177): stderr: | 20221212205341571 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205341571 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205341572 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205341572 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205341572 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205341573 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205341573 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:53:43.055733 run osmo-stp_10.42.42.5(pid=26177): stdout: | (launched: 2022-12-12_20:53:41.402533) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:53:43.182749 run osmo-stp_10.42.42.5(pid=26177): stderr: | 20221212205341571 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205341571 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205341572 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205341572 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205341572 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205341573 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205341573 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:53:43.333768 run patchelf(pid=26180): Terminating (SIGINT) 20:53:43.507422 run patchelf(pid=26180): Terminated: ok {rc=0} 20:53:43.633180 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=26177): Process ended prematurely: osmo-stp_10.42.42.5(pid=26177) [trial-2382↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26177)] [trial-2382↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 20:53:43.642682 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 20:53:43.669927 run osmo-hlr_10.42.42.2(pid=26174): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26174)] 20:53:43.718360 run osmo-hlr_10.42.42.2(pid=26174): stdout: | (launched: 2022-12-12_20:53:40.441368) 20:53:43.768421 run osmo-hlr_10.42.42.2(pid=26174): stderr: | 20221212205340616 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212205340616 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212205340616 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212205340616 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212205340616 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212205340617 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212205340633 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:oc2g+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212205340644 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212205340644 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212205340644 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:53:43.819239 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26167): Terminating (SIGTERM) 20:53:43.860115 run iperf3-srv_10.42.42.10(pid=26168): Terminating (SIGTERM) 20:53:43.900333 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26169): Terminating (SIGTERM) 20:53:43.940754 run iperf3-srv_10.42.42.10(pid=26170): Terminating (SIGTERM) 20:53:43.981147 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26173): Terminating (SIGTERM) 20:53:44.022015 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26176): Terminating (SIGTERM) 20:53:44.062415 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26179): Terminating (SIGTERM) 20:53:44.102951 --- ParallelTerminationStrategy: PID 26167 died... 20:53:44.122380 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26167): Terminated: ok {rc=0} 20:53:44.166885 --- ParallelTerminationStrategy: PID 26168 died... 20:53:44.185601 run iperf3-srv_10.42.42.10(pid=26168): Terminated {rc=256} 20:53:44.229875 --- ParallelTerminationStrategy: PID 26169 died... 20:53:44.248511 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26169): Terminated: ok {rc=0} 20:53:44.293374 --- ParallelTerminationStrategy: PID 26170 died... 20:53:44.312148 run iperf3-srv_10.42.42.10(pid=26170): Terminated {rc=256} 20:53:44.357090 --- ParallelTerminationStrategy: PID 26173 died... 20:53:44.375907 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26173): Terminated: ok {rc=0} 20:53:44.420454 --- ParallelTerminationStrategy: PID 26176 died... 20:53:44.439175 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26176): Terminated: ok {rc=0} 20:53:44.483423 --- ParallelTerminationStrategy: PID 26179 died... 20:53:44.502276 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26179): Terminated: ok {rc=0} 20:53:44.588764 bus /gobi_0: Setting Powered False 20:53:45.689431 bus /gobi_0: Setting Powered False 20:53:46.828940 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:oc2g+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 20:53:48.032592 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:53:48.045373 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:53:48.122367 tst iperf3.py: using LAC 31437 20:53:48.303345 tst iperf3.py: using RAC 72 20:53:48.442466 tst iperf3.py: using CellId 31437 20:53:48.581049 tst iperf3.py: using BVCI 31438 20:53:48.706323 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:53:48.719422 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:53:48.731568 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:53:48.744357 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:53:48.758005 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:53:48.770794 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:53:48.784208 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:53:48.798427 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:53:48.810901 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:53:48.942122 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 20:53:49.175239 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:53:49.517058 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26475): Launched 20:53:49.821340 run iperf3-srv_10.42.42.10(pid=26476): Launched 20:53:49.964375 tst iperf3.py:8: start network... 20:53:50.194863 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:53:50.720922 run create_hlr_db(pid=26479): Launched 20:53:50.882243 bus /gobi_6: Setting Powered False 20:53:51.943614 run create_hlr_db(pid=26479): Terminated: ok {rc=0} 20:53:52.381515 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26481): Launched 20:53:52.712699 run osmo-hlr_10.42.42.2(pid=26482): Launched 20:53:52.952935 run osmo-stp_10.42.42.5: Starting osmo-stp 20:53:53.673153 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26484): Launched 20:53:54.007270 run osmo-stp_10.42.42.5(pid=26485): Launched 20:53:54.248571 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:53:54.945418 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26487): Launched 20:53:55.079764 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:53:55.352553 run patchelf(pid=26488): Launched 20:53:55.546403 run osmo-stp_10.42.42.5(pid=26485): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26485)] 20:53:55.683631 run osmo-stp_10.42.42.5(pid=26485): stdout: | (launched: 2022-12-12_20:53:53.949278) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:53:55.819735 run osmo-stp_10.42.42.5(pid=26485): stderr: | 20221212205354271 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205354272 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205354272 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205354272 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205354273 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205354273 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205354273 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:53:55.957807 run osmo-stp_10.42.42.5(pid=26485): stdout: | (launched: 2022-12-12_20:53:53.949278) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:53:56.089768 run osmo-stp_10.42.42.5(pid=26485): stderr: | 20221212205354271 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205354272 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205354272 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205354272 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205354273 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205354273 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205354273 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:53:56.245223 run patchelf(pid=26488): Terminating (SIGINT) 20:53:56.426370 run patchelf(pid=26488): Terminated: ok {rc=0} 20:53:56.558220 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26485): Process ended prematurely: osmo-stp_10.42.42.5(pid=26485) [trial-2382↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26485)] [trial-2382↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8] 20:53:56.569079 tst iperf3.py:8: Test FAILED (8.6 sec) 20:53:56.598421 run osmo-hlr_10.42.42.2(pid=26482): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26482)] 20:53:56.649197 run osmo-hlr_10.42.42.2(pid=26482): stdout: | (launched: 2022-12-12_20:53:52.651011) 20:53:56.702847 run osmo-hlr_10.42.42.2(pid=26482): stderr: | 20221212205352987 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212205352987 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212205352987 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212205352987 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212205352987 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212205352987 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212205353009 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:oc2g+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212205353023 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212205353023 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212205353023 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:53:56.755788 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26475): Terminating (SIGTERM) 20:53:56.798844 run iperf3-srv_10.42.42.10(pid=26476): Terminating (SIGTERM) 20:53:56.844367 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26481): Terminating (SIGTERM) 20:53:56.888597 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26484): Terminating (SIGTERM) 20:53:56.933418 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26487): Terminating (SIGTERM) 20:53:56.977929 --- ParallelTerminationStrategy: PID 26475 died... 20:53:56.998373 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26475): Terminated: ok {rc=0} 20:53:57.046453 --- ParallelTerminationStrategy: PID 26476 died... 20:53:57.066753 run iperf3-srv_10.42.42.10(pid=26476): Terminated {rc=256} 20:53:57.113937 --- ParallelTerminationStrategy: PID 26481 died... 20:53:57.134083 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26481): Terminated: ok {rc=0} 20:53:57.180603 --- ParallelTerminationStrategy: PID 26484 died... 20:53:57.200728 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26484): Terminated: ok {rc=0} 20:53:57.247128 --- ParallelTerminationStrategy: PID 26487 died... 20:53:57.267268 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26487): Terminated: ok {rc=0} 20:53:57.358456 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:oc2g+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 20:53:58.521635 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:53:58.535641 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:53:58.598218 tst iperf3m4.py: using LAC 31438 20:53:58.741209 tst iperf3m4.py: using RAC 73 20:53:58.877426 tst iperf3m4.py: using CellId 31438 20:53:59.014678 tst iperf3m4.py: using BVCI 31439 20:53:59.142306 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:53:59.155000 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:53:59.168997 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:53:59.182633 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:53:59.195376 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:53:59.209598 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:53:59.223971 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:53:59.237688 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:53:59.250369 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:53:59.382592 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:53:59.516385 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:53:59.645627 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:53:59.776842 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 20:54:00.013155 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:54:00.361666 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26489): Launched 20:54:00.673263 run iperf3-srv_10.42.42.10(pid=26490): Launched 20:54:00.817503 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 20:54:01.060896 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:54:01.407115 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26491): Launched 20:54:01.749613 run iperf3-srv_10.42.42.10(pid=26492): Launched 20:54:01.890546 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 20:54:02.132484 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:54:02.484852 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26493): Launched 20:54:02.798471 run iperf3-srv_10.42.42.10(pid=26494): Launched 20:54:02.943129 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 20:54:03.179292 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:54:03.529886 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26495): Launched 20:54:03.846444 run iperf3-srv_10.42.42.10(pid=26496): Launched 20:54:03.990363 tst iperf3m4.py:8: start network... 20:54:04.227471 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:54:04.767962 run create_hlr_db(pid=26497): Launched 20:54:04.939783 bus /gobi_6: Setting Powered False 20:54:06.007289 run create_hlr_db(pid=26497): Terminated: ok {rc=0} 20:54:06.488597 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26500): Launched 20:54:06.847144 run osmo-hlr_10.42.42.2(pid=26501): Launched 20:54:07.113298 run osmo-stp_10.42.42.5: Starting osmo-stp 20:54:07.802265 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26503): Launched 20:54:08.160718 run osmo-stp_10.42.42.5(pid=26504): Launched 20:54:08.422647 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:54:09.088352 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26506): Launched 20:54:09.233107 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:54:09.527558 run patchelf(pid=26507): Launched 20:54:09.734491 run osmo-stp_10.42.42.5(pid=26504): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26504)] 20:54:09.883262 run osmo-stp_10.42.42.5(pid=26504): stdout: | (launched: 2022-12-12_20:54:08.098230) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:54:10.032446 run osmo-stp_10.42.42.5(pid=26504): stderr: | 20221212205408394 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205408394 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205408394 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205408395 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205408395 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205408395 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205408395 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:54:10.181542 run osmo-stp_10.42.42.5(pid=26504): stdout: | (launched: 2022-12-12_20:54:08.098230) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:54:10.326510 run osmo-stp_10.42.42.5(pid=26504): stderr: | 20221212205408394 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205408394 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205408394 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205408395 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205408395 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205408395 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205408395 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:54:10.497337 run patchelf(pid=26507): Terminating (SIGINT) 20:54:10.688589 run patchelf(pid=26507): Terminated: ok {rc=0} 20:54:10.826320 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26504): Process ended prematurely: osmo-stp_10.42.42.5(pid=26504) [trial-2382↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26504)] [trial-2382↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8] 20:54:10.836934 tst iperf3m4.py:8: Test FAILED (12.4 sec) 20:54:10.868204 run osmo-hlr_10.42.42.2(pid=26501): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26501)] 20:54:10.921371 run osmo-hlr_10.42.42.2(pid=26501): stdout: | (launched: 2022-12-12_20:54:06.784248) 20:54:10.976500 run osmo-hlr_10.42.42.2(pid=26501): stderr: | 20221212205407091 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212205407092 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212205407092 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212205407092 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212205407092 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212205407092 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212205407107 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:oc2g+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212205407119 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212205407119 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212205407119 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:54:11.031510 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26489): Terminating (SIGTERM) 20:54:11.075688 run iperf3-srv_10.42.42.10(pid=26490): Terminating (SIGTERM) 20:54:11.119803 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26491): Terminating (SIGTERM) 20:54:11.163916 run iperf3-srv_10.42.42.10(pid=26492): Terminating (SIGTERM) 20:54:11.208357 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26493): Terminating (SIGTERM) 20:54:11.253055 run iperf3-srv_10.42.42.10(pid=26494): Terminating (SIGTERM) 20:54:11.297175 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26495): Terminating (SIGTERM) 20:54:11.341365 run iperf3-srv_10.42.42.10(pid=26496): Terminating (SIGTERM) 20:54:11.385468 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26500): Terminating (SIGTERM) 20:54:11.429749 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26503): Terminating (SIGTERM) 20:54:11.474070 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26506): Terminating (SIGTERM) 20:54:11.518541 --- ParallelTerminationStrategy: PID 26489 died... 20:54:11.539152 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26489): Terminated: ok {rc=0} 20:54:11.588401 --- ParallelTerminationStrategy: PID 26490 died... 20:54:11.608720 run iperf3-srv_10.42.42.10(pid=26490): Terminated {rc=256} 20:54:11.657462 --- ParallelTerminationStrategy: PID 26491 died... 20:54:11.677885 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26491): Terminated: ok {rc=0} 20:54:11.726904 --- ParallelTerminationStrategy: PID 26492 died... 20:54:11.747246 run iperf3-srv_10.42.42.10(pid=26492): Terminated {rc=256} 20:54:11.795985 --- ParallelTerminationStrategy: PID 26493 died... 20:54:11.816441 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26493): Terminated: ok {rc=0} 20:54:11.865570 --- ParallelTerminationStrategy: PID 26494 died... 20:54:11.886050 run iperf3-srv_10.42.42.10(pid=26494): Terminated {rc=256} 20:54:11.935110 --- ParallelTerminationStrategy: PID 26495 died... 20:54:11.955569 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26495): Terminated: ok {rc=0} 20:54:12.004433 --- ParallelTerminationStrategy: PID 26496 died... 20:54:12.025063 run iperf3-srv_10.42.42.10(pid=26496): Terminated {rc=256} 20:54:12.073756 --- ParallelTerminationStrategy: PID 26500 died... 20:54:12.094341 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26500): Terminated: ok {rc=0} 20:54:12.143270 --- ParallelTerminationStrategy: PID 26503 died... 20:54:12.163689 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26503): Terminated: ok {rc=0} 20:54:12.213068 --- ParallelTerminationStrategy: PID 26506 died... 20:54:12.233472 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26506): Terminated: ok {rc=0} 20:54:12.324714 bus /gobi_4: Setting Powered False 20:54:13.426529 bus /gobi_4: Setting Powered False 20:54:14.547316 bus /gobi_1: Setting Powered False 20:54:15.649033 bus /gobi_1: Setting Powered False 20:54:16.768770 bus /gobi_0: Setting Powered False 20:54:17.871528 bus /gobi_0: Setting Powered False 20:54:18.991099 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:oc2g+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 20:54:20.098714 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:54:20.110416 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:54:20.167798 tst ping.py: using LAC 31439 20:54:20.290198 tst ping.py: using RAC 74 20:54:20.412541 tst ping.py: using CellId 31439 20:54:20.536292 tst ping.py: using BVCI 31440 20:54:20.650461 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:54:20.661845 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:54:20.673055 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:54:20.683771 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:54:20.694524 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:54:20.705176 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:54:20.716016 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:54:20.726720 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:54:20.847806 tst ping.py:19: start network... 20:54:21.071897 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:54:21.586817 run create_hlr_db(pid=26509): Launched 20:54:21.716048 bus /gobi_6: Setting Powered False 20:54:22.781768 run create_hlr_db(pid=26509): Terminated: ok {rc=0} 20:54:23.224458 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26511): Launched 20:54:23.534005 run osmo-hlr_10.42.42.2(pid=26512): Launched 20:54:23.652278 run osmo-stp_10.42.42.5: Starting osmo-stp 20:54:24.205253 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26514): Launched 20:54:24.514856 run osmo-stp_10.42.42.5(pid=26515): Launched 20:54:24.634649 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:54:25.173904 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26517): Launched 20:54:25.291719 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:54:25.552867 run patchelf(pid=26518): Launched 20:54:25.726570 run osmo-stp_10.42.42.5(pid=26515): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26515)] 20:54:25.857529 run osmo-stp_10.42.42.5(pid=26515): stdout: | (launched: 2022-12-12_20:54:24.457842) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:54:25.990496 run osmo-stp_10.42.42.5(pid=26515): stderr: | 20221212205424628 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205424628 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205424628 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205424629 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205424629 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205424629 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205424629 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:54:26.123411 run osmo-stp_10.42.42.5(pid=26515): stdout: | (launched: 2022-12-12_20:54:24.457842) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:54:26.250795 run osmo-stp_10.42.42.5(pid=26515): stderr: | 20221212205424628 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205424628 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205424628 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205424629 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205424629 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205424629 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205424629 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:54:26.401522 run patchelf(pid=26518): Terminating (SIGINT) 20:54:26.575951 run patchelf(pid=26518): Terminated: ok {rc=0} 20:54:26.702278 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=26515): Process ended prematurely: osmo-stp_10.42.42.5(pid=26515) [trial-2382↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26515)] [trial-2382↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22] 20:54:26.711297 tst ping.py:22: Test FAILED (6.6 sec) 20:54:26.738669 run osmo-hlr_10.42.42.2(pid=26512): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26512)] 20:54:26.787804 run osmo-hlr_10.42.42.2(pid=26512): stdout: | (launched: 2022-12-12_20:54:23.476518) 20:54:26.839063 run osmo-hlr_10.42.42.2(pid=26512): stderr: | 20221212205423650 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212205423650 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212205423650 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212205423650 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212205423650 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212205423650 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212205423662 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:oc2g+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212205423670 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212205423671 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212205423671 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:54:26.890789 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26511): Terminating (SIGTERM) 20:54:26.931840 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26514): Terminating (SIGTERM) 20:54:26.972526 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26517): Terminating (SIGTERM) 20:54:27.013372 --- ParallelTerminationStrategy: PID 26511 died... 20:54:27.032907 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26511): Terminated: ok {rc=0} 20:54:27.078782 --- ParallelTerminationStrategy: PID 26514 died... 20:54:27.098402 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26514): Terminated: ok {rc=0} 20:54:27.143727 --- ParallelTerminationStrategy: PID 26517 died... 20:54:27.163036 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26517): Terminated: ok {rc=0} 20:54:27.252090 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:oc2g+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 20:54:28.344506 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:54:28.356937 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:54:28.423992 tst ping_idle_ping.py: using LAC 31440 20:54:28.554390 tst ping_idle_ping.py: using RAC 75 20:54:28.685456 tst ping_idle_ping.py: using CellId 31440 20:54:28.806430 tst ping_idle_ping.py: using BVCI 31441 20:54:28.921308 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:54:28.932307 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:54:28.943315 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:54:28.954147 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:54:28.964923 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:54:28.975762 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:54:28.986805 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:54:28.997674 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:54:29.115109 tst ping_idle_ping.py:24: start network... 20:54:29.322292 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:54:29.815285 run create_hlr_db(pid=26519): Launched 20:54:29.942527 bus /gobi_6: Setting Powered False 20:54:31.019919 run create_hlr_db(pid=26519): Terminated: ok {rc=0} 20:54:31.469816 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26521): Launched 20:54:31.802148 run osmo-hlr_10.42.42.2(pid=26522): Launched 20:54:31.990856 run osmo-stp_10.42.42.5: Starting osmo-stp 20:54:32.639390 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26524): Launched 20:54:32.974858 run osmo-stp_10.42.42.5(pid=26525): Launched 20:54:33.103962 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:54:33.680795 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26527): Launched 20:54:33.808491 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:54:34.091012 run patchelf(pid=26528): Launched 20:54:34.277615 run osmo-stp_10.42.42.5(pid=26525): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26525)] 20:54:34.419532 run osmo-stp_10.42.42.5(pid=26525): stdout: | (launched: 2022-12-12_20:54:32.914503) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:54:34.566660 run osmo-stp_10.42.42.5(pid=26525): stderr: | 20221212205433105 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205433105 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205433106 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205433106 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205433106 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205433106 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205433107 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:54:34.709823 run osmo-stp_10.42.42.5(pid=26525): stdout: | (launched: 2022-12-12_20:54:32.914503) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:54:34.846380 run osmo-stp_10.42.42.5(pid=26525): stderr: | 20221212205433105 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205433105 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205433106 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205433106 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205433106 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205433106 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205433107 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:54:35.008200 run patchelf(pid=26528): Terminating (SIGINT) 20:54:35.194469 run patchelf(pid=26528): Terminated: ok {rc=0} 20:54:35.330022 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=26525): Process ended prematurely: osmo-stp_10.42.42.5(pid=26525) [trial-2382↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26525)] [trial-2382↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 20:54:35.339781 tst ping_idle_ping.py:27: Test FAILED (7.0 sec) 20:54:35.369534 run osmo-hlr_10.42.42.2(pid=26522): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26522)] 20:54:35.422935 run osmo-hlr_10.42.42.2(pid=26522): stdout: | (launched: 2022-12-12_20:54:31.743689) 20:54:35.477629 run osmo-hlr_10.42.42.2(pid=26522): stderr: | 20221212205432092 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212205432092 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212205432092 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212205432092 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212205432101 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212205432101 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212205432115 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:oc2g+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212205432131 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212205432132 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212205432132 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:54:35.532766 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26521): Terminating (SIGTERM) 20:54:35.576639 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26524): Terminating (SIGTERM) 20:54:35.620543 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26527): Terminating (SIGTERM) 20:54:35.664783 --- ParallelTerminationStrategy: PID 26521 died... 20:54:35.685562 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26521): Terminated: ok {rc=0} 20:54:35.735010 --- ParallelTerminationStrategy: PID 26524 died... 20:54:35.755000 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26524): Terminated: ok {rc=0} 20:54:35.804225 --- ParallelTerminationStrategy: PID 26527 died... 20:54:35.824378 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26527): Terminated: ok {rc=0} 20:54:35.917175 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2382 gprs:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 20:54:37.208599 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:54:37.215458 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 20:54:37.236441 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 20:54:37.271596 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 20:54:37.325587 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 20:54:37.346947 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 20:54:37.381491 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 20:54:37.937850 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2382 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 20:54:37.943161 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:54:37.954660 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 20:54:38.011567 tst switch_tch_pdch.py: using LAC 31441 20:54:38.135146 tst switch_tch_pdch.py: using RAC 76 20:54:38.258576 tst switch_tch_pdch.py: using CellId 31441 20:54:38.382870 tst switch_tch_pdch.py: using BVCI 31442 20:54:38.497731 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:54:38.509140 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:54:38.520067 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:54:38.531269 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:54:38.542416 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:54:38.553611 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:54:38.564904 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:54:38.576101 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:54:38.699135 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:54:38.818413 tst switch_tch_pdch.py:51: start network... 20:54:39.025654 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:54:39.506341 run create_hlr_db(pid=26533): Launched 20:54:39.633479 bus /gobi_6: Setting Powered False 20:54:40.694917 run create_hlr_db(pid=26533): Terminated: ok {rc=0} 20:54:41.126510 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26535): Launched 20:54:41.436524 run osmo-hlr_10.42.42.2(pid=26536): Launched 20:54:41.553933 run osmo-stp_10.42.42.5: Starting osmo-stp 20:54:42.104511 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26538): Launched 20:54:42.414098 run osmo-stp_10.42.42.5(pid=26539): Launched 20:54:42.531620 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:54:43.065926 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26541): Launched 20:54:43.183497 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:54:43.445533 run patchelf(pid=26542): Launched 20:54:43.617965 run osmo-stp_10.42.42.5(pid=26539): ERR: Terminated: ERROR {rc=1} [trial-2382↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26539)] 20:54:43.749444 run osmo-stp_10.42.42.5(pid=26539): stdout: | (launched: 2022-12-12_20:54:42.357368) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:54:43.882776 run osmo-stp_10.42.42.5(pid=26539): stderr: | 20221212205442529 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205442529 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205442529 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205442530 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205442530 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205442530 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205442530 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:54:44.015721 run osmo-stp_10.42.42.5(pid=26539): stdout: | (launched: 2022-12-12_20:54:42.357368) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:54:44.143361 run osmo-stp_10.42.42.5(pid=26539): stderr: | 20221212205442529 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205442529 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205442529 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205442530 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205442530 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205442530 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205442530 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:54:44.294765 run patchelf(pid=26542): Terminating (SIGINT) 20:54:44.469864 run patchelf(pid=26542): Terminated: ok {rc=0} 20:54:44.596159 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=26539): Process ended prematurely: osmo-stp_10.42.42.5(pid=26539) [trial-2382↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26539)] [trial-2382↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 20:54:44.605179 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 20:54:44.632109 run osmo-hlr_10.42.42.2(pid=26536): ERR: Terminated: ERROR {rc=237} [trial-2382↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26536)] 20:54:44.680842 run osmo-hlr_10.42.42.2(pid=26536): stdout: | (launched: 2022-12-12_20:54:41.379527) 20:54:44.731308 run osmo-hlr_10.42.42.2(pid=26536): stderr: | 20221212205441557 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212205441557 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212205441557 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212205441557 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212205441557 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212205441557 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212205441569 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212205441578 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212205441579 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212205441579 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:54:44.782210 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26535): Terminating (SIGTERM) 20:54:44.822608 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26538): Terminating (SIGTERM) 20:54:44.863132 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26541): Terminating (SIGTERM) 20:54:44.903644 --- ParallelTerminationStrategy: PID 26535 died... 20:54:44.923200 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26535): Terminated: ok {rc=0} 20:54:44.968118 --- ParallelTerminationStrategy: PID 26538 died... 20:54:44.987077 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26538): Terminated: ok {rc=0} 20:54:45.031689 --- ParallelTerminationStrategy: PID 26541 died... 20:54:45.051092 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26541): Terminated: ok {rc=0} 20:54:45.137884 bus /gobi_0: Setting Powered False 20:54:46.248236 bus /gobi_0: Setting Powered False 20:54:47.376152 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2382 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 dynts:oc2g+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 20:54:48.618985 tst dynts:oc2g+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:54:48.625482 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 20:54:48.647956 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 20:54:48.684451 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 20:54:48.739479 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 20:54:48.760331 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 20:54:48.795052 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 20:54:49.352098 tst dynts:oc2g+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2382 dynts:oc2g+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 20:54:49.357716 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:54:49.369302 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 20:54:49.429259 tst switch_tch_pdch.py: using LAC 31442 20:54:49.560096 tst switch_tch_pdch.py: using RAC 77 20:54:49.692781 tst switch_tch_pdch.py: using CellId 31442 20:54:49.826034 tst switch_tch_pdch.py: using BVCI 31443 20:54:49.948462 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:54:49.960070 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:54:49.971366 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:54:49.982909 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:54:49.994387 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:54:50.005936 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:54:50.017754 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:54:50.029236 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 20:54:50.148293 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 20:54:50.267562 tst switch_tch_pdch.py:51: start network... 20:54:50.477013 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:54:50.932227 run create_hlr_db(pid=26546): Launched 20:54:51.059089 bus /gobi_6: Setting Powered False 20:54:52.120078 run create_hlr_db(pid=26546): Terminated: ok {rc=0} 20:54:52.544538 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26548): Launched 20:54:52.876743 run osmo-hlr_10.42.42.2(pid=26549): Launched 20:54:53.004762 run osmo-stp_10.42.42.5: Starting osmo-stp 20:54:53.545976 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26551): Launched 20:54:53.877505 run osmo-stp_10.42.42.5(pid=26552): Launched 20:54:54.005095 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:54:54.547515 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26554): Launched 20:54:54.675747 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:54:54.956297 run patchelf(pid=26555): Launched 20:54:55.140769 run osmo-stp_10.42.42.5(pid=26552): ERR: Terminated: ERROR {rc=1} [trial-2382↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26552)] 20:54:55.281601 run osmo-stp_10.42.42.5(pid=26552): stdout: | (launched: 2022-12-12_20:54:53.816176) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:54:55.423638 run osmo-stp_10.42.42.5(pid=26552): stderr: | 20221212205454007 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205454008 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205454008 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205454008 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205454009 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205454009 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205454009 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:54:55.565446 run osmo-stp_10.42.42.5(pid=26552): stdout: | (launched: 2022-12-12_20:54:53.816176) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:54:55.701628 run osmo-stp_10.42.42.5(pid=26552): stderr: | 20221212205454007 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205454008 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205454008 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205454008 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205454009 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205454009 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205454009 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:54:55.863074 run patchelf(pid=26555): Terminating (SIGINT) 20:54:56.048654 run patchelf(pid=26555): Terminated: ok {rc=0} 20:54:56.183003 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=26552): Process ended prematurely: osmo-stp_10.42.42.5(pid=26552) [trial-2382↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26552)] [trial-2382↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 20:54:56.192756 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 20:54:56.222359 run osmo-hlr_10.42.42.2(pid=26549): ERR: Terminated: ERROR {rc=237} [trial-2382↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26549)] 20:54:56.274402 run osmo-hlr_10.42.42.2(pid=26549): stdout: | (launched: 2022-12-12_20:54:52.815604) 20:54:56.328090 run osmo-hlr_10.42.42.2(pid=26549): stderr: | 20221212205453014 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212205453014 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212205453014 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212205453014 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212205453014 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212205453014 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212205453074 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/dynts:oc2g+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212205453084 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212205453084 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212205453084 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:54:56.382206 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26548): Terminating (SIGTERM) 20:54:56.425683 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26551): Terminating (SIGTERM) 20:54:56.469023 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26554): Terminating (SIGTERM) 20:54:56.512518 --- ParallelTerminationStrategy: PID 26548 died... 20:54:56.533198 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26548): Terminated: ok {rc=0} 20:54:56.581350 --- ParallelTerminationStrategy: PID 26551 died... 20:54:56.601445 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26551): Terminated: ok {rc=0} 20:54:56.649431 --- ParallelTerminationStrategy: PID 26554 died... 20:54:56.669624 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26554): Terminated: ok {rc=0} 20:54:56.761906 bus /gobi_0: Setting Powered False 20:54:57.862888 bus /gobi_0: Setting Powered False 20:54:58.983604 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2382 dynts:oc2g+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 nitb_sms:trx-b200 --------------------------------------------------------------------- 20:55:00.223643 tst nitb_sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:55:00.227803 tst nitb_sms:trx-b200: Verifying 1 x bts (candidates: 11) 20:55:00.261110 tst nitb_sms:trx-b200: Verifying 1 x ip_address (candidates: 9) 20:55:00.267844 tst nitb_sms:trx-b200: Verifying 2 x modem (candidates: 12) 20:55:00.323985 tst nitb_sms:trx-b200: Reserving 1 x bts (candidates: 11) 20:55:00.357069 tst nitb_sms:trx-b200: Reserving 1 x ip_address (candidates: 9) 20:55:00.363681 tst nitb_sms:trx-b200: Reserving 2 x modem (candidates: 12) 20:55:00.931192 tst nitb_sms:trx-b200: RESERVED RESOURCES for nitb_sms: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 nitb_sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 20:55:00.936929 tst nitb_sms:trx-b200: Using 1 x ip_address (candidates: 1) 20:55:00.948716 tst nitb_sms:trx-b200: Using 1 x bts (candidates: 1) 20:55:01.004397 tst mo_mt_sms.py: using LAC 31443 20:55:01.139533 tst mo_mt_sms.py: using RAC 78 20:55:01.271889 tst mo_mt_sms.py: using CellId 31443 20:55:01.397327 tst mo_mt_sms.py: using BVCI 31444 20:55:01.513264 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 20:55:01.652925 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 20:55:01.784331 tst mo_mt_sms.py:9: start nitb and bts... 20:55:02.031593 run osmo-nitb_10.42.42.2: Starting osmo-nitb 20:55:02.672079 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26562): Launched 20:55:02.983074 run osmo-nitb_10.42.42.2(pid=26563): Launched 20:55:03.154923 run osmo-nitb_10.42.42.2(pid=26563): ERR: Terminated: ERROR {rc=2} [trial-2382↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26563)] 20:55:03.294259 run osmo-nitb_10.42.42.2(pid=26563): stdout: | (launched: 2022-12-12_20:55:02.926102) 20:55:03.434914 run osmo-nitb_10.42.42.2(pid=26563): stderr: | (launched: 2022-12-12_20:55:02.972380) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 20:55:03.575604 run osmo-nitb_10.42.42.2(pid=26563): stdout: | (launched: 2022-12-12_20:55:02.926102) 20:55:03.710801 run osmo-nitb_10.42.42.2(pid=26563): stderr: | (launched: 2022-12-12_20:55:02.972380) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7ff6b86c2268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=26563): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26563) [trial-2382↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26563)] 20:55:04.100671 tst osmo-nitb_10.42.42.2(pid=26563): stdout: | (launched: 2022-12-12_20:55:02.926102) 20:55:04.226360 tst osmo-nitb_10.42.42.2(pid=26563): stderr: | (launched: 2022-12-12_20:55:02.972380) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 20:55:04.374721 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=26563): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26563) [trial-2382↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26563)] [trial-2382↪nitb_sms:trx-b200↪mo_mt_sms.py:11] 20:55:04.383279 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 20:55:04.389875 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26562): Terminating (SIGTERM) 20:55:04.599321 --- ParallelTerminationStrategy: PID 26562 died... 20:55:04.620571 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26562): Terminated: ok {rc=0} 20:55:04.707898 bus /sierra_3: Setting Powered False 20:55:05.811189 bus /sierra_3: Setting Powered False 20:55:06.929930 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 nitb_sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 sms:trx-b200 --------------------------------------------------------------------- 20:55:08.129769 tst sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:55:08.133772 tst sms:trx-b200: Verifying 1 x bts (candidates: 11) 20:55:08.167089 tst sms:trx-b200: Verifying 6 x ip_address (candidates: 9) 20:55:08.193760 tst sms:trx-b200: Verifying 2 x modem (candidates: 12) 20:55:08.245881 tst sms:trx-b200: Reserving 1 x bts (candidates: 11) 20:55:08.279619 tst sms:trx-b200: Reserving 6 x ip_address (candidates: 9) 20:55:08.306629 tst sms:trx-b200: Reserving 2 x modem (candidates: 12) 20:55:08.852011 tst sms:trx-b200: RESERVED RESOURCES for sms: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 20:55:08.858569 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 20:55:08.870503 tst sms:trx-b200: Using 1 x bts (candidates: 1) 20:55:08.922419 tst mo_mt_sms.py: using LAC 31444 20:55:09.054330 tst mo_mt_sms.py: using RAC 79 20:55:09.186228 tst mo_mt_sms.py: using CellId 31444 20:55:09.317134 tst mo_mt_sms.py: using BVCI 31445 20:55:09.432372 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 20:55:09.443382 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 20:55:09.454118 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 20:55:09.465388 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 20:55:09.476604 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 20:55:09.487737 tst sms:trx-b200: Using 1 x modem (candidates: 2) 20:55:09.606822 tst sms:trx-b200: Using 1 x modem (candidates: 2) 20:55:09.729784 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:55:10.245663 run create_hlr_db(pid=26567): Launched 20:55:10.375948 bus /sierra_2: Setting Powered False 20:55:11.442198 run create_hlr_db(pid=26567): Terminated: ok {rc=0} 20:55:11.886763 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26569): Launched 20:55:12.197775 run osmo-hlr_10.42.42.2(pid=26570): Launched 20:55:12.316811 run osmo-stp_10.42.42.5: Starting osmo-stp 20:55:12.853975 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26572): Launched 20:55:13.162649 run osmo-stp_10.42.42.5(pid=26573): Launched 20:55:13.280693 run osmo-msc_10.42.42.6: Starting osmo-msc 20:55:13.839651 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26575): Launched 20:55:14.149171 run osmo-msc_10.42.42.6(pid=26576): Launched 20:55:14.322377 run osmo-stp_10.42.42.5(pid=26573): ERR: Terminated: ERROR {rc=1} [trial-2382↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26573)] 20:55:14.452556 run osmo-stp_10.42.42.5(pid=26573): stdout: | (launched: 2022-12-12_20:55:13.105973) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:55:14.583852 run osmo-stp_10.42.42.5(pid=26573): stderr: | 20221212205513274 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205513275 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205513275 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205513275 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205513276 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205513276 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205513276 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:55:14.713157 run osmo-stp_10.42.42.5(pid=26573): stdout: | (launched: 2022-12-12_20:55:13.105973) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:55:14.835760 run osmo-stp_10.42.42.5(pid=26573): stderr: | 20221212205513274 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205513275 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205513275 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205513275 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205513276 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205513276 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205513276 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:55:14.982451 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=26573): Process ended prematurely: osmo-stp_10.42.42.5(pid=26573) [trial-2382↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26573)] [trial-2382↪sms:trx-b200↪mo_mt_sms.py:16] 20:55:14.990955 tst mo_mt_sms.py:16: Test FAILED (6.1 sec) 20:55:15.017304 run osmo-hlr_10.42.42.2(pid=26570): ERR: Terminated: ERROR {rc=237} [trial-2382↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26570)] 20:55:15.066307 run osmo-hlr_10.42.42.2(pid=26570): stdout: | (launched: 2022-12-12_20:55:12.140858) 20:55:15.117300 run osmo-hlr_10.42.42.2(pid=26570): stderr: | 20221212205512318 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212205512318 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212205512318 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212205512318 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212205512318 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212205512319 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212205512331 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/sms:trx-b200/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212205512342 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212205512342 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212205512342 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:55:15.188141 run osmo-msc_10.42.42.6(pid=26576): ERR: Terminated: ERROR {rc=2} [trial-2382↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26576)] 20:55:15.237336 run osmo-msc_10.42.42.6(pid=26576): stdout: | (launched: 2022-12-12_20:55:14.092404) 20:55:15.287879 run osmo-msc_10.42.42.6(pid=26576): stderr: | 20221212205514364 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212205514364 DLGLOBAL DEBUG validating counter group 0x7f0c28f8fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212205514364 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212205514364 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212205514365 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212205514365 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212205514366 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212205514367 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212205514367 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212205514367 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:55:15.338858 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26569): Terminating (SIGTERM) 20:55:15.379669 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26572): Terminating (SIGTERM) 20:55:15.420707 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26575): Terminating (SIGTERM) 20:55:15.461915 --- ParallelTerminationStrategy: PID 26569 died... 20:55:15.481669 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26569): Terminated: ok {rc=0} 20:55:15.527079 --- ParallelTerminationStrategy: PID 26572 died... 20:55:15.546375 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26572): Terminated: ok {rc=0} 20:55:15.591553 --- ParallelTerminationStrategy: PID 26575 died... 20:55:15.610871 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26575): Terminated: ok {rc=0} 20:55:15.699691 bus /sierra_3: Setting Powered False 20:55:16.803416 bus /sierra_3: Setting Powered False 20:55:17.921992 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 nitb_ussd:trx-b200 --------------------------------------------------------------------- 20:55:19.156144 tst nitb_ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:55:19.160424 tst nitb_ussd:trx-b200: Verifying 1 x bts (candidates: 11) 20:55:19.197919 tst nitb_ussd:trx-b200: Verifying 1 x ip_address (candidates: 9) 20:55:19.204538 tst nitb_ussd:trx-b200: Verifying 1 x modem (candidates: 12) 20:55:19.239436 tst nitb_ussd:trx-b200: Reserving 1 x bts (candidates: 11) 20:55:19.273120 tst nitb_ussd:trx-b200: Reserving 1 x ip_address (candidates: 9) 20:55:19.279927 tst nitb_ussd:trx-b200: Reserving 1 x modem (candidates: 12) 20:55:19.799958 tst nitb_ussd:trx-b200: RESERVED RESOURCES for nitb_ussd: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2382 nitb_ussd:trx-b200 assert_extension.py ---------------------------------------------- 20:55:19.804843 tst nitb_ussd:trx-b200: Using 1 x ip_address (candidates: 1) 20:55:19.816013 tst nitb_ussd:trx-b200: Using 1 x bts (candidates: 1) 20:55:19.865513 tst assert_extension.py: using LAC 31445 20:55:19.987820 tst assert_extension.py: using RAC 80 20:55:20.111605 tst assert_extension.py: using CellId 31445 20:55:20.236883 tst assert_extension.py: using BVCI 31446 20:55:20.359635 tst nitb_ussd:trx-b200: Using 1 x modem (candidates: 1) 20:55:20.477097 tst assert_extension.py:10: start nitb and bts... 20:55:20.684410 run osmo-nitb_10.42.42.2: Starting osmo-nitb 20:55:21.316278 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26581): Launched 20:55:21.623726 run osmo-nitb_10.42.42.2(pid=26582): Launched 20:55:21.794755 run osmo-nitb_10.42.42.2(pid=26582): ERR: Terminated: ERROR {rc=2} [trial-2382↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26582)] 20:55:21.933387 run osmo-nitb_10.42.42.2(pid=26582): stdout: | (launched: 2022-12-12_20:55:21.567272) 20:55:22.073689 run osmo-nitb_10.42.42.2(pid=26582): stderr: | (launched: 2022-12-12_20:55:21.613051) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 20:55:22.213886 run osmo-nitb_10.42.42.2(pid=26582): stdout: | (launched: 2022-12-12_20:55:21.567272) 20:55:22.348269 run osmo-nitb_10.42.42.2(pid=26582): stderr: | (launched: 2022-12-12_20:55:21.613051) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7ff6b86c2268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=26582): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26582) [trial-2382↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26582)] 20:55:22.740488 tst osmo-nitb_10.42.42.2(pid=26582): stdout: | (launched: 2022-12-12_20:55:21.567272) 20:55:22.865641 tst osmo-nitb_10.42.42.2(pid=26582): stderr: | (launched: 2022-12-12_20:55:21.613051) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 20:55:23.014394 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=26582): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26582) [trial-2382↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26582)] [trial-2382↪nitb_ussd:trx-b200↪assert_extension.py:12] 20:55:23.023079 tst assert_extension.py:12: Test FAILED (3.2 sec) 20:55:23.029871 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26581): Terminating (SIGTERM) 20:55:23.239402 --- ParallelTerminationStrategy: PID 26581 died... 20:55:23.260723 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26581): Terminated: ok {rc=0} 20:55:23.348307 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 nitb_ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 ussd:trx-b200 --------------------------------------------------------------------- 20:55:24.533441 tst ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:55:24.537838 tst ussd:trx-b200: Verifying 1 x bts (candidates: 11) 20:55:24.573461 tst ussd:trx-b200: Verifying 6 x ip_address (candidates: 9) 20:55:24.601353 tst ussd:trx-b200: Verifying 1 x modem (candidates: 12) 20:55:24.637710 tst ussd:trx-b200: Reserving 1 x bts (candidates: 11) 20:55:24.672205 tst ussd:trx-b200: Reserving 6 x ip_address (candidates: 9) 20:55:24.700079 tst ussd:trx-b200: Reserving 1 x modem (candidates: 12) 20:55:25.239388 tst ussd:trx-b200: RESERVED RESOURCES for ussd: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2382 ussd:trx-b200 assert_extension.py ---------------------------------------------- 20:55:25.244541 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 20:55:25.255533 tst ussd:trx-b200: Using 1 x bts (candidates: 1) 20:55:25.306454 tst assert_extension.py: using LAC 31446 20:55:25.427732 tst assert_extension.py: using RAC 81 20:55:25.549559 tst assert_extension.py: using CellId 31446 20:55:25.669342 tst assert_extension.py: using BVCI 31447 20:55:25.782023 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 20:55:25.792832 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 20:55:25.803646 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 20:55:25.814561 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 20:55:25.825573 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 20:55:25.836370 tst ussd:trx-b200: Using 1 x modem (candidates: 1) 20:55:25.951488 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:55:26.431601 run create_hlr_db(pid=26586): Launched 20:55:26.558453 bus /sierra_2: Setting Powered False 20:55:27.619606 run create_hlr_db(pid=26586): Terminated: ok {rc=0} 20:55:28.071456 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26588): Launched 20:55:28.405327 run osmo-hlr_10.42.42.2(pid=26589): Launched 20:55:28.532308 run osmo-stp_10.42.42.5: Starting osmo-stp 20:55:29.107162 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26591): Launched 20:55:29.441088 run osmo-stp_10.42.42.5(pid=26592): Launched 20:55:29.567523 run osmo-msc_10.42.42.6: Starting osmo-msc 20:55:30.167173 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26594): Launched 20:55:30.498499 run osmo-msc_10.42.42.6(pid=26595): Launched 20:55:30.685845 run osmo-stp_10.42.42.5(pid=26592): ERR: Terminated: ERROR {rc=1} [trial-2382↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26592)] 20:55:30.825811 run osmo-stp_10.42.42.5(pid=26592): stdout: | (launched: 2022-12-12_20:55:29.380235) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:55:31.083684 run osmo-stp_10.42.42.5(pid=26592): stderr: | 20221212205529573 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205529573 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205529573 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205529574 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205529574 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205529574 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205529574 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:55:31.228387 run osmo-stp_10.42.42.5(pid=26592): stdout: | (launched: 2022-12-12_20:55:29.380235) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:55:31.365035 run osmo-stp_10.42.42.5(pid=26592): stderr: | 20221212205529573 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205529573 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205529573 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205529574 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205529574 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205529574 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205529574 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:55:31.527292 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=26592): Process ended prematurely: osmo-stp_10.42.42.5(pid=26592) [trial-2382↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26592)] [trial-2382↪ussd:trx-b200↪assert_extension.py:17] 20:55:31.537424 tst assert_extension.py:17: Test FAILED (6.3 sec) 20:55:31.568073 run osmo-hlr_10.42.42.2(pid=26589): ERR: Terminated: ERROR {rc=237} [trial-2382↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26589)] 20:55:31.623721 run osmo-hlr_10.42.42.2(pid=26589): stdout: | (launched: 2022-12-12_20:55:28.344770) 20:55:31.680546 run osmo-hlr_10.42.42.2(pid=26589): stderr: | 20221212205528544 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212205528544 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212205528544 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212205528544 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212205528544 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212205528544 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212205528557 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/ussd:trx-b200/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212205528565 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212205528566 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212205528566 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:55:31.759051 run osmo-msc_10.42.42.6(pid=26595): ERR: Terminated: ERROR {rc=2} [trial-2382↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26595)] 20:55:31.813319 run osmo-msc_10.42.42.6(pid=26595): stdout: | (launched: 2022-12-12_20:55:30.438151) 20:55:31.869345 run osmo-msc_10.42.42.6(pid=26595): stderr: | 20221212205530757 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212205530757 DLGLOBAL DEBUG validating counter group 0x7fe264f7dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212205530757 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212205530757 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212205530757 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212205530757 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212205530759 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212205530759 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212205530760 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212205530760 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:55:31.927255 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26588): Terminating (SIGTERM) 20:55:31.972624 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26591): Terminating (SIGTERM) 20:55:32.018392 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26594): Terminating (SIGTERM) 20:55:32.065050 --- ParallelTerminationStrategy: PID 26588 died... 20:55:32.086463 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26588): Terminated: ok {rc=0} 20:55:32.137267 --- ParallelTerminationStrategy: PID 26591 died... 20:55:32.158317 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26591): Terminated: ok {rc=0} 20:55:32.207860 --- ParallelTerminationStrategy: PID 26594 died... 20:55:32.227923 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26594): Terminated: ok {rc=0} 20:55:32.318575 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 20:55:33.539495 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:55:33.546630 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 20:55:33.581629 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 20:55:33.609239 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 20:55:33.662865 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 20:55:33.697592 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 20:55:33.724832 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 20:55:34.276740 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 20:55:34.332128 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:55:34.343877 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 20:55:34.416274 tst mo_mt_call.py: using LAC 31447 20:55:34.549381 tst mo_mt_call.py: using RAC 82 20:55:34.681858 tst mo_mt_call.py: using CellId 31447 20:55:34.810884 tst mo_mt_call.py: using BVCI 31448 20:55:34.926109 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:55:34.937570 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:55:34.948865 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:55:34.960035 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:55:34.971209 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:55:34.982176 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 20:55:35.103161 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 20:55:35.221476 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:55:35.706739 run create_hlr_db(pid=26600): Launched 20:55:35.837086 bus /sierra_2: Setting Powered False 20:55:36.898374 run create_hlr_db(pid=26600): Terminated: ok {rc=0} 20:55:37.357499 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26602): Launched 20:55:37.696014 run osmo-hlr_10.42.42.2(pid=26603): Launched 20:55:37.824034 run osmo-stp_10.42.42.5: Starting osmo-stp 20:55:38.406942 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26605): Launched 20:55:38.744864 run osmo-stp_10.42.42.5(pid=26606): Launched 20:55:38.874248 run osmo-msc_10.42.42.6: Starting osmo-msc 20:55:39.482720 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26608): Launched 20:55:39.821186 run osmo-msc_10.42.42.6(pid=26609): Launched 20:55:40.009365 run osmo-stp_10.42.42.5(pid=26606): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26606)] 20:55:40.151295 run osmo-stp_10.42.42.5(pid=26606): stdout: | (launched: 2022-12-12_20:55:38.683475) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:55:40.293815 run osmo-stp_10.42.42.5(pid=26606): stderr: | 20221212205538876 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205538876 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205538876 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205538877 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205538877 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205538877 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205538877 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:55:40.435023 run osmo-stp_10.42.42.5(pid=26606): stdout: | (launched: 2022-12-12_20:55:38.683475) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:55:40.569880 run osmo-stp_10.42.42.5(pid=26606): stderr: | 20221212205538876 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205538876 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205538876 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205538877 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205538877 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205538877 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205538877 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:55:40.731013 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26606): Process ended prematurely: osmo-stp_10.42.42.5(pid=26606) [trial-2382↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26606)] [trial-2382↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 20:55:40.740655 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 20:55:40.769569 run osmo-hlr_10.42.42.2(pid=26603): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26603)] 20:55:40.821967 run osmo-hlr_10.42.42.2(pid=26603): stdout: | (launched: 2022-12-12_20:55:37.634187) 20:55:40.876120 run osmo-hlr_10.42.42.2(pid=26603): stderr: | 20221212205537832 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212205537832 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212205537832 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212205537832 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212205537832 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212205537832 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212205537844 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212205537853 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212205537853 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212205537853 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:55:40.951410 run osmo-msc_10.42.42.6(pid=26609): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26609)] 20:55:41.003860 run osmo-msc_10.42.42.6(pid=26609): stdout: | (launched: 2022-12-12_20:55:39.759434) 20:55:41.058088 run osmo-msc_10.42.42.6(pid=26609): stderr: | 20221212205540086 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212205540086 DLGLOBAL DEBUG validating counter group 0x7fcd996f4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212205540086 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212205540086 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212205540087 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212205540087 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212205540088 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212205540089 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212205540089 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212205540089 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:55:41.112675 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26602): Terminating (SIGTERM) 20:55:41.156299 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26605): Terminating (SIGTERM) 20:55:41.200081 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26608): Terminating (SIGTERM) 20:55:41.243670 --- ParallelTerminationStrategy: PID 26602 died... 20:55:41.264711 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26602): Terminated: ok {rc=0} 20:55:41.313254 --- ParallelTerminationStrategy: PID 26605 died... 20:55:41.333468 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26605): Terminated: ok {rc=0} 20:55:41.381768 --- ParallelTerminationStrategy: PID 26608 died... 20:55:41.401967 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26608): Terminated: ok {rc=0} 20:55:41.492531 bus /sierra_3: Setting Powered False 20:55:42.590925 bus /sierra_3: Setting Powered False 20:55:43.708758 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2382 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 20:55:44.858048 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:55:44.870010 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 20:55:44.939960 tst mo_mt_call_osmux.py: using LAC 31448 20:55:45.063629 tst mo_mt_call_osmux.py: using RAC 83 20:55:45.188887 tst mo_mt_call_osmux.py: using CellId 31448 20:55:45.318417 tst mo_mt_call_osmux.py: using BVCI 31449 20:55:45.434322 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:55:45.445634 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:55:45.456545 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:55:45.467503 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:55:45.478579 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:55:45.489545 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 20:55:45.610742 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 20:55:45.735048 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:55:46.273633 run create_hlr_db(pid=26611): Launched 20:55:46.441794 bus /sierra_2: Setting Powered False 20:55:47.508658 run create_hlr_db(pid=26611): Terminated: ok {rc=0} 20:55:47.957687 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26613): Launched 20:55:48.273769 run osmo-hlr_10.42.42.2(pid=26614): Launched 20:55:48.404517 run osmo-stp_10.42.42.5: Starting osmo-stp 20:55:48.986287 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26616): Launched 20:55:49.323774 run osmo-stp_10.42.42.5(pid=26617): Launched 20:55:49.453950 run osmo-msc_10.42.42.6: Starting osmo-msc 20:55:50.062153 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26619): Launched 20:55:50.401142 run osmo-msc_10.42.42.6(pid=26620): Launched 20:55:50.587756 run osmo-stp_10.42.42.5(pid=26617): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26617)] 20:55:50.729985 run osmo-stp_10.42.42.5(pid=26617): stdout: | (launched: 2022-12-12_20:55:49.262362) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:55:50.872400 run osmo-stp_10.42.42.5(pid=26617): stderr: | 20221212205549456 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205549456 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205549456 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205549456 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205549457 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205549457 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205549457 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:55:51.012471 run osmo-stp_10.42.42.5(pid=26617): stdout: | (launched: 2022-12-12_20:55:49.262362) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:55:51.146662 run osmo-stp_10.42.42.5(pid=26617): stderr: | 20221212205549456 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205549456 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205549456 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205549456 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205549457 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205549457 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205549457 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:55:51.307620 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26617): Process ended prematurely: osmo-stp_10.42.42.5(pid=26617) [trial-2382↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26617)] [trial-2382↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 20:55:51.317444 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 20:55:51.346467 run osmo-hlr_10.42.42.2(pid=26614): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26614)] 20:55:51.398502 run osmo-hlr_10.42.42.2(pid=26614): stdout: | (launched: 2022-12-12_20:55:48.215990) 20:55:51.452813 run osmo-hlr_10.42.42.2(pid=26614): stderr: | 20221212205548414 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212205548414 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212205548414 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212205548414 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212205548414 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212205548414 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212205548429 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212205548438 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212205548438 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212205548438 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:55:51.527771 run osmo-msc_10.42.42.6(pid=26620): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26620)] 20:55:51.579496 run osmo-msc_10.42.42.6(pid=26620): stdout: | (launched: 2022-12-12_20:55:50.339743) 20:55:51.633161 run osmo-msc_10.42.42.6(pid=26620): stderr: | 20221212205550663 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212205550663 DLGLOBAL DEBUG validating counter group 0x7fe93cc5dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212205550663 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212205550663 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212205550663 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212205550664 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212205550665 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212205550666 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212205550666 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212205550666 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:55:51.687079 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26613): Terminating (SIGTERM) 20:55:51.730451 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26616): Terminating (SIGTERM) 20:55:51.773773 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26619): Terminating (SIGTERM) 20:55:51.817427 --- ParallelTerminationStrategy: PID 26613 died... 20:55:51.837943 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26613): Terminated: ok {rc=0} 20:55:51.885918 --- ParallelTerminationStrategy: PID 26616 died... 20:55:51.905865 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26616): Terminated: ok {rc=0} 20:55:51.953470 --- ParallelTerminationStrategy: PID 26619 died... 20:55:51.973481 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26619): Terminated: ok {rc=0} 20:55:52.063164 bus /sierra_3: Setting Powered False 20:55:53.164705 bus /sierra_3: Setting Powered False 20:55:54.286036 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 20:55:55.540518 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:55:55.547201 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 20:55:55.580654 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 20:55:55.607385 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 20:55:55.664186 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 20:55:55.699221 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 20:55:55.725937 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 20:55:56.269317 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 20:55:56.319966 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:55:56.331343 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 20:55:56.399591 tst mo_mt_call.py: using LAC 31449 20:55:56.521138 tst mo_mt_call.py: using RAC 84 20:55:56.642449 tst mo_mt_call.py: using CellId 31449 20:55:56.766708 tst mo_mt_call.py: using BVCI 31450 20:55:56.882436 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:55:56.893671 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:55:56.904618 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:55:56.915549 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:55:56.926578 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:55:56.937544 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 20:55:57.058048 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 20:55:57.180725 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:55:57.703931 run create_hlr_db(pid=26626): Launched 20:55:57.834320 bus /sierra_2: Setting Powered False 20:55:58.900753 run create_hlr_db(pid=26626): Terminated: ok {rc=0} 20:55:59.350803 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26628): Launched 20:55:59.668302 run osmo-hlr_10.42.42.2(pid=26629): Launched 20:55:59.789447 run osmo-stp_10.42.42.5: Starting osmo-stp 20:56:00.345558 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26631): Launched 20:56:00.661176 run osmo-stp_10.42.42.5(pid=26632): Launched 20:56:00.783864 run osmo-msc_10.42.42.6: Starting osmo-msc 20:56:01.490483 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26634): Launched 20:56:01.829874 run osmo-msc_10.42.42.6(pid=26635): Launched 20:56:02.073352 run osmo-stp_10.42.42.5(pid=26632): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26632)] 20:56:02.354616 run osmo-stp_10.42.42.5(pid=26632): stdout: | (launched: 2022-12-12_20:56:00.603257) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:56:02.498452 run osmo-stp_10.42.42.5(pid=26632): stderr: | 20221212205600776 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205600776 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205600776 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205600777 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205600777 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205600777 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205600777 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:56:02.641201 run osmo-stp_10.42.42.5(pid=26632): stdout: | (launched: 2022-12-12_20:56:00.603257) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:56:02.776559 run osmo-stp_10.42.42.5(pid=26632): stderr: | 20221212205600776 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205600776 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205600776 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205600777 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205600777 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205600777 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205600777 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:56:02.937848 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26632): Process ended prematurely: osmo-stp_10.42.42.5(pid=26632) [trial-2382↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26632)] [trial-2382↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 20:56:02.947893 tst mo_mt_call.py:8: Test FAILED (6.7 sec) 20:56:02.978187 run osmo-hlr_10.42.42.2(pid=26629): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26629)] 20:56:03.031740 run osmo-hlr_10.42.42.2(pid=26629): stdout: | (launched: 2022-12-12_20:55:59.610640) 20:56:03.086431 run osmo-hlr_10.42.42.2(pid=26629): stderr: | 20221212205559787 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212205559787 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212205559787 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212205559787 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212205559787 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212205559787 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212205559799 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212205559808 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212205559808 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212205559808 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:56:03.162235 run osmo-msc_10.42.42.6(pid=26635): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26635)] 20:56:03.215148 run osmo-msc_10.42.42.6(pid=26635): stdout: | (launched: 2022-12-12_20:56:01.767716) 20:56:03.270155 run osmo-msc_10.42.42.6(pid=26635): stderr: | 20221212205602288 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212205602288 DLGLOBAL DEBUG validating counter group 0x7f8876a42c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212205602289 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212205602289 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212205602289 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212205602289 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212205602291 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212205602291 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212205602291 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212205602291 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:56:03.325761 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26628): Terminating (SIGTERM) 20:56:03.369980 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26631): Terminating (SIGTERM) 20:56:03.414436 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26634): Terminating (SIGTERM) 20:56:03.458714 --- ParallelTerminationStrategy: PID 26628 died... 20:56:03.479343 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26628): Terminated: ok {rc=0} 20:56:03.529219 --- ParallelTerminationStrategy: PID 26631 died... 20:56:03.549851 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26631): Terminated: ok {rc=0} 20:56:03.599694 --- ParallelTerminationStrategy: PID 26634 died... 20:56:03.620106 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26634): Terminated: ok {rc=0} 20:56:03.711871 bus /sierra_3: Setting Powered False 20:56:04.813211 bus /sierra_3: Setting Powered False 20:56:05.933037 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2382 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 20:56:07.085789 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:56:07.098472 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 20:56:07.175282 tst mo_mt_call_osmux.py: using LAC 31450 20:56:07.306948 tst mo_mt_call_osmux.py: using RAC 85 20:56:07.437699 tst mo_mt_call_osmux.py: using CellId 31450 20:56:07.563509 tst mo_mt_call_osmux.py: using BVCI 31451 20:56:07.680412 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:56:07.691866 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:56:07.702945 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:56:07.714211 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:56:07.725476 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:56:07.736436 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 20:56:07.854267 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 20:56:07.978580 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:56:08.502182 run create_hlr_db(pid=26637): Launched 20:56:08.633808 bus /sierra_2: Setting Powered False 20:56:09.700792 run create_hlr_db(pid=26637): Terminated: ok {rc=0} 20:56:10.168789 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26639): Launched 20:56:10.507403 run osmo-hlr_10.42.42.2(pid=26640): Launched 20:56:10.637048 run osmo-stp_10.42.42.5: Starting osmo-stp 20:56:11.216019 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26642): Launched 20:56:11.553987 run osmo-stp_10.42.42.5(pid=26643): Launched 20:56:11.682966 run osmo-msc_10.42.42.6: Starting osmo-msc 20:56:12.299724 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26645): Launched 20:56:12.639812 run osmo-msc_10.42.42.6(pid=26646): Launched 20:56:12.830359 run osmo-stp_10.42.42.5(pid=26643): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26643)] 20:56:12.973715 run osmo-stp_10.42.42.5(pid=26643): stdout: | (launched: 2022-12-12_20:56:11.492069) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:56:13.117237 run osmo-stp_10.42.42.5(pid=26643): stderr: | 20221212205611684 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205611684 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205611685 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205611686 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205611686 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205611686 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205611686 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:56:13.258323 run osmo-stp_10.42.42.5(pid=26643): stdout: | (launched: 2022-12-12_20:56:11.492069) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:56:13.393703 run osmo-stp_10.42.42.5(pid=26643): stderr: | 20221212205611684 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205611684 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205611685 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205611686 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205611686 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205611686 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205611686 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:56:13.555249 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26643): Process ended prematurely: osmo-stp_10.42.42.5(pid=26643) [trial-2382↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26643)] [trial-2382↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 20:56:13.565130 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 20:56:13.594202 run osmo-hlr_10.42.42.2(pid=26640): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26640)] 20:56:13.646111 run osmo-hlr_10.42.42.2(pid=26640): stdout: | (launched: 2022-12-12_20:56:10.446207) 20:56:13.700038 run osmo-hlr_10.42.42.2(pid=26640): stderr: | 20221212205610645 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212205610645 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212205610646 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212205610646 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212205610646 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212205610646 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212205610658 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212205610669 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212205610669 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212205610669 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:56:13.774913 run osmo-msc_10.42.42.6(pid=26646): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26646)] 20:56:13.827314 run osmo-msc_10.42.42.6(pid=26646): stdout: | (launched: 2022-12-12_20:56:12.578208) 20:56:13.880938 run osmo-msc_10.42.42.6(pid=26646): stderr: | 20221212205612902 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212205612902 DLGLOBAL DEBUG validating counter group 0x7fc3c0a75c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212205612902 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212205612902 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212205612902 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212205612902 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212205612904 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212205612905 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212205612905 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212205612905 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:56:13.934926 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26639): Terminating (SIGTERM) 20:56:13.977946 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26642): Terminating (SIGTERM) 20:56:14.021366 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26645): Terminating (SIGTERM) 20:56:14.064544 --- ParallelTerminationStrategy: PID 26639 died... 20:56:14.085169 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26639): Terminated: ok {rc=0} 20:56:14.133233 --- ParallelTerminationStrategy: PID 26642 died... 20:56:14.153212 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26642): Terminated: ok {rc=0} 20:56:14.200713 --- ParallelTerminationStrategy: PID 26645 died... 20:56:14.220728 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26645): Terminated: ok {rc=0} 20:56:14.311541 bus /sierra_3: Setting Powered False 20:56:15.412396 bus /sierra_3: Setting Powered False 20:56:16.557588 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 20:56:17.812011 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:56:17.819337 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 20:56:17.854670 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 20:56:17.882487 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 20:56:17.936405 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 20:56:17.971676 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 20:56:17.999244 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 20:56:18.551453 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 20:56:18.606602 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:56:18.618370 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 20:56:18.689126 tst mo_mt_call.py: using LAC 31451 20:56:18.822820 tst mo_mt_call.py: using RAC 86 20:56:18.956472 tst mo_mt_call.py: using CellId 31451 20:56:19.089293 tst mo_mt_call.py: using BVCI 31452 20:56:19.212650 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:56:19.224464 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:56:19.236050 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:56:19.247899 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:56:19.259824 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:56:19.271936 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 20:56:19.395130 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 20:56:19.514240 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:56:20.006066 run create_hlr_db(pid=26651): Launched 20:56:20.135320 bus /sierra_2: Setting Powered False 20:56:21.198510 run create_hlr_db(pid=26651): Terminated: ok {rc=0} 20:56:21.657607 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26653): Launched 20:56:21.998809 run osmo-hlr_10.42.42.2(pid=26654): Launched 20:56:22.128933 run osmo-stp_10.42.42.5: Starting osmo-stp 20:56:22.719149 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26656): Launched 20:56:23.058869 run osmo-stp_10.42.42.5(pid=26657): Launched 20:56:23.187051 run osmo-msc_10.42.42.6: Starting osmo-msc 20:56:23.795982 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26659): Launched 20:56:24.133918 run osmo-msc_10.42.42.6(pid=26660): Launched 20:56:24.321741 run osmo-stp_10.42.42.5(pid=26657): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26657)] 20:56:24.468119 run osmo-stp_10.42.42.5(pid=26657): stdout: | (launched: 2022-12-12_20:56:22.996684) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:56:24.611189 run osmo-stp_10.42.42.5(pid=26657): stderr: | 20221212205623190 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205623190 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205623191 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205623191 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205623191 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205623192 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205623192 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:56:24.752336 run osmo-stp_10.42.42.5(pid=26657): stdout: | (launched: 2022-12-12_20:56:22.996684) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:56:24.887003 run osmo-stp_10.42.42.5(pid=26657): stderr: | 20221212205623190 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205623190 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205623191 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205623191 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205623191 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205623192 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205623192 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:56:25.048158 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26657): Process ended prematurely: osmo-stp_10.42.42.5(pid=26657) [trial-2382↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26657)] [trial-2382↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 20:56:25.057858 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 20:56:25.087247 run osmo-hlr_10.42.42.2(pid=26654): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26654)] 20:56:25.139484 run osmo-hlr_10.42.42.2(pid=26654): stdout: | (launched: 2022-12-12_20:56:21.937212) 20:56:25.193330 run osmo-hlr_10.42.42.2(pid=26654): stderr: | 20221212205622137 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212205622137 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212205622137 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212205622137 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212205622137 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212205622137 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212205622150 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212205622158 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212205622158 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212205622158 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:56:25.268095 run osmo-msc_10.42.42.6(pid=26660): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26660)] 20:56:25.319836 run osmo-msc_10.42.42.6(pid=26660): stdout: | (launched: 2022-12-12_20:56:24.071894) 20:56:25.373389 run osmo-msc_10.42.42.6(pid=26660): stderr: | 20221212205624395 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212205624395 DLGLOBAL DEBUG validating counter group 0x7f149b656c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212205624395 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212205624395 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212205624395 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212205624396 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212205624397 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212205624398 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212205624398 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212205624398 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:56:25.427486 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26653): Terminating (SIGTERM) 20:56:25.470515 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26656): Terminating (SIGTERM) 20:56:25.513626 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26659): Terminating (SIGTERM) 20:56:25.556835 --- ParallelTerminationStrategy: PID 26653 died... 20:56:25.577398 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26653): Terminated: ok {rc=0} 20:56:25.625394 --- ParallelTerminationStrategy: PID 26656 died... 20:56:25.645417 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26656): Terminated: ok {rc=0} 20:56:25.693435 --- ParallelTerminationStrategy: PID 26659 died... 20:56:25.713603 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26659): Terminated: ok {rc=0} 20:56:25.804637 bus /sierra_3: Setting Powered False 20:56:26.907168 bus /sierra_3: Setting Powered False 20:56:28.028561 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2382 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 20:56:29.180658 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:56:29.192603 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 20:56:29.262393 tst mo_mt_call_osmux.py: using LAC 31452 20:56:29.386564 tst mo_mt_call_osmux.py: using RAC 87 20:56:29.512213 tst mo_mt_call_osmux.py: using CellId 31452 20:56:29.641936 tst mo_mt_call_osmux.py: using BVCI 31453 20:56:29.757623 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:56:29.768852 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:56:29.780061 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:56:29.790944 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:56:29.802188 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:56:29.813257 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 20:56:29.931144 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 20:56:30.053335 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:56:30.578113 run create_hlr_db(pid=26662): Launched 20:56:30.707951 bus /sierra_2: Setting Powered False 20:56:31.786611 run create_hlr_db(pid=26662): Terminated: ok {rc=0} 20:56:32.325310 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26664): Launched 20:56:32.663027 run osmo-hlr_10.42.42.2(pid=26665): Launched 20:56:32.794121 run osmo-stp_10.42.42.5: Starting osmo-stp 20:56:33.376641 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26667): Launched 20:56:33.713520 run osmo-stp_10.42.42.5(pid=26668): Launched 20:56:33.843610 run osmo-msc_10.42.42.6: Starting osmo-msc 20:56:34.456780 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26670): Launched 20:56:34.794003 run osmo-msc_10.42.42.6(pid=26671): Launched 20:56:34.982336 run osmo-stp_10.42.42.5(pid=26668): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26668)] 20:56:35.125059 run osmo-stp_10.42.42.5(pid=26668): stdout: | (launched: 2022-12-12_20:56:33.651965) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:56:35.267921 run osmo-stp_10.42.42.5(pid=26668): stderr: | 20221212205633843 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205633843 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205633843 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205633843 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205633844 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205633844 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205633844 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:56:35.408330 run osmo-stp_10.42.42.5(pid=26668): stdout: | (launched: 2022-12-12_20:56:33.651965) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:56:35.542820 run osmo-stp_10.42.42.5(pid=26668): stderr: | 20221212205633843 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205633843 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205633843 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205633843 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205633844 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205633844 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205633844 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:56:35.703656 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26668): Process ended prematurely: osmo-stp_10.42.42.5(pid=26668) [trial-2382↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26668)] [trial-2382↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 20:56:35.713604 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 20:56:35.742376 run osmo-hlr_10.42.42.2(pid=26665): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26665)] 20:56:35.793902 run osmo-hlr_10.42.42.2(pid=26665): stdout: | (launched: 2022-12-12_20:56:32.601110) 20:56:35.847093 run osmo-hlr_10.42.42.2(pid=26665): stderr: | 20221212205632801 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212205632801 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212205632801 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212205632801 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212205632801 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212205632801 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212205632813 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212205632822 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212205632823 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212205632823 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:56:35.921103 run osmo-msc_10.42.42.6(pid=26671): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26671)] 20:56:35.972531 run osmo-msc_10.42.42.6(pid=26671): stdout: | (launched: 2022-12-12_20:56:34.732552) 20:56:36.025733 run osmo-msc_10.42.42.6(pid=26671): stderr: | 20221212205635053 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212205635053 DLGLOBAL DEBUG validating counter group 0x7f065edc1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212205635054 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212205635054 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212205635054 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212205635054 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212205635056 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212205635056 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212205635056 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212205635056 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:56:36.079412 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26664): Terminating (SIGTERM) 20:56:36.122338 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26667): Terminating (SIGTERM) 20:56:36.165374 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26670): Terminating (SIGTERM) 20:56:36.208588 --- ParallelTerminationStrategy: PID 26664 died... 20:56:36.229246 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26664): Terminated: ok {rc=0} 20:56:36.277645 --- ParallelTerminationStrategy: PID 26667 died... 20:56:36.297812 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26667): Terminated: ok {rc=0} 20:56:36.345575 --- ParallelTerminationStrategy: PID 26670 died... 20:56:36.365751 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26670): Terminated: ok {rc=0} 20:56:36.455771 bus /sierra_3: Setting Powered False 20:56:37.557617 bus /sierra_3: Setting Powered False 20:56:38.677120 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 20:56:39.933729 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:56:39.941533 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 20:56:39.974707 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 20:56:40.001525 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 20:56:40.057372 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 20:56:40.092878 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 20:56:40.120923 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 20:56:40.667484 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 20:56:40.722012 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:56:40.733782 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 20:56:40.803545 tst mo_mt_call.py: using LAC 31453 20:56:40.933367 tst mo_mt_call.py: using RAC 88 20:56:41.062490 tst mo_mt_call.py: using CellId 31453 20:56:41.195573 tst mo_mt_call.py: using BVCI 31454 20:56:41.319723 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:56:41.331674 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:56:41.343112 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:56:41.354942 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:56:41.366929 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:56:41.378675 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 20:56:41.497993 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 20:56:41.616813 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:56:42.105651 run create_hlr_db(pid=26678): Launched 20:56:42.235652 bus /sierra_2: Setting Powered False 20:56:43.299445 run create_hlr_db(pid=26678): Terminated: ok {rc=0} 20:56:43.758465 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26680): Launched 20:56:44.096647 run osmo-hlr_10.42.42.2(pid=26681): Launched 20:56:44.225360 run osmo-stp_10.42.42.5: Starting osmo-stp 20:56:44.811692 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26683): Launched 20:56:45.150118 run osmo-stp_10.42.42.5(pid=26684): Launched 20:56:45.279856 run osmo-msc_10.42.42.6: Starting osmo-msc 20:56:45.912417 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26686): Launched 20:56:46.247946 run osmo-msc_10.42.42.6(pid=26687): Launched 20:56:46.535671 run osmo-stp_10.42.42.5(pid=26684): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26684)] 20:56:46.932119 run osmo-stp_10.42.42.5(pid=26684): stdout: | (launched: 2022-12-12_20:56:45.088287) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:56:47.278055 run osmo-stp_10.42.42.5(pid=26684): stderr: | 20221212205645282 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205645282 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205645282 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205645283 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205645283 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205645283 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205645283 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:56:47.454284 run osmo-stp_10.42.42.5(pid=26684): stdout: | (launched: 2022-12-12_20:56:45.088287) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:56:47.591651 run osmo-stp_10.42.42.5(pid=26684): stderr: | 20221212205645282 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205645282 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205645282 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205645283 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205645283 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205645283 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205645283 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:56:47.753180 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26684): Process ended prematurely: osmo-stp_10.42.42.5(pid=26684) [trial-2382↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26684)] [trial-2382↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 20:56:47.763039 tst mo_mt_call.py:8: Test FAILED (7.1 sec) 20:56:47.792134 run osmo-hlr_10.42.42.2(pid=26681): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26681)] 20:56:47.844258 run osmo-hlr_10.42.42.2(pid=26681): stdout: | (launched: 2022-12-12_20:56:44.035284) 20:56:47.898223 run osmo-hlr_10.42.42.2(pid=26681): stderr: | 20221212205644233 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212205644233 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212205644233 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212205644234 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212205644234 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212205644234 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212205644246 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212205644255 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212205644255 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212205644255 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:56:47.973221 run osmo-msc_10.42.42.6(pid=26687): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26687)] 20:56:48.025383 run osmo-msc_10.42.42.6(pid=26687): stdout: | (launched: 2022-12-12_20:56:46.187393) 20:56:48.079009 run osmo-msc_10.42.42.6(pid=26687): stderr: | 20221212205646752 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212205646754 DLGLOBAL DEBUG validating counter group 0x7f930f9fcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212205646754 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212205646754 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212205646756 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212205646756 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212205646761 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212205646763 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212205646763 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212205646764 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:56:48.133424 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26680): Terminating (SIGTERM) 20:56:48.176667 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26683): Terminating (SIGTERM) 20:56:48.220283 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26686): Terminating (SIGTERM) 20:56:48.263893 --- ParallelTerminationStrategy: PID 26680 died... 20:56:48.284365 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26680): Terminated: ok {rc=0} 20:56:48.332772 --- ParallelTerminationStrategy: PID 26683 died... 20:56:48.353022 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26683): Terminated: ok {rc=0} 20:56:48.401472 --- ParallelTerminationStrategy: PID 26686 died... 20:56:48.421704 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26686): Terminated: ok {rc=0} 20:56:48.512082 bus /sierra_3: Setting Powered False 20:56:49.614081 bus /sierra_3: Setting Powered False 20:56:50.732566 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2382 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 20:56:51.887091 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:56:51.899493 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 20:56:51.971466 tst mo_mt_call_osmux.py: using LAC 31454 20:56:52.105489 tst mo_mt_call_osmux.py: using RAC 89 20:56:52.239904 tst mo_mt_call_osmux.py: using CellId 31454 20:56:52.374340 tst mo_mt_call_osmux.py: using BVCI 31455 20:56:52.497304 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:56:52.509133 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:56:52.520550 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:56:52.532307 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:56:52.544176 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:56:52.555938 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 20:56:52.680662 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 20:56:52.803185 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:56:53.295891 run create_hlr_db(pid=26689): Launched 20:56:53.426040 bus /sierra_2: Setting Powered False 20:56:54.488882 run create_hlr_db(pid=26689): Terminated: ok {rc=0} 20:56:54.928625 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26691): Launched 20:56:55.245435 run osmo-hlr_10.42.42.2(pid=26692): Launched 20:56:55.365922 run osmo-stp_10.42.42.5: Starting osmo-stp 20:56:55.922386 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26694): Launched 20:56:56.240829 run osmo-stp_10.42.42.5(pid=26695): Launched 20:56:56.361350 run osmo-msc_10.42.42.6: Starting osmo-msc 20:56:56.931060 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26697): Launched 20:56:57.245915 run osmo-msc_10.42.42.6(pid=26698): Launched 20:56:57.425280 run osmo-stp_10.42.42.5(pid=26695): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26695)] 20:56:57.558989 run osmo-stp_10.42.42.5(pid=26695): stdout: | (launched: 2022-12-12_20:56:56.182216) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:56:57.691262 run osmo-stp_10.42.42.5(pid=26695): stderr: | 20221212205656355 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205656355 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205656355 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205656356 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205656356 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205656356 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205656356 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:56:57.822251 run osmo-stp_10.42.42.5(pid=26695): stdout: | (launched: 2022-12-12_20:56:56.182216) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:56:57.947578 run osmo-stp_10.42.42.5(pid=26695): stderr: | 20221212205656355 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205656355 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205656355 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205656356 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205656356 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205656356 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205656356 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:56:58.097638 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26695): Process ended prematurely: osmo-stp_10.42.42.5(pid=26695) [trial-2382↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26695)] [trial-2382↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 20:56:58.106616 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 20:56:58.133722 run osmo-hlr_10.42.42.2(pid=26692): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26692)] 20:56:58.183727 run osmo-hlr_10.42.42.2(pid=26692): stdout: | (launched: 2022-12-12_20:56:55.187590) 20:56:58.234812 run osmo-hlr_10.42.42.2(pid=26692): stderr: | 20221212205655366 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212205655366 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212205655366 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212205655366 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212205655366 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212205655366 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212205655379 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212205655389 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212205655389 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212205655389 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:56:58.305928 run osmo-msc_10.42.42.6(pid=26698): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26698)] 20:56:58.355254 run osmo-msc_10.42.42.6(pid=26698): stdout: | (launched: 2022-12-12_20:56:57.187929) 20:56:58.406068 run osmo-msc_10.42.42.6(pid=26698): stderr: | 20221212205657461 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212205657461 DLGLOBAL DEBUG validating counter group 0x7f80b81c2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212205657461 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212205657462 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212205657462 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212205657462 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212205657464 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212205657464 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212205657464 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212205657464 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:56:58.457295 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26691): Terminating (SIGTERM) 20:56:58.497941 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26694): Terminating (SIGTERM) 20:56:58.538877 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26697): Terminating (SIGTERM) 20:56:58.580000 --- ParallelTerminationStrategy: PID 26691 died... 20:56:58.599785 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26691): Terminated: ok {rc=0} 20:56:58.645294 --- ParallelTerminationStrategy: PID 26694 died... 20:56:58.664297 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26694): Terminated: ok {rc=0} 20:56:58.709539 --- ParallelTerminationStrategy: PID 26697 died... 20:56:58.728574 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26697): Terminated: ok {rc=0} 20:56:58.817191 bus /sierra_3: Setting Powered False 20:56:59.919749 bus /sierra_3: Setting Powered False 20:57:01.049478 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 20:57:02.328656 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:57:02.336219 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 20:57:02.371874 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 20:57:02.399841 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 20:57:02.453339 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 20:57:02.489049 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 20:57:02.517571 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 20:57:03.068344 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 20:57:03.123151 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:57:03.135046 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 20:57:03.207381 tst mo_mt_call.py: using LAC 31455 20:57:03.339317 tst mo_mt_call.py: using RAC 90 20:57:03.470714 tst mo_mt_call.py: using CellId 31455 20:57:03.608105 tst mo_mt_call.py: using BVCI 31456 20:57:03.725373 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:57:03.736686 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:57:03.747839 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:57:03.759653 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:57:03.771315 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:57:03.783162 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 20:57:03.905867 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 20:57:04.028453 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:57:04.554794 run create_hlr_db(pid=26703): Launched 20:57:04.685918 bus /sierra_2: Setting Powered False 20:57:05.753139 run create_hlr_db(pid=26703): Terminated: ok {rc=0} 20:57:06.205612 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26705): Launched 20:57:06.522910 run osmo-hlr_10.42.42.2(pid=26706): Launched 20:57:06.644801 run osmo-stp_10.42.42.5: Starting osmo-stp 20:57:07.186957 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26708): Launched 20:57:07.501643 run osmo-stp_10.42.42.5(pid=26709): Launched 20:57:07.625059 run osmo-msc_10.42.42.6: Starting osmo-msc 20:57:08.196233 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26711): Launched 20:57:08.512880 run osmo-msc_10.42.42.6(pid=26712): Launched 20:57:08.689551 run osmo-stp_10.42.42.5(pid=26709): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26709)] 20:57:08.822467 run osmo-stp_10.42.42.5(pid=26709): stdout: | (launched: 2022-12-12_20:57:07.443764) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:57:08.955509 run osmo-stp_10.42.42.5(pid=26709): stderr: | 20221212205707614 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205707614 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205707615 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205707615 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205707615 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205707616 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205707616 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:57:09.086546 run osmo-stp_10.42.42.5(pid=26709): stdout: | (launched: 2022-12-12_20:57:07.443764) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:57:09.211792 run osmo-stp_10.42.42.5(pid=26709): stderr: | 20221212205707614 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205707614 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205707615 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205707615 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205707615 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205707616 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205707616 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:57:09.362169 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26709): Process ended prematurely: osmo-stp_10.42.42.5(pid=26709) [trial-2382↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26709)] [trial-2382↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 20:57:09.371155 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 20:57:09.397944 run osmo-hlr_10.42.42.2(pid=26706): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26706)] 20:57:09.446799 run osmo-hlr_10.42.42.2(pid=26706): stdout: | (launched: 2022-12-12_20:57:06.464812) 20:57:09.497450 run osmo-hlr_10.42.42.2(pid=26706): stderr: | 20221212205706641 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212205706641 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212205706641 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212205706641 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212205706641 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212205706641 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212205706653 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212205706662 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212205706662 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212205706662 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:57:09.568279 run osmo-msc_10.42.42.6(pid=26712): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26712)] 20:57:09.617460 run osmo-msc_10.42.42.6(pid=26712): stdout: | (launched: 2022-12-12_20:57:08.455253) 20:57:09.667894 run osmo-msc_10.42.42.6(pid=26712): stderr: | 20221212205708730 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212205708730 DLGLOBAL DEBUG validating counter group 0x7f31ebe62c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212205708730 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212205708730 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212205708730 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212205708730 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212205708732 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212205708732 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212205708733 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212205708733 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:57:09.718736 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26705): Terminating (SIGTERM) 20:57:09.759227 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26708): Terminating (SIGTERM) 20:57:09.799531 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26711): Terminating (SIGTERM) 20:57:09.840082 --- ParallelTerminationStrategy: PID 26705 died... 20:57:09.859688 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26705): Terminated: ok {rc=0} 20:57:09.904493 --- ParallelTerminationStrategy: PID 26708 died... 20:57:09.923484 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26708): Terminated: ok {rc=0} 20:57:09.969127 --- ParallelTerminationStrategy: PID 26711 died... 20:57:09.988175 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26711): Terminated: ok {rc=0} 20:57:10.074403 bus /sierra_3: Setting Powered False 20:57:11.175683 bus /sierra_3: Setting Powered False 20:57:12.294817 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2382 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 20:57:13.442214 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:57:13.454306 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 20:57:13.524539 tst mo_mt_call_osmux.py: using LAC 31456 20:57:13.650902 tst mo_mt_call_osmux.py: using RAC 91 20:57:13.777783 tst mo_mt_call_osmux.py: using CellId 31456 20:57:13.902969 tst mo_mt_call_osmux.py: using BVCI 31457 20:57:14.019601 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:57:14.030982 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:57:14.042079 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:57:14.053291 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:57:14.064601 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:57:14.075786 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 20:57:14.194917 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 20:57:14.315175 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:57:14.804853 run create_hlr_db(pid=26714): Launched 20:57:14.934131 bus /sierra_2: Setting Powered False 20:57:16.012630 run create_hlr_db(pid=26714): Terminated: ok {rc=0} 20:57:16.535710 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26716): Launched 20:57:16.888861 run osmo-hlr_10.42.42.2(pid=26717): Launched 20:57:17.142206 run osmo-stp_10.42.42.5: Starting osmo-stp 20:57:17.806721 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26719): Launched 20:57:18.123641 run osmo-stp_10.42.42.5(pid=26720): Launched 20:57:18.243673 run osmo-msc_10.42.42.6: Starting osmo-msc 20:57:18.813459 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26722): Launched 20:57:19.132465 run osmo-msc_10.42.42.6(pid=26723): Launched 20:57:19.309671 run osmo-stp_10.42.42.5(pid=26720): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26720)] 20:57:19.443333 run osmo-stp_10.42.42.5(pid=26720): stdout: | (launched: 2022-12-12_20:57:18.065985) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:57:19.576593 run osmo-stp_10.42.42.5(pid=26720): stderr: | 20221212205718237 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205718237 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205718237 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205718238 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205718238 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205718238 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205718238 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:57:19.708322 run osmo-stp_10.42.42.5(pid=26720): stdout: | (launched: 2022-12-12_20:57:18.065985) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:57:19.834196 run osmo-stp_10.42.42.5(pid=26720): stderr: | 20221212205718237 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205718237 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205718237 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205718238 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205718238 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205718238 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205718238 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:57:19.984531 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26720): Process ended prematurely: osmo-stp_10.42.42.5(pid=26720) [trial-2382↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26720)] [trial-2382↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 20:57:19.993770 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 20:57:20.020809 run osmo-hlr_10.42.42.2(pid=26717): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26717)] 20:57:20.069906 run osmo-hlr_10.42.42.2(pid=26717): stdout: | (launched: 2022-12-12_20:57:16.830627) 20:57:20.120703 run osmo-hlr_10.42.42.2(pid=26717): stderr: | 20221212205717130 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212205717130 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212205717130 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212205717130 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212205717130 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212205717130 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212205717149 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212205717157 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212205717158 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212205717158 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:57:20.191428 run osmo-msc_10.42.42.6(pid=26723): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26723)] 20:57:20.240095 run osmo-msc_10.42.42.6(pid=26723): stdout: | (launched: 2022-12-12_20:57:19.074190) 20:57:20.290655 run osmo-msc_10.42.42.6(pid=26723): stderr: | 20221212205719350 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212205719351 DLGLOBAL DEBUG validating counter group 0x7f510a4c6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212205719351 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212205719351 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212205719351 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212205719351 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212205719353 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212205719353 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212205719353 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212205719354 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:57:20.341496 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26716): Terminating (SIGTERM) 20:57:20.382133 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26719): Terminating (SIGTERM) 20:57:20.422766 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26722): Terminating (SIGTERM) 20:57:20.463876 --- ParallelTerminationStrategy: PID 26716 died... 20:57:20.483596 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26716): Terminated: ok {rc=0} 20:57:20.529043 --- ParallelTerminationStrategy: PID 26719 died... 20:57:20.548134 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26719): Terminated: ok {rc=0} 20:57:20.593097 --- ParallelTerminationStrategy: PID 26722 died... 20:57:20.612268 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26722): Terminated: ok {rc=0} 20:57:20.700236 bus /sierra_3: Setting Powered False 20:57:21.802725 bus /sierra_3: Setting Powered False 20:57:22.920559 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 20:57:24.180674 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:57:24.188236 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 20:57:24.221794 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 20:57:24.248517 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 20:57:24.300385 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 20:57:24.333695 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 20:57:24.360495 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 20:57:24.917590 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 20:57:24.967679 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:57:24.979362 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 20:57:25.049823 tst mo_mt_call.py: using LAC 31457 20:57:25.185378 tst mo_mt_call.py: using RAC 92 20:57:25.322260 tst mo_mt_call.py: using CellId 31457 20:57:25.460456 tst mo_mt_call.py: using BVCI 31458 20:57:25.584638 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:57:25.596617 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:57:25.608490 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:57:25.621196 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:57:25.633891 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:57:25.647133 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:57:25.769623 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:57:25.888466 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:57:26.376503 run create_hlr_db(pid=26728): Launched 20:57:26.504835 bus /sierra_2: Setting Powered False 20:57:27.568316 run create_hlr_db(pid=26728): Terminated: ok {rc=0} 20:57:28.029515 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26730): Launched 20:57:28.370755 run osmo-hlr_10.42.42.2(pid=26731): Launched 20:57:28.499964 run osmo-stp_10.42.42.5: Starting osmo-stp 20:57:29.080569 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26733): Launched 20:57:29.419174 run osmo-stp_10.42.42.5(pid=26734): Launched 20:57:29.550084 run osmo-msc_10.42.42.6: Starting osmo-msc 20:57:30.161047 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26736): Launched 20:57:30.500069 run osmo-msc_10.42.42.6(pid=26737): Launched 20:57:30.688407 run osmo-stp_10.42.42.5(pid=26734): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26734)] 20:57:30.838889 run osmo-stp_10.42.42.5(pid=26734): stdout: | (launched: 2022-12-12_20:57:29.358020) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:57:31.116319 run osmo-stp_10.42.42.5(pid=26734): stderr: | 20221212205729550 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205729550 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205729550 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205729551 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205729551 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205729551 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205729551 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:57:31.251148 run osmo-stp_10.42.42.5(pid=26734): stdout: | (launched: 2022-12-12_20:57:29.358020) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:57:31.382799 run osmo-stp_10.42.42.5(pid=26734): stderr: | 20221212205729550 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205729550 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205729550 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205729551 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205729551 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205729551 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205729551 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:57:31.537896 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26734): Process ended prematurely: osmo-stp_10.42.42.5(pid=26734) [trial-2382↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26734)] [trial-2382↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 20:57:31.547885 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 20:57:31.576671 run osmo-hlr_10.42.42.2(pid=26731): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26731)] 20:57:31.627977 run osmo-hlr_10.42.42.2(pid=26731): stdout: | (launched: 2022-12-12_20:57:28.308394) 20:57:31.681099 run osmo-hlr_10.42.42.2(pid=26731): stderr: | 20221212205728508 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212205728508 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212205728508 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212205728508 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212205728508 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212205728508 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212205728520 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212205728529 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212205728529 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212205728529 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:57:31.754881 run osmo-msc_10.42.42.6(pid=26737): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26737)] 20:57:31.805738 run osmo-msc_10.42.42.6(pid=26737): stdout: | (launched: 2022-12-12_20:57:30.438491) 20:57:31.858062 run osmo-msc_10.42.42.6(pid=26737): stderr: | 20221212205730762 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212205730762 DLGLOBAL DEBUG validating counter group 0x7f0f93560c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212205730762 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212205730762 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212205730762 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212205730763 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212205730764 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212205730765 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212205730765 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212205730765 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:57:31.912307 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26730): Terminating (SIGTERM) 20:57:31.954915 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26733): Terminating (SIGTERM) 20:57:31.999328 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26736): Terminating (SIGTERM) 20:57:32.045544 --- ParallelTerminationStrategy: PID 26730 died... 20:57:32.065867 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26730): Terminated: ok {rc=0} 20:57:32.115316 --- ParallelTerminationStrategy: PID 26733 died... 20:57:32.135764 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26733): Terminated: ok {rc=0} 20:57:32.182626 --- ParallelTerminationStrategy: PID 26736 died... 20:57:32.202629 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26736): Terminated: ok {rc=0} 20:57:32.290378 bus /sierra_3: Setting Powered False 20:57:33.391860 bus /sierra_3: Setting Powered False 20:57:34.511609 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2382 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 20:57:35.658419 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:57:35.670707 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 20:57:35.741783 tst mo_mt_call_osmux.py: using LAC 31458 20:57:35.876450 tst mo_mt_call_osmux.py: using RAC 93 20:57:36.014905 tst mo_mt_call_osmux.py: using CellId 31458 20:57:36.139640 tst mo_mt_call_osmux.py: using BVCI 31459 20:57:36.255397 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:57:36.266993 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:57:36.278206 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:57:36.289245 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:57:36.300476 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:57:36.311758 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:57:36.432490 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:57:36.556355 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:57:37.081158 run create_hlr_db(pid=26739): Launched 20:57:37.211050 bus /sierra_2: Setting Powered False 20:57:38.278240 run create_hlr_db(pid=26739): Terminated: ok {rc=0} 20:57:38.749541 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26741): Launched 20:57:39.090810 run osmo-hlr_10.42.42.2(pid=26742): Launched 20:57:39.222598 run osmo-stp_10.42.42.5: Starting osmo-stp 20:57:39.806207 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26744): Launched 20:57:40.145537 run osmo-stp_10.42.42.5(pid=26745): Launched 20:57:40.275367 run osmo-msc_10.42.42.6: Starting osmo-msc 20:57:40.889299 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26747): Launched 20:57:41.228801 run osmo-msc_10.42.42.6(pid=26748): Launched 20:57:41.418930 run osmo-stp_10.42.42.5(pid=26745): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26745)] 20:57:41.568263 run osmo-stp_10.42.42.5(pid=26745): stdout: | (launched: 2022-12-12_20:57:40.084068) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:57:41.710646 run osmo-stp_10.42.42.5(pid=26745): stderr: | 20221212205740276 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205740276 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205740276 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205740277 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205740277 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205740277 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205740278 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:57:41.851831 run osmo-stp_10.42.42.5(pid=26745): stdout: | (launched: 2022-12-12_20:57:40.084068) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:57:41.986700 run osmo-stp_10.42.42.5(pid=26745): stderr: | 20221212205740276 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205740276 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205740276 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205740277 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205740277 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205740277 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205740278 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:57:42.148168 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26745): Process ended prematurely: osmo-stp_10.42.42.5(pid=26745) [trial-2382↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26745)] [trial-2382↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 20:57:42.158155 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 20:57:42.187233 run osmo-hlr_10.42.42.2(pid=26742): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26742)] 20:57:42.239401 run osmo-hlr_10.42.42.2(pid=26742): stdout: | (launched: 2022-12-12_20:57:39.028879) 20:57:42.293507 run osmo-hlr_10.42.42.2(pid=26742): stderr: | 20221212205739230 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212205739230 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212205739230 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212205739230 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212205739230 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212205739230 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212205739242 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212205739251 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212205739251 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212205739251 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:57:42.368851 run osmo-msc_10.42.42.6(pid=26748): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26748)] 20:57:42.420585 run osmo-msc_10.42.42.6(pid=26748): stdout: | (launched: 2022-12-12_20:57:41.166993) 20:57:42.474304 run osmo-msc_10.42.42.6(pid=26748): stderr: | 20221212205741489 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212205741489 DLGLOBAL DEBUG validating counter group 0x7febd1670c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212205741490 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212205741490 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212205741490 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212205741490 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212205741493 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212205741493 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212205741493 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212205741493 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:57:42.528301 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26741): Terminating (SIGTERM) 20:57:42.571582 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26744): Terminating (SIGTERM) 20:57:42.614601 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26747): Terminating (SIGTERM) 20:57:42.657737 --- ParallelTerminationStrategy: PID 26741 died... 20:57:42.678316 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26741): Terminated: ok {rc=0} 20:57:42.726162 --- ParallelTerminationStrategy: PID 26744 died... 20:57:42.746285 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26744): Terminated: ok {rc=0} 20:57:42.793857 --- ParallelTerminationStrategy: PID 26747 died... 20:57:42.813910 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26747): Terminated: ok {rc=0} 20:57:42.904050 bus /sierra_3: Setting Powered False 20:57:44.004556 bus /sierra_3: Setting Powered False 20:57:45.127684 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 voice:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 20:57:46.410937 tst voice:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:57:46.421374 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 20:57:46.463551 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 20:57:46.499048 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 20:57:46.561706 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 20:57:46.613411 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 20:57:46.652131 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 20:57:47.188092 tst voice:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 20:57:47.246554 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:57:47.259241 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:57:47.337913 tst mo_mt_call.py: using LAC 31459 20:57:47.462229 tst mo_mt_call.py: using RAC 94 20:57:47.586684 tst mo_mt_call.py: using CellId 31459 20:57:47.710052 tst mo_mt_call.py: using BVCI 31460 20:57:47.824408 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:57:47.835511 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:57:47.846596 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:57:47.857439 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:57:47.868324 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:57:47.879237 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 20:57:48.000758 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 20:57:48.124363 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:57:48.649169 run create_hlr_db(pid=26753): Launched 20:57:48.779272 bus /sierra_2: Setting Powered False 20:57:49.846203 run create_hlr_db(pid=26753): Terminated: ok {rc=0} 20:57:50.296030 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26755): Launched 20:57:50.612316 run osmo-hlr_10.42.42.2(pid=26756): Launched 20:57:50.732790 run osmo-stp_10.42.42.5: Starting osmo-stp 20:57:51.292077 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26758): Launched 20:57:51.635948 run osmo-stp_10.42.42.5(pid=26759): Launched 20:57:51.766110 run osmo-msc_10.42.42.6: Starting osmo-msc 20:57:52.377541 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26761): Launched 20:57:52.719537 run osmo-msc_10.42.42.6(pid=26762): Launched 20:57:52.909426 run osmo-stp_10.42.42.5(pid=26759): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26759)] 20:57:53.051915 run osmo-stp_10.42.42.5(pid=26759): stdout: | (launched: 2022-12-12_20:57:51.574515) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:57:53.195694 run osmo-stp_10.42.42.5(pid=26759): stderr: | 20221212205751767 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205751767 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205751768 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205751768 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205751768 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205751769 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205751769 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:57:53.337535 run osmo-stp_10.42.42.5(pid=26759): stdout: | (launched: 2022-12-12_20:57:51.574515) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:57:53.472731 run osmo-stp_10.42.42.5(pid=26759): stderr: | 20221212205751767 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205751767 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205751768 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205751768 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205751768 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205751769 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205751769 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:57:53.634507 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26759): Process ended prematurely: osmo-stp_10.42.42.5(pid=26759) [trial-2382↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26759)] [trial-2382↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 20:57:53.644250 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 20:57:53.673551 run osmo-hlr_10.42.42.2(pid=26756): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26756)] 20:57:53.725372 run osmo-hlr_10.42.42.2(pid=26756): stdout: | (launched: 2022-12-12_20:57:50.554591) 20:57:53.778995 run osmo-hlr_10.42.42.2(pid=26756): stderr: | 20221212205750733 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212205750733 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212205750733 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212205750733 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212205750733 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212205750733 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212205750745 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212205750754 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212205750754 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212205750754 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:57:53.853532 run osmo-msc_10.42.42.6(pid=26762): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26762)] 20:57:53.905423 run osmo-msc_10.42.42.6(pid=26762): stdout: | (launched: 2022-12-12_20:57:52.657659) 20:57:53.959094 run osmo-msc_10.42.42.6(pid=26762): stderr: | 20221212205752980 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212205752980 DLGLOBAL DEBUG validating counter group 0x7ff8ee98fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212205752980 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212205752980 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212205752981 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212205752981 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212205752983 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212205752983 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212205752983 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212205752983 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:57:54.013122 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26755): Terminating (SIGTERM) 20:57:54.056176 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26758): Terminating (SIGTERM) 20:57:54.099282 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26761): Terminating (SIGTERM) 20:57:54.143001 --- ParallelTerminationStrategy: PID 26755 died... 20:57:54.163694 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26755): Terminated: ok {rc=0} 20:57:54.212682 --- ParallelTerminationStrategy: PID 26758 died... 20:57:54.233063 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26758): Terminated: ok {rc=0} 20:57:54.281257 --- ParallelTerminationStrategy: PID 26761 died... 20:57:54.301541 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26761): Terminated: ok {rc=0} 20:57:54.393521 bus /sierra_3: Setting Powered False 20:57:55.495869 bus /sierra_3: Setting Powered False 20:57:56.615868 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2382 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 20:57:57.765421 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:57:57.777229 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:57:57.847624 tst mo_mt_call_osmux.py: using LAC 31460 20:57:57.981913 tst mo_mt_call_osmux.py: using RAC 95 20:57:58.116456 tst mo_mt_call_osmux.py: using CellId 31460 20:57:58.248813 tst mo_mt_call_osmux.py: using BVCI 31461 20:57:58.372726 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:57:58.384566 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:57:58.396282 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:57:58.407987 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:57:58.419646 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:57:58.431346 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 20:57:58.550441 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 20:57:58.668753 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:57:59.158697 run create_hlr_db(pid=26764): Launched 20:57:59.290316 bus /sierra_2: Setting Powered False 20:58:00.353954 run create_hlr_db(pid=26764): Terminated: ok {rc=0} 20:58:00.794677 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26766): Launched 20:58:01.157716 run osmo-hlr_10.42.42.2(pid=26767): Launched 20:58:01.407282 run osmo-stp_10.42.42.5: Starting osmo-stp 20:58:02.066743 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26769): Launched 20:58:02.425799 run osmo-stp_10.42.42.5(pid=26770): Launched 20:58:02.559255 run osmo-msc_10.42.42.6: Starting osmo-msc 20:58:03.175048 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26772): Launched 20:58:03.516148 run osmo-msc_10.42.42.6(pid=26773): Launched 20:58:03.707174 run osmo-stp_10.42.42.5(pid=26770): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26770)] 20:58:03.850429 run osmo-stp_10.42.42.5(pid=26770): stdout: | (launched: 2022-12-12_20:58:02.363765) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:58:03.993491 run osmo-stp_10.42.42.5(pid=26770): stderr: | 20221212205802555 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205802555 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205802556 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205802556 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205802557 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205802557 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205802557 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:58:04.135220 run osmo-stp_10.42.42.5(pid=26770): stdout: | (launched: 2022-12-12_20:58:02.363765) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:58:04.270798 run osmo-stp_10.42.42.5(pid=26770): stderr: | 20221212205802555 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205802555 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205802556 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205802556 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205802557 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205802557 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205802557 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:58:04.434287 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26770): Process ended prematurely: osmo-stp_10.42.42.5(pid=26770) [trial-2382↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26770)] [trial-2382↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 20:58:04.444116 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 20:58:04.473608 run osmo-hlr_10.42.42.2(pid=26767): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26767)] 20:58:04.525860 run osmo-hlr_10.42.42.2(pid=26767): stdout: | (launched: 2022-12-12_20:58:01.095086) 20:58:04.579937 run osmo-hlr_10.42.42.2(pid=26767): stderr: | 20221212205801315 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212205801315 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212205801315 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212205801315 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212205801315 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212205801315 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212205801327 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212205801344 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212205801344 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212205801344 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:58:04.655095 run osmo-msc_10.42.42.6(pid=26773): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26773)] 20:58:04.707347 run osmo-msc_10.42.42.6(pid=26773): stdout: | (launched: 2022-12-12_20:58:03.454371) 20:58:04.761094 run osmo-msc_10.42.42.6(pid=26773): stderr: | 20221212205803778 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212205803778 DLGLOBAL DEBUG validating counter group 0x7ff3b9194c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212205803778 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212205803778 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212205803778 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212205803779 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212205803780 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212205803781 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212205803781 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212205803781 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:58:04.815229 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26766): Terminating (SIGTERM) 20:58:04.858809 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26769): Terminating (SIGTERM) 20:58:04.902370 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26772): Terminating (SIGTERM) 20:58:04.945778 --- ParallelTerminationStrategy: PID 26766 died... 20:58:04.966818 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26766): Terminated: ok {rc=0} 20:58:05.015186 --- ParallelTerminationStrategy: PID 26769 died... 20:58:05.035525 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26769): Terminated: ok {rc=0} 20:58:05.083869 --- ParallelTerminationStrategy: PID 26772 died... 20:58:05.104097 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26772): Terminated: ok {rc=0} 20:58:05.195254 bus /sierra_3: Setting Powered False 20:58:06.296434 bus /sierra_3: Setting Powered False 20:58:07.418633 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 voice:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 voice:trx-b200+mod-bts0-trxdversion0 --------------------------------------------------------------------- 20:58:08.675725 tst voice:trx-b200+mod-bts0-trxdversion0: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:58:08.680663 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 1 x bts (candidates: 11) 20:58:08.713853 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 6 x ip_address (candidates: 9) 20:58:08.740721 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 2 x modem (candidates: 12) 20:58:08.793417 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 1 x bts (candidates: 11) 20:58:08.827041 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 6 x ip_address (candidates: 9) 20:58:08.853618 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 2 x modem (candidates: 12) 20:58:09.403074 tst voice:trx-b200+mod-bts0-trxdversion0: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call.py ---------------------------------------------- 20:58:09.454029 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 20:58:09.465250 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 20:58:09.516081 tst mo_mt_call.py: using LAC 31461 20:58:09.651898 tst mo_mt_call.py: using RAC 96 20:58:09.787448 tst mo_mt_call.py: using CellId 31461 20:58:09.921942 tst mo_mt_call.py: using BVCI 31462 20:58:10.047666 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 20:58:10.059500 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 20:58:10.071066 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 20:58:10.082706 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 20:58:10.094455 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 20:58:10.106938 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 20:58:10.232284 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 20:58:10.356635 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:58:10.881441 run create_hlr_db(pid=26778): Launched 20:58:11.010926 bus /sierra_2: Setting Powered False 20:58:12.077904 run create_hlr_db(pid=26778): Terminated: ok {rc=0} 20:58:12.549601 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26780): Launched 20:58:12.889674 run osmo-hlr_10.42.42.2(pid=26781): Launched 20:58:13.019658 run osmo-stp_10.42.42.5: Starting osmo-stp 20:58:13.606141 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26783): Launched 20:58:13.945465 run osmo-stp_10.42.42.5(pid=26784): Launched 20:58:14.076419 run osmo-msc_10.42.42.6: Starting osmo-msc 20:58:14.692675 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26786): Launched 20:58:15.031757 run osmo-msc_10.42.42.6(pid=26787): Launched 20:58:15.222899 run osmo-stp_10.42.42.5(pid=26784): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26784)] 20:58:15.366348 run osmo-stp_10.42.42.5(pid=26784): stdout: | (launched: 2022-12-12_20:58:13.883616) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:58:15.509455 run osmo-stp_10.42.42.5(pid=26784): stderr: | 20221212205814076 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205814076 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205814076 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205814077 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205814077 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205814077 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205814078 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:58:15.650224 run osmo-stp_10.42.42.5(pid=26784): stdout: | (launched: 2022-12-12_20:58:13.883616) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:58:15.785209 run osmo-stp_10.42.42.5(pid=26784): stderr: | 20221212205814076 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205814076 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205814076 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205814077 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205814077 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205814077 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205814078 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:58:15.951325 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26784): Process ended prematurely: osmo-stp_10.42.42.5(pid=26784) [trial-2382↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26784)] [trial-2382↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8] 20:58:15.961380 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 20:58:15.992420 run osmo-hlr_10.42.42.2(pid=26781): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26781)] 20:58:16.046583 run osmo-hlr_10.42.42.2(pid=26781): stdout: | (launched: 2022-12-12_20:58:12.827880) 20:58:16.102751 run osmo-hlr_10.42.42.2(pid=26781): stderr: | 20221212205813028 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212205813028 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212205813028 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212205813028 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212205813028 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212205813028 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212205813040 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212205813049 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212205813049 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212205813049 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:58:16.179934 run osmo-msc_10.42.42.6(pid=26787): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26787)] 20:58:16.234135 run osmo-msc_10.42.42.6(pid=26787): stdout: | (launched: 2022-12-12_20:58:14.970144) 20:58:16.290058 run osmo-msc_10.42.42.6(pid=26787): stderr: | 20221212205815294 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212205815294 DLGLOBAL DEBUG validating counter group 0x7f8c47b7ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212205815295 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212205815295 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212205815295 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212205815295 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212205815297 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212205815297 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212205815297 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212205815297 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:58:16.347239 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26780): Terminating (SIGTERM) 20:58:16.393082 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26783): Terminating (SIGTERM) 20:58:16.438734 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26786): Terminating (SIGTERM) 20:58:16.484378 --- ParallelTerminationStrategy: PID 26780 died... 20:58:16.505625 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26780): Terminated: ok {rc=0} 20:58:16.556765 --- ParallelTerminationStrategy: PID 26783 died... 20:58:16.578022 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26783): Terminated: ok {rc=0} 20:58:16.629110 --- ParallelTerminationStrategy: PID 26786 died... 20:58:16.650170 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26786): Terminated: ok {rc=0} 20:58:16.749925 bus /sierra_3: Setting Powered False 20:58:17.868113 bus /sierra_3: Setting Powered False 20:58:18.988185 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2382 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call_osmux.py ---------------------------------------------- 20:58:20.140231 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 20:58:20.152197 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 20:58:20.205292 tst mo_mt_call_osmux.py: using LAC 31462 20:58:20.330733 tst mo_mt_call_osmux.py: using RAC 97 20:58:20.458346 tst mo_mt_call_osmux.py: using CellId 31462 20:58:20.584352 tst mo_mt_call_osmux.py: using BVCI 31463 20:58:20.701182 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 20:58:20.712261 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 20:58:20.723136 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 20:58:20.734632 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 20:58:20.746227 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 20:58:20.757769 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 20:58:20.876091 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 20:58:20.998685 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:58:21.524924 run create_hlr_db(pid=26789): Launched 20:58:21.656223 bus /sierra_2: Setting Powered False 20:58:22.723918 run create_hlr_db(pid=26789): Terminated: ok {rc=0} 20:58:23.193754 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26791): Launched 20:58:23.535658 run osmo-hlr_10.42.42.2(pid=26792): Launched 20:58:23.665898 run osmo-stp_10.42.42.5: Starting osmo-stp 20:58:24.247817 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26794): Launched 20:58:24.587929 run osmo-stp_10.42.42.5(pid=26795): Launched 20:58:24.717564 run osmo-msc_10.42.42.6: Starting osmo-msc 20:58:25.330032 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26797): Launched 20:58:25.673333 run osmo-msc_10.42.42.6(pid=26798): Launched 20:58:25.862276 run osmo-stp_10.42.42.5(pid=26795): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26795)] 20:58:26.005640 run osmo-stp_10.42.42.5(pid=26795): stdout: | (launched: 2022-12-12_20:58:24.526462) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:58:26.149279 run osmo-stp_10.42.42.5(pid=26795): stderr: | 20221212205824719 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205824719 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205824720 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205824720 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205824720 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205824721 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205824721 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:58:26.290784 run osmo-stp_10.42.42.5(pid=26795): stdout: | (launched: 2022-12-12_20:58:24.526462) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:58:26.426849 run osmo-stp_10.42.42.5(pid=26795): stderr: | 20221212205824719 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205824719 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205824720 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205824720 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205824720 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205824721 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205824721 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:58:26.589024 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26795): Process ended prematurely: osmo-stp_10.42.42.5(pid=26795) [trial-2382↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26795)] [trial-2382↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8] 20:58:26.598635 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 20:58:26.627632 run osmo-hlr_10.42.42.2(pid=26792): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26792)] 20:58:26.679511 run osmo-hlr_10.42.42.2(pid=26792): stdout: | (launched: 2022-12-12_20:58:23.473796) 20:58:26.733214 run osmo-hlr_10.42.42.2(pid=26792): stderr: | 20221212205823672 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212205823672 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212205823672 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212205823672 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212205823672 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212205823672 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212205823687 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212205823697 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212205823697 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212205823697 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:58:26.807583 run osmo-msc_10.42.42.6(pid=26798): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26798)] 20:58:26.859452 run osmo-msc_10.42.42.6(pid=26798): stdout: | (launched: 2022-12-12_20:58:25.611426) 20:58:26.913130 run osmo-msc_10.42.42.6(pid=26798): stderr: | 20221212205825935 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212205825935 DLGLOBAL DEBUG validating counter group 0x7f81fbd2ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212205825935 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212205825935 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212205825935 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212205825935 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212205825937 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212205825938 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212205825938 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212205825938 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:58:26.967057 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26791): Terminating (SIGTERM) 20:58:27.010163 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26794): Terminating (SIGTERM) 20:58:27.053262 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26797): Terminating (SIGTERM) 20:58:27.096732 --- ParallelTerminationStrategy: PID 26791 died... 20:58:27.117264 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26791): Terminated: ok {rc=0} 20:58:27.165413 --- ParallelTerminationStrategy: PID 26794 died... 20:58:27.185523 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26794): Terminated: ok {rc=0} 20:58:27.233513 --- ParallelTerminationStrategy: PID 26797 died... 20:58:27.253619 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26797): Terminated: ok {rc=0} 20:58:27.343420 bus /sierra_3: Setting Powered False 20:58:28.445366 bus /sierra_3: Setting Powered False 20:58:29.564234 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 voice:trx-b200+mod-bts0-trxdversion0 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 20:58:30.822455 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:58:30.828922 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 20:58:30.890869 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 20:58:30.928265 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 20:58:30.992068 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 20:58:31.029236 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 20:58:31.059335 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 20:58:31.629237 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 20:58:31.690705 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 20:58:31.704558 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 20:58:31.758241 tst mo_mt_call.py: using LAC 31463 20:58:31.918365 tst mo_mt_call.py: using RAC 98 20:58:32.053880 tst mo_mt_call.py: using CellId 31463 20:58:32.211020 tst mo_mt_call.py: using BVCI 31464 20:58:32.327860 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 20:58:32.339427 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 20:58:32.350774 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 20:58:32.362087 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 20:58:32.373390 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 20:58:32.384864 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 20:58:32.508918 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 20:58:32.631951 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:58:33.158892 run create_hlr_db(pid=26804): Launched 20:58:33.289292 bus /sierra_2: Setting Powered False 20:58:34.357380 run create_hlr_db(pid=26804): Terminated: ok {rc=0} 20:58:34.808616 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26806): Launched 20:58:35.125193 run osmo-hlr_10.42.42.2(pid=26807): Launched 20:58:35.245896 run osmo-stp_10.42.42.5: Starting osmo-stp 20:58:35.791970 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26809): Launched 20:58:36.110476 run osmo-stp_10.42.42.5(pid=26810): Launched 20:58:36.231622 run osmo-msc_10.42.42.6: Starting osmo-msc 20:58:36.803357 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26812): Launched 20:58:37.120862 run osmo-msc_10.42.42.6(pid=26813): Launched 20:58:37.297934 run osmo-stp_10.42.42.5(pid=26810): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26810)] 20:58:37.431215 run osmo-stp_10.42.42.5(pid=26810): stdout: | (launched: 2022-12-12_20:58:36.052278) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:58:37.565265 run osmo-stp_10.42.42.5(pid=26810): stderr: | 20221212205836223 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205836223 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205836223 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205836224 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205836224 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205836224 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205836224 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:58:37.697318 run osmo-stp_10.42.42.5(pid=26810): stdout: | (launched: 2022-12-12_20:58:36.052278) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:58:37.823526 run osmo-stp_10.42.42.5(pid=26810): stderr: | 20221212205836223 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205836223 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205836223 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205836224 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205836224 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205836224 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205836224 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:58:37.974306 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26810): Process ended prematurely: osmo-stp_10.42.42.5(pid=26810) [trial-2382↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26810)] [trial-2382↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 20:58:37.983371 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 20:58:38.010520 run osmo-hlr_10.42.42.2(pid=26807): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26807)] 20:58:38.059829 run osmo-hlr_10.42.42.2(pid=26807): stdout: | (launched: 2022-12-12_20:58:35.067181) 20:58:38.110945 run osmo-hlr_10.42.42.2(pid=26807): stderr: | 20221212205835244 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212205835244 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212205835244 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212205835244 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212205835244 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212205835244 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212205835256 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212205835264 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212205835264 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212205835265 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:58:38.182338 run osmo-msc_10.42.42.6(pid=26813): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26813)] 20:58:38.231500 run osmo-msc_10.42.42.6(pid=26813): stdout: | (launched: 2022-12-12_20:58:37.062568) 20:58:38.282640 run osmo-msc_10.42.42.6(pid=26813): stderr: | 20221212205837336 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212205837336 DLGLOBAL DEBUG validating counter group 0x7fb94674ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212205837336 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212205837336 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212205837337 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212205837337 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212205837339 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212205837339 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212205837339 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212205837339 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:58:38.334012 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26806): Terminating (SIGTERM) 20:58:38.375420 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26809): Terminating (SIGTERM) 20:58:38.416445 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26812): Terminating (SIGTERM) 20:58:38.458030 --- ParallelTerminationStrategy: PID 26806 died... 20:58:38.477736 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26806): Terminated: ok {rc=0} 20:58:38.523326 --- ParallelTerminationStrategy: PID 26809 died... 20:58:38.542479 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26809): Terminated: ok {rc=0} 20:58:38.588049 --- ParallelTerminationStrategy: PID 26812 died... 20:58:38.607218 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26812): Terminated: ok {rc=0} 20:58:38.693983 bus /sierra_3: Setting Powered False 20:58:39.795527 bus /sierra_3: Setting Powered False 20:58:40.915329 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2382 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 20:58:42.069582 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 20:58:42.082338 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 20:58:42.138378 tst mo_mt_call_osmux.py: using LAC 31464 20:58:42.271688 tst mo_mt_call_osmux.py: using RAC 99 20:58:42.404812 tst mo_mt_call_osmux.py: using CellId 31464 20:58:42.537542 tst mo_mt_call_osmux.py: using BVCI 31465 20:58:42.653904 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 20:58:42.665603 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 20:58:42.676803 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 20:58:42.688105 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 20:58:42.699451 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 20:58:42.710656 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 20:58:42.828369 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 20:58:42.955995 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:58:43.481940 run create_hlr_db(pid=26815): Launched 20:58:43.613331 bus /sierra_2: Setting Powered False 20:58:44.680662 run create_hlr_db(pid=26815): Terminated: ok {rc=0} 20:58:45.150349 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26817): Launched 20:58:45.489858 run osmo-hlr_10.42.42.2(pid=26818): Launched 20:58:45.620377 run osmo-stp_10.42.42.5: Starting osmo-stp 20:58:46.225711 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26820): Launched 20:58:46.561489 run osmo-stp_10.42.42.5(pid=26821): Launched 20:58:46.770212 run osmo-msc_10.42.42.6: Starting osmo-msc 20:58:47.667276 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26823): Launched 20:58:48.005481 run osmo-msc_10.42.42.6(pid=26824): Launched 20:58:48.193776 run osmo-stp_10.42.42.5(pid=26821): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26821)] 20:58:48.336325 run osmo-stp_10.42.42.5(pid=26821): stdout: | (launched: 2022-12-12_20:58:46.502039) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:58:48.479027 run osmo-stp_10.42.42.5(pid=26821): stderr: | 20221212205846916 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205846917 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205846917 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205846919 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205846920 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205846920 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205846920 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:58:48.620366 run osmo-stp_10.42.42.5(pid=26821): stdout: | (launched: 2022-12-12_20:58:46.502039) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:58:48.755305 run osmo-stp_10.42.42.5(pid=26821): stderr: | 20221212205846916 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205846917 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205846917 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205846919 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205846920 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205846920 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205846920 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:58:48.917240 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26821): Process ended prematurely: osmo-stp_10.42.42.5(pid=26821) [trial-2382↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26821)] [trial-2382↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 20:58:48.926987 tst mo_mt_call_osmux.py:8: Test FAILED (6.9 sec) 20:58:48.955650 run osmo-hlr_10.42.42.2(pid=26818): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26818)] 20:58:49.007181 run osmo-hlr_10.42.42.2(pid=26818): stdout: | (launched: 2022-12-12_20:58:45.428255) 20:58:49.060636 run osmo-hlr_10.42.42.2(pid=26818): stderr: | 20221212205845627 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212205845627 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212205845627 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212205845627 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212205845627 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212205845627 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212205845642 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212205845652 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212205845653 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212205845653 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:58:49.135098 run osmo-msc_10.42.42.6(pid=26824): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26824)] 20:58:49.186443 run osmo-msc_10.42.42.6(pid=26824): stdout: | (launched: 2022-12-12_20:58:47.943912) 20:58:49.239588 run osmo-msc_10.42.42.6(pid=26824): stderr: | 20221212205848268 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212205848269 DLGLOBAL DEBUG validating counter group 0x7feae3ac3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212205848269 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212205848269 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212205848269 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212205848269 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212205848271 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212205848271 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212205848271 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212205848271 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:58:49.293412 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26817): Terminating (SIGTERM) 20:58:49.336622 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26820): Terminating (SIGTERM) 20:58:49.379447 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26823): Terminating (SIGTERM) 20:58:49.422695 --- ParallelTerminationStrategy: PID 26817 died... 20:58:49.443169 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26817): Terminated: ok {rc=0} 20:58:49.490959 --- ParallelTerminationStrategy: PID 26820 died... 20:58:49.510802 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26820): Terminated: ok {rc=0} 20:58:49.558308 --- ParallelTerminationStrategy: PID 26823 died... 20:58:49.578122 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26823): Terminated: ok {rc=0} 20:58:49.667926 bus /sierra_3: Setting Powered False 20:58:50.769853 bus /sierra_3: Setting Powered False 20:58:51.888773 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 emergency:trx-b200 --------------------------------------------------------------------- 20:58:53.148197 tst emergency:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:58:53.153083 tst emergency:trx-b200: Verifying 1 x bts (candidates: 11) 20:58:53.189381 tst emergency:trx-b200: Verifying 6 x ip_address (candidates: 9) 20:58:53.217572 tst emergency:trx-b200: Verifying 4 x modem (candidates: 12) 20:58:53.305094 tst emergency:trx-b200: Reserving 1 x bts (candidates: 11) 20:58:53.339102 tst emergency:trx-b200: Reserving 6 x ip_address (candidates: 9) 20:58:53.366029 tst emergency:trx-b200: Reserving 4 x modem (candidates: 12) 20:58:53.952849 tst emergency:trx-b200: RESERVED RESOURCES for emergency: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2382 emergency:trx-b200 emergency_mo_mt_call.py ---------------------------------------------- 20:58:53.959113 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 20:58:53.970413 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 20:58:54.020230 tst emergency_mo_mt_call.py: using LAC 31465 20:58:54.145069 tst emergency_mo_mt_call.py: using RAC 100 20:58:54.267660 tst emergency_mo_mt_call.py: using CellId 31465 20:58:54.392667 tst emergency_mo_mt_call.py: using BVCI 31466 20:58:54.505928 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 20:58:54.516771 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 20:58:54.527467 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 20:58:54.538051 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 20:58:54.548586 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 20:58:54.559176 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 20:58:54.680802 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 20:58:54.804071 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:58:55.320528 run create_hlr_db(pid=26830): Launched 20:58:55.450106 bus /sierra_2: Setting Powered False 20:58:56.515137 run create_hlr_db(pid=26830): Terminated: ok {rc=0} 20:58:56.961371 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26832): Launched 20:58:57.272014 run osmo-hlr_10.42.42.2(pid=26833): Launched 20:58:57.390817 run osmo-stp_10.42.42.5: Starting osmo-stp 20:58:57.929619 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26835): Launched 20:58:58.241645 run osmo-stp_10.42.42.5(pid=26836): Launched 20:58:58.370097 tst emergency_mo_mt_call.py: using MSISDN 7969 20:58:58.527725 run osmo-msc_10.42.42.6: Starting osmo-msc 20:58:59.085661 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26838): Launched 20:58:59.397545 run osmo-msc_10.42.42.6(pid=26839): Launched 20:58:59.571145 run osmo-stp_10.42.42.5(pid=26836): ERR: Terminated: ERROR {rc=1} [trial-2382↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26836)] 20:58:59.702989 run osmo-stp_10.42.42.5(pid=26836): stdout: | (launched: 2022-12-12_20:58:58.183835) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:58:59.835586 run osmo-stp_10.42.42.5(pid=26836): stderr: | 20221212205858356 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205858356 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205858356 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205858357 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205858357 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205858357 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205858357 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:58:59.965573 run osmo-stp_10.42.42.5(pid=26836): stdout: | (launched: 2022-12-12_20:58:58.183835) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:59:00.089346 run osmo-stp_10.42.42.5(pid=26836): stderr: | 20221212205858356 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205858356 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205858356 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205858357 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205858357 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205858357 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205858357 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:59:00.237511 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=26836): Process ended prematurely: osmo-stp_10.42.42.5(pid=26836) [trial-2382↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26836)] [trial-2382↪emergency:trx-b200↪emergency_mo_mt_call.py:19] 20:59:00.245839 tst emergency_mo_mt_call.py:19: Test FAILED (6.3 sec) 20:59:00.272277 run osmo-hlr_10.42.42.2(pid=26833): ERR: Terminated: ERROR {rc=237} [trial-2382↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26833)] 20:59:00.321270 run osmo-hlr_10.42.42.2(pid=26833): stdout: | (launched: 2022-12-12_20:58:57.215268) 20:59:00.372054 run osmo-hlr_10.42.42.2(pid=26833): stderr: | 20221212205857394 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212205857394 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212205857394 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212205857394 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212205857394 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212205857394 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212205857426 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/emergency:trx-b200/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212205857436 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212205857437 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212205857437 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:59:00.442972 run osmo-msc_10.42.42.6(pid=26839): ERR: Terminated: ERROR {rc=2} [trial-2382↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26839)] 20:59:00.492133 run osmo-msc_10.42.42.6(pid=26839): stdout: | (launched: 2022-12-12_20:58:59.339998) 20:59:00.542683 run osmo-msc_10.42.42.6(pid=26839): stderr: | 20221212205859614 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212205859614 DLGLOBAL DEBUG validating counter group 0x7fdc3c05ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212205859614 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212205859614 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212205859615 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212205859615 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212205859617 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212205859617 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212205859617 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212205859617 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:59:00.593615 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26832): Terminating (SIGTERM) 20:59:00.634336 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26835): Terminating (SIGTERM) 20:59:00.675077 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26838): Terminating (SIGTERM) 20:59:00.716169 --- ParallelTerminationStrategy: PID 26832 died... 20:59:00.735839 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26832): Terminated: ok {rc=0} 20:59:00.780878 --- ParallelTerminationStrategy: PID 26835 died... 20:59:00.800372 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26835): Terminated: ok {rc=0} 20:59:00.853383 --- ParallelTerminationStrategy: PID 26838 died... 20:59:00.874406 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26838): Terminated: ok {rc=0} 20:59:00.975701 bus /sierra_3: Setting Powered False 20:59:02.078460 bus /sierra_3: Setting Powered False 20:59:03.202184 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2382 emergency:trx-b200 emergency_preemptive_call.py ---------------------------------------------- 20:59:04.292162 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 20:59:04.304001 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 20:59:04.356894 tst emergency_preemptive_call.py: using LAC 31466 20:59:04.480314 tst emergency_preemptive_call.py: using RAC 101 20:59:04.605873 tst emergency_preemptive_call.py: using CellId 31466 20:59:04.730054 tst emergency_preemptive_call.py: using BVCI 31467 20:59:04.844886 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 20:59:04.856009 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 20:59:04.866788 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 20:59:04.878038 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 20:59:04.889378 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 20:59:04.900595 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 20:59:05.024596 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 20:59:05.145232 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 20:59:05.262651 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 20:59:05.379789 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:59:05.861986 run create_hlr_db(pid=26841): Launched 20:59:05.991887 bus /sierra_2: Setting Powered False 20:59:07.054089 run create_hlr_db(pid=26841): Terminated: ok {rc=0} 20:59:07.510154 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26846): Launched 20:59:07.820818 run osmo-hlr_10.42.42.2(pid=26849): Launched 20:59:07.938985 run osmo-stp_10.42.42.5: Starting osmo-stp 20:59:08.472238 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26851): Launched 20:59:08.781645 run osmo-stp_10.42.42.5(pid=26852): Launched 20:59:08.908285 tst emergency_preemptive_call.py: using MSISDN 7970 20:59:09.066540 run osmo-msc_10.42.42.6: Starting osmo-msc 20:59:09.624528 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26854): Launched 20:59:09.934862 run osmo-msc_10.42.42.6(pid=26855): Launched 20:59:10.107480 run osmo-stp_10.42.42.5(pid=26852): ERR: Terminated: ERROR {rc=1} [trial-2382↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26852)] 20:59:10.238691 run osmo-stp_10.42.42.5(pid=26852): stdout: | (launched: 2022-12-12_20:59:08.724626) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:59:10.369534 run osmo-stp_10.42.42.5(pid=26852): stderr: | 20221212205908896 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205908896 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205908896 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205908896 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205908897 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205908897 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205908897 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:59:10.498850 run osmo-stp_10.42.42.5(pid=26852): stdout: | (launched: 2022-12-12_20:59:08.724626) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:59:10.621569 run osmo-stp_10.42.42.5(pid=26852): stderr: | 20221212205908896 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205908896 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205908896 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205908896 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205908897 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205908897 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205908897 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:59:10.768521 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=26852): Process ended prematurely: osmo-stp_10.42.42.5(pid=26852) [trial-2382↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26852)] [trial-2382↪emergency:trx-b200↪emergency_preemptive_call.py:32] 20:59:10.777022 tst emergency_preemptive_call.py:32: Test FAILED (6.5 sec) 20:59:10.803818 run osmo-hlr_10.42.42.2(pid=26849): ERR: Terminated: ERROR {rc=237} [trial-2382↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26849)] 20:59:10.853295 run osmo-hlr_10.42.42.2(pid=26849): stdout: | (launched: 2022-12-12_20:59:07.763264) 20:59:10.904408 run osmo-hlr_10.42.42.2(pid=26849): stderr: | 20221212205907942 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212205907942 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212205907942 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212205907942 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212205907942 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212205907942 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212205907978 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/emergency:trx-b200/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212205907988 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212205907989 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212205907989 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:59:10.975867 run osmo-msc_10.42.42.6(pid=26855): ERR: Terminated: ERROR {rc=2} [trial-2382↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26855)] 20:59:11.024857 run osmo-msc_10.42.42.6(pid=26855): stdout: | (launched: 2022-12-12_20:59:09.877897) 20:59:11.075559 run osmo-msc_10.42.42.6(pid=26855): stderr: | 20221212205910150 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212205910150 DLGLOBAL DEBUG validating counter group 0x7f1e93e96c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212205910150 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212205910150 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212205910150 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212205910150 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212205910152 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212205910153 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212205910153 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212205910153 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:59:11.126533 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26846): Terminating (SIGTERM) 20:59:11.167269 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26851): Terminating (SIGTERM) 20:59:11.208001 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26854): Terminating (SIGTERM) 20:59:11.249127 --- ParallelTerminationStrategy: PID 26846 died... 20:59:11.268736 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26846): Terminated: ok {rc=0} 20:59:11.314425 --- ParallelTerminationStrategy: PID 26851 died... 20:59:11.333583 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26851): Terminated: ok {rc=0} 20:59:11.378636 --- ParallelTerminationStrategy: PID 26854 died... 20:59:11.397712 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26854): Terminated: ok {rc=0} 20:59:11.485546 bus /sierra_9: Setting Powered False 20:59:12.588909 bus /sierra_9: Setting Powered False 20:59:13.707582 bus /sierra_8: Setting Powered False 20:59:14.810450 bus /sierra_8: Setting Powered False 20:59:15.944186 bus /sierra_3: Setting Powered False 20:59:17.074929 bus /sierra_3: Setting Powered False 20:59:18.197829 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 emergency:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 gprs:trx-b200 --------------------------------------------------------------------- 20:59:19.487543 tst gprs:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:59:19.492373 tst gprs:trx-b200: Verifying 1 x bts (candidates: 11) 20:59:19.527393 tst gprs:trx-b200: Verifying 9 x ip_address (candidates: 9) 20:59:19.567409 tst gprs:trx-b200: Verifying 4 x modem (candidates: 12) 20:59:19.656940 tst gprs:trx-b200: Reserving 1 x bts (candidates: 11) 20:59:19.691413 tst gprs:trx-b200: Reserving 9 x ip_address (candidates: 9) 20:59:19.731299 tst gprs:trx-b200: Reserving 4 x modem (candidates: 12) 20:59:20.324386 tst gprs:trx-b200: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2382 gprs:trx-b200 cs_paging_gprs_active.py ---------------------------------------------- 20:59:20.380835 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:59:20.392155 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 20:59:20.442975 tst cs_paging_gprs_active.py: using LAC 31467 20:59:20.580840 tst cs_paging_gprs_active.py: using RAC 102 20:59:20.713775 tst cs_paging_gprs_active.py: using CellId 31467 20:59:20.849590 tst cs_paging_gprs_active.py: using BVCI 31468 20:59:20.967494 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:59:20.978486 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:59:20.989047 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:59:20.999542 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:59:21.009935 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:59:21.020403 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:59:21.031049 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:59:21.041628 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:59:21.052277 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 20:59:21.174906 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 20:59:21.293924 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 20:59:21.508444 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:59:21.827982 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26861): Launched 20:59:22.105487 run iperf3-srv_10.42.42.10(pid=26862): Launched 20:59:22.225228 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 20:59:22.440648 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:59:22.761521 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26863): Launched 20:59:23.038708 run iperf3-srv_10.42.42.10(pid=26864): Launched 20:59:23.157260 tst cs_paging_gprs_active.py:38: start network... 20:59:23.369897 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:59:23.861720 run create_hlr_db(pid=26865): Launched 20:59:23.992412 bus /sierra_2: Setting Powered False 20:59:25.055825 run create_hlr_db(pid=26865): Terminated: ok {rc=0} 20:59:25.524419 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26867): Launched 20:59:25.840802 run osmo-hlr_10.42.42.2(pid=26868): Launched 20:59:25.962445 run osmo-stp_10.42.42.5: Starting osmo-stp 20:59:26.522864 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26870): Launched 20:59:26.843647 run osmo-stp_10.42.42.5(pid=26871): Launched 20:59:26.963231 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:59:27.508734 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26873): Launched 20:59:27.629687 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:59:27.898845 run patchelf(pid=26874): Launched 20:59:28.076092 run osmo-stp_10.42.42.5(pid=26871): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26871)] 20:59:28.210696 run osmo-stp_10.42.42.5(pid=26871): stdout: | (launched: 2022-12-12_20:59:26.785574) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:59:28.346452 run osmo-stp_10.42.42.5(pid=26871): stderr: | 20221212205926957 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205926957 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205926957 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205926958 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205926958 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205926958 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205926958 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:59:28.482415 run osmo-stp_10.42.42.5(pid=26871): stdout: | (launched: 2022-12-12_20:59:26.785574) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:59:28.612383 run osmo-stp_10.42.42.5(pid=26871): stderr: | 20221212205926957 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205926957 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205926957 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205926958 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205926958 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205926958 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205926958 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:59:28.766714 run patchelf(pid=26874): Terminating (SIGINT) 20:59:28.945142 run patchelf(pid=26874): Terminated: ok {rc=0} 20:59:29.073828 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=26871): Process ended prematurely: osmo-stp_10.42.42.5(pid=26871) [trial-2382↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26871)] [trial-2382↪gprs:trx-b200↪cs_paging_gprs_active.py:38] 20:59:29.083406 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 20:59:29.111322 run osmo-hlr_10.42.42.2(pid=26868): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-b200↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26868)] 20:59:29.160299 run osmo-hlr_10.42.42.2(pid=26868): stdout: | (launched: 2022-12-12_20:59:25.782273) 20:59:29.210896 run osmo-hlr_10.42.42.2(pid=26868): stderr: | 20221212205925959 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212205925959 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212205925959 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212205925959 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212205925959 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212205925959 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212205925971 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-b200/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212205925981 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212205925982 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212205925982 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:59:29.262125 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26861): Terminating (SIGTERM) 20:59:29.303183 run iperf3-srv_10.42.42.10(pid=26862): Terminating (SIGTERM) 20:59:29.344389 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26863): Terminating (SIGTERM) 20:59:29.385659 run iperf3-srv_10.42.42.10(pid=26864): Terminating (SIGTERM) 20:59:29.426491 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26867): Terminating (SIGTERM) 20:59:29.467650 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26870): Terminating (SIGTERM) 20:59:29.508761 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26873): Terminating (SIGTERM) 20:59:29.550176 --- ParallelTerminationStrategy: PID 26861 died... 20:59:29.570085 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26861): Terminated: ok {rc=0} 20:59:29.616149 --- ParallelTerminationStrategy: PID 26862 died... 20:59:29.635304 run iperf3-srv_10.42.42.10(pid=26862): Terminated {rc=256} 20:59:29.680403 --- ParallelTerminationStrategy: PID 26863 died... 20:59:29.699487 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26863): Terminated: ok {rc=0} 20:59:29.744504 --- ParallelTerminationStrategy: PID 26864 died... 20:59:29.763646 run iperf3-srv_10.42.42.10(pid=26864): Terminated {rc=256} 20:59:29.808572 --- ParallelTerminationStrategy: PID 26867 died... 20:59:29.827830 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26867): Terminated: ok {rc=0} 20:59:29.872728 --- ParallelTerminationStrategy: PID 26870 died... 20:59:29.891784 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26870): Terminated: ok {rc=0} 20:59:29.936616 --- ParallelTerminationStrategy: PID 26873 died... 20:59:29.955753 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26873): Terminated: ok {rc=0} 20:59:30.045020 bus /gobi_0: Setting Powered False 20:59:31.152386 bus /gobi_0: Setting Powered False 20:59:32.271724 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:trx-b200 iperf3.py ---------------------------------------------- 20:59:33.428216 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:59:33.440265 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 20:59:33.493832 tst iperf3.py: using LAC 31468 20:59:33.631426 tst iperf3.py: using RAC 103 20:59:33.763741 tst iperf3.py: using CellId 31468 20:59:33.894452 tst iperf3.py: using BVCI 31469 20:59:34.020699 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:59:34.032247 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:59:34.043505 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:59:34.055084 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:59:34.066267 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:59:34.077351 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:59:34.088623 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:59:34.099945 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:59:34.112096 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 20:59:34.232183 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 20:59:34.455874 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:59:34.794267 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26876): Launched 20:59:35.087873 run iperf3-srv_10.42.42.10(pid=26877): Launched 20:59:35.215171 tst iperf3.py:8: start network... 20:59:35.444760 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:59:35.969692 run create_hlr_db(pid=26878): Launched 20:59:36.098538 bus /gobi_6: Setting Powered False 20:59:37.165337 run create_hlr_db(pid=26878): Terminated: ok {rc=0} 20:59:37.615947 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26880): Launched 20:59:37.932472 run osmo-hlr_10.42.42.2(pid=26881): Launched 20:59:38.054032 run osmo-stp_10.42.42.5: Starting osmo-stp 20:59:38.601783 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26883): Launched 20:59:38.921102 run osmo-stp_10.42.42.5(pid=26884): Launched 20:59:39.042740 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:59:39.589522 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26886): Launched 20:59:39.710746 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:59:39.979658 run patchelf(pid=26887): Launched 20:59:40.155831 run osmo-stp_10.42.42.5(pid=26884): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26884)] 20:59:40.289444 run osmo-stp_10.42.42.5(pid=26884): stdout: | (launched: 2022-12-12_20:59:38.862604) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:59:40.424505 run osmo-stp_10.42.42.5(pid=26884): stderr: | 20221212205939035 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205939035 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205939036 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205939036 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205939036 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205939037 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205939037 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:59:40.560093 run osmo-stp_10.42.42.5(pid=26884): stdout: | (launched: 2022-12-12_20:59:38.862604) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:59:40.689975 run osmo-stp_10.42.42.5(pid=26884): stderr: | 20221212205939035 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205939035 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205939036 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205939036 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205939036 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205939037 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205939037 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:59:40.844411 run patchelf(pid=26887): Terminating (SIGINT) 20:59:41.022462 run patchelf(pid=26887): Terminated: ok {rc=0} 20:59:41.150959 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26884): Process ended prematurely: osmo-stp_10.42.42.5(pid=26884) [trial-2382↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26884)] [trial-2382↪gprs:trx-b200↪iperf3.py:8] 20:59:41.160405 tst iperf3.py:8: Test FAILED (7.8 sec) 20:59:41.188114 run osmo-hlr_10.42.42.2(pid=26881): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-b200↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26881)] 20:59:41.236897 run osmo-hlr_10.42.42.2(pid=26881): stdout: | (launched: 2022-12-12_20:59:37.874472) 20:59:41.287622 run osmo-hlr_10.42.42.2(pid=26881): stderr: | 20221212205938051 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212205938051 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212205938051 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212205938051 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212205938051 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212205938051 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212205938063 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-b200/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212205938071 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212205938072 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212205938072 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:59:41.338955 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26876): Terminating (SIGTERM) 20:59:41.380180 run iperf3-srv_10.42.42.10(pid=26877): Terminating (SIGTERM) 20:59:41.421244 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26880): Terminating (SIGTERM) 20:59:41.462241 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26883): Terminating (SIGTERM) 20:59:41.503146 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26886): Terminating (SIGTERM) 20:59:41.544553 --- ParallelTerminationStrategy: PID 26876 died... 20:59:41.564347 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26876): Terminated: ok {rc=0} 20:59:41.609852 --- ParallelTerminationStrategy: PID 26877 died... 20:59:41.628775 run iperf3-srv_10.42.42.10(pid=26877): Terminated {rc=256} 20:59:41.674592 --- ParallelTerminationStrategy: PID 26880 died... 20:59:41.693680 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26880): Terminated: ok {rc=0} 20:59:41.738657 --- ParallelTerminationStrategy: PID 26883 died... 20:59:41.757941 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26883): Terminated: ok {rc=0} 20:59:41.803100 --- ParallelTerminationStrategy: PID 26886 died... 20:59:41.822327 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26886): Terminated: ok {rc=0} 20:59:41.910470 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:trx-b200 iperf3m4.py ---------------------------------------------- 20:59:43.067074 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:59:43.078764 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 20:59:43.126480 tst iperf3m4.py: using LAC 31469 20:59:43.256158 tst iperf3m4.py: using RAC 104 20:59:43.380656 tst iperf3m4.py: using CellId 31469 20:59:43.504036 tst iperf3m4.py: using BVCI 31470 20:59:43.620602 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:59:43.631515 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:59:43.642034 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:59:43.652535 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:59:43.663039 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:59:43.673559 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:59:43.684156 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:59:43.694650 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:59:43.705261 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 20:59:43.826833 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 20:59:43.949212 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 20:59:44.072050 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 20:59:44.191684 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 20:59:44.404399 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:59:44.723036 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26888): Launched 20:59:44.999950 run iperf3-srv_10.42.42.10(pid=26889): Launched 20:59:45.118491 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 20:59:45.332065 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:59:45.651041 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26890): Launched 20:59:45.953634 run iperf3-srv_10.42.42.10(pid=26891): Launched 20:59:46.088339 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 20:59:46.326475 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:59:46.677790 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26892): Launched 20:59:47.029485 run iperf3-srv_10.42.42.10(pid=26893): Launched 20:59:47.173873 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 20:59:47.404178 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:59:47.745831 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26894): Launched 20:59:48.043193 run iperf3-srv_10.42.42.10(pid=26895): Launched 20:59:48.170907 tst iperf3m4.py:8: start network... 20:59:48.400377 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:59:48.927997 run create_hlr_db(pid=26896): Launched 20:59:49.058690 bus /gobi_6: Setting Powered False 20:59:50.125830 run create_hlr_db(pid=26896): Terminated: ok {rc=0} 20:59:50.578610 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26898): Launched 20:59:50.897345 run osmo-hlr_10.42.42.2(pid=26899): Launched 20:59:51.017659 run osmo-stp_10.42.42.5: Starting osmo-stp 20:59:51.561521 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26901): Launched 20:59:51.879567 run osmo-stp_10.42.42.5(pid=26902): Launched 20:59:52.000061 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:59:52.545989 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26904): Launched 20:59:52.666582 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:59:52.934119 run patchelf(pid=26905): Launched 20:59:53.111101 run osmo-stp_10.42.42.5(pid=26902): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26902)] 20:59:53.244804 run osmo-stp_10.42.42.5(pid=26902): stdout: | (launched: 2022-12-12_20:59:51.820862) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:59:53.380149 run osmo-stp_10.42.42.5(pid=26902): stderr: | 20221212205951992 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205951992 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205951993 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205951993 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205951994 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205951994 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205951994 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:59:53.515294 run osmo-stp_10.42.42.5(pid=26902): stdout: | (launched: 2022-12-12_20:59:51.820862) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:59:53.644698 run osmo-stp_10.42.42.5(pid=26902): stderr: | 20221212205951992 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212205951992 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212205951993 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212205951993 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212205951994 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212205951994 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212205951994 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:59:53.798609 run patchelf(pid=26905): Terminating (SIGINT) 20:59:53.977227 run patchelf(pid=26905): Terminated: ok {rc=0} 20:59:54.106167 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26902): Process ended prematurely: osmo-stp_10.42.42.5(pid=26902) [trial-2382↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26902)] [trial-2382↪gprs:trx-b200↪iperf3m4.py:8] 20:59:54.115724 tst iperf3m4.py:8: Test FAILED (11.1 sec) 20:59:54.143695 run osmo-hlr_10.42.42.2(pid=26899): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-b200↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26899)] 20:59:54.193646 run osmo-hlr_10.42.42.2(pid=26899): stdout: | (launched: 2022-12-12_20:59:50.839317) 20:59:54.244433 run osmo-hlr_10.42.42.2(pid=26899): stderr: | 20221212205951018 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212205951018 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212205951018 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212205951018 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212205951018 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212205951018 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212205951031 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-b200/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212205951040 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212205951041 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212205951041 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:59:54.295574 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26888): Terminating (SIGTERM) 20:59:54.336470 run iperf3-srv_10.42.42.10(pid=26889): Terminating (SIGTERM) 20:59:54.377344 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26890): Terminating (SIGTERM) 20:59:54.418059 run iperf3-srv_10.42.42.10(pid=26891): Terminating (SIGTERM) 20:59:54.458812 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26892): Terminating (SIGTERM) 20:59:54.499710 run iperf3-srv_10.42.42.10(pid=26893): Terminating (SIGTERM) 20:59:54.540331 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26894): Terminating (SIGTERM) 20:59:54.581067 run iperf3-srv_10.42.42.10(pid=26895): Terminating (SIGTERM) 20:59:54.622357 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26898): Terminating (SIGTERM) 20:59:54.663197 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26901): Terminating (SIGTERM) 20:59:54.703999 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26904): Terminating (SIGTERM) 20:59:54.745060 --- ParallelTerminationStrategy: PID 26888 died... 20:59:54.764579 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26888): Terminated: ok {rc=0} 20:59:54.810021 --- ParallelTerminationStrategy: PID 26889 died... 20:59:54.829218 run iperf3-srv_10.42.42.10(pid=26889): Terminated {rc=256} 20:59:54.874904 --- ParallelTerminationStrategy: PID 26890 died... 20:59:54.893973 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26890): Terminated: ok {rc=0} 20:59:54.938783 --- ParallelTerminationStrategy: PID 26891 died... 20:59:54.957777 run iperf3-srv_10.42.42.10(pid=26891): Terminated {rc=256} 20:59:55.003045 --- ParallelTerminationStrategy: PID 26892 died... 20:59:55.022063 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26892): Terminated: ok {rc=0} 20:59:55.067199 --- ParallelTerminationStrategy: PID 26893 died... 20:59:55.086223 run iperf3-srv_10.42.42.10(pid=26893): Terminated {rc=256} 20:59:55.131478 --- ParallelTerminationStrategy: PID 26894 died... 20:59:55.150450 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26894): Terminated: ok {rc=0} 20:59:55.195067 --- ParallelTerminationStrategy: PID 26895 died... 20:59:55.214022 run iperf3-srv_10.42.42.10(pid=26895): Terminated {rc=256} 20:59:55.258767 --- ParallelTerminationStrategy: PID 26898 died... 20:59:55.277874 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26898): Terminated: ok {rc=0} 20:59:55.322638 --- ParallelTerminationStrategy: PID 26901 died... 20:59:55.341782 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26901): Terminated: ok {rc=0} 20:59:55.386550 --- ParallelTerminationStrategy: PID 26904 died... 20:59:55.405498 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26904): Terminated: ok {rc=0} 20:59:55.494338 bus /gobi_4: Setting Powered False 20:59:56.597510 bus /gobi_4: Setting Powered False 20:59:57.716409 bus /gobi_1: Setting Powered False 20:59:58.817982 bus /gobi_1: Setting Powered False 20:59:59.936057 bus /gobi_0: Setting Powered False 21:00:01.044515 bus /gobi_0: Setting Powered False 21:00:02.178078 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:trx-b200 ping.py ---------------------------------------------- 21:00:03.300457 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 21:00:03.311937 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 21:00:03.361613 tst ping.py: using LAC 31470 21:00:03.485642 tst ping.py: using RAC 105 21:00:03.608627 tst ping.py: using CellId 31470 21:00:03.732875 tst ping.py: using BVCI 31471 21:00:03.848066 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 21:00:03.858852 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 21:00:03.869579 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 21:00:03.880072 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 21:00:03.890501 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 21:00:03.900942 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 21:00:03.911531 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 21:00:03.922136 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 21:00:04.044888 tst ping.py:19: start network... 21:00:04.253575 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:00:04.735133 run create_hlr_db(pid=26929): Launched 21:00:04.861293 bus /gobi_6: Setting Powered False 21:00:05.922947 run create_hlr_db(pid=26929): Terminated: ok {rc=0} 21:00:06.376668 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26931): Launched 21:00:06.710566 run osmo-hlr_10.42.42.2(pid=26932): Launched 21:00:06.839076 run osmo-stp_10.42.42.5: Starting osmo-stp 21:00:07.421674 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26935): Launched 21:00:07.758442 run osmo-stp_10.42.42.5(pid=26936): Launched 21:00:07.886011 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:00:08.463303 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26938): Launched 21:00:08.592294 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:00:08.874425 run patchelf(pid=26939): Launched 21:00:09.061253 run osmo-stp_10.42.42.5(pid=26936): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26936)] 21:00:09.202918 run osmo-stp_10.42.42.5(pid=26936): stdout: | (launched: 2022-12-12_21:00:07.697071) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:00:09.345834 run osmo-stp_10.42.42.5(pid=26936): stderr: | 20221212210007889 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210007889 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210007889 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210007889 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210007890 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210007890 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210007890 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:00:09.489251 run osmo-stp_10.42.42.5(pid=26936): stdout: | (launched: 2022-12-12_21:00:07.697071) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:00:09.626341 run osmo-stp_10.42.42.5(pid=26936): stderr: | 20221212210007889 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210007889 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210007889 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210007889 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210007890 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210007890 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210007890 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:00:09.788588 run patchelf(pid=26939): Terminating (SIGINT) 21:00:09.976242 run patchelf(pid=26939): Terminated: ok {rc=0} 21:00:10.111674 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=26936): Process ended prematurely: osmo-stp_10.42.42.5(pid=26936) [trial-2382↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26936)] [trial-2382↪gprs:trx-b200↪ping.py:22] 21:00:10.121387 tst ping.py:22: Test FAILED (6.8 sec) 21:00:10.150897 run osmo-hlr_10.42.42.2(pid=26932): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-b200↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26932)] 21:00:10.203214 run osmo-hlr_10.42.42.2(pid=26932): stdout: | (launched: 2022-12-12_21:00:06.649793) 21:00:10.257368 run osmo-hlr_10.42.42.2(pid=26932): stderr: | 20221212210006847 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212210006847 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212210006847 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212210006847 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212210006847 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212210006847 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212210006860 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-b200/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212210006869 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212210006869 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212210006870 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:00:10.312019 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26931): Terminating (SIGTERM) 21:00:10.355771 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26935): Terminating (SIGTERM) 21:00:10.399506 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26938): Terminating (SIGTERM) 21:00:10.443525 --- ParallelTerminationStrategy: PID 26931 died... 21:00:10.464255 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26931): Terminated: ok {rc=0} 21:00:10.512859 --- ParallelTerminationStrategy: PID 26935 died... 21:00:10.533229 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26935): Terminated: ok {rc=0} 21:00:10.581482 --- ParallelTerminationStrategy: PID 26938 died... 21:00:10.601771 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26938): Terminated: ok {rc=0} 21:00:10.693012 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:trx-b200 ping_idle_ping.py ---------------------------------------------- 21:00:11.783543 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 21:00:11.795498 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 21:00:11.846694 tst ping_idle_ping.py: using LAC 31471 21:00:11.970781 tst ping_idle_ping.py: using RAC 106 21:00:12.096341 tst ping_idle_ping.py: using CellId 31471 21:00:12.220593 tst ping_idle_ping.py: using BVCI 31472 21:00:12.337601 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 21:00:12.348310 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 21:00:12.358968 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 21:00:12.369666 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 21:00:12.380063 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 21:00:12.391005 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 21:00:12.401689 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 21:00:12.412218 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 21:00:12.533641 tst ping_idle_ping.py:24: start network... 21:00:12.759334 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:00:13.279479 run create_hlr_db(pid=26941): Launched 21:00:13.408737 bus /gobi_6: Setting Powered False 21:00:14.475209 run create_hlr_db(pid=26941): Terminated: ok {rc=0} 21:00:14.919661 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26943): Launched 21:00:15.232834 run osmo-hlr_10.42.42.2(pid=26944): Launched 21:00:15.351334 run osmo-stp_10.42.42.5: Starting osmo-stp 21:00:15.949897 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26946): Launched 21:00:16.281841 run osmo-stp_10.42.42.5(pid=26947): Launched 21:00:16.558043 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:00:17.155637 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26949): Launched 21:00:17.289217 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:00:17.556376 run patchelf(pid=26950): Launched 21:00:17.732574 run osmo-stp_10.42.42.5(pid=26947): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26947)] 21:00:17.865114 run osmo-stp_10.42.42.5(pid=26947): stdout: | (launched: 2022-12-12_21:00:16.217735) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:00:17.998374 run osmo-stp_10.42.42.5(pid=26947): stderr: | 20221212210016408 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210016408 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210016409 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210016409 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210016410 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210016410 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210016410 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:00:18.132062 run osmo-stp_10.42.42.5(pid=26947): stdout: | (launched: 2022-12-12_21:00:16.217735) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:00:18.259632 run osmo-stp_10.42.42.5(pid=26947): stderr: | 20221212210016408 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210016408 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210016409 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210016409 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210016410 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210016410 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210016410 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:00:18.411680 run patchelf(pid=26950): Terminating (SIGINT) 21:00:18.587394 run patchelf(pid=26950): Terminated: ok {rc=0} 21:00:18.713906 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=26947): Process ended prematurely: osmo-stp_10.42.42.5(pid=26947) [trial-2382↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26947)] [trial-2382↪gprs:trx-b200↪ping_idle_ping.py:27] 21:00:18.722904 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 21:00:18.750137 run osmo-hlr_10.42.42.2(pid=26944): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-b200↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26944)] 21:00:18.798967 run osmo-hlr_10.42.42.2(pid=26944): stdout: | (launched: 2022-12-12_21:00:15.175450) 21:00:18.850347 run osmo-hlr_10.42.42.2(pid=26944): stderr: | 20221212210015355 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212210015355 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212210015355 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212210015355 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212210015355 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212210015355 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212210015370 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-b200/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212210015379 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212210015379 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212210015379 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:00:18.901348 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26943): Terminating (SIGTERM) 21:00:18.941812 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26946): Terminating (SIGTERM) 21:00:18.982323 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26949): Terminating (SIGTERM) 21:00:19.023260 --- ParallelTerminationStrategy: PID 26943 died... 21:00:19.043014 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26943): Terminated: ok {rc=0} 21:00:19.088292 --- ParallelTerminationStrategy: PID 26946 died... 21:00:19.107753 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26946): Terminated: ok {rc=0} 21:00:19.152736 --- ParallelTerminationStrategy: PID 26949 died... 21:00:19.171877 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26949): Terminated: ok {rc=0} 21:00:19.257938 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2382 gprs:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 gprs:trx-b200+mod-bts0-egprs --------------------------------------------------------------------- 21:00:20.572935 tst gprs:trx-b200+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:00:20.579481 tst gprs:trx-b200+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 21:00:20.616311 tst gprs:trx-b200+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 21:00:20.656879 tst gprs:trx-b200+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 21:00:20.746723 tst gprs:trx-b200+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 21:00:20.781516 tst gprs:trx-b200+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 21:00:20.821573 tst gprs:trx-b200+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 21:00:21.416312 tst gprs:trx-b200+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2382 gprs:trx-b200+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 21:00:21.472400 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:00:21.483953 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:00:21.537404 tst cs_paging_gprs_active.py: using LAC 31472 21:00:21.674299 tst cs_paging_gprs_active.py: using RAC 107 21:00:21.809065 tst cs_paging_gprs_active.py: using CellId 31472 21:00:21.941045 tst cs_paging_gprs_active.py: using BVCI 31473 21:00:22.064444 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:00:22.075921 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:00:22.087097 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:00:22.098666 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:00:22.110291 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:00:22.121882 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:00:22.133763 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:00:22.145294 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:00:22.157090 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:00:22.278575 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:00:22.401690 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 21:00:22.632426 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:00:22.973433 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26954): Launched 21:00:23.270616 run iperf3-srv_10.42.42.10(pid=26955): Launched 21:00:23.400420 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 21:00:23.631184 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:00:23.973727 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26956): Launched 21:00:24.270295 run iperf3-srv_10.42.42.10(pid=26957): Launched 21:00:24.398488 tst cs_paging_gprs_active.py:38: start network... 21:00:24.629145 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:00:25.156633 run create_hlr_db(pid=26958): Launched 21:00:25.286272 bus /gobi_6: Setting Powered False 21:00:26.353914 run create_hlr_db(pid=26958): Terminated: ok {rc=0} 21:00:26.825930 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26960): Launched 21:00:27.165325 run osmo-hlr_10.42.42.2(pid=26961): Launched 21:00:27.295483 run osmo-stp_10.42.42.5: Starting osmo-stp 21:00:27.881632 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26963): Launched 21:00:28.223320 run osmo-stp_10.42.42.5(pid=26964): Launched 21:00:28.354696 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:00:28.942188 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26966): Launched 21:00:29.071686 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:00:29.359626 run patchelf(pid=26967): Launched 21:00:29.548702 run osmo-stp_10.42.42.5(pid=26964): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26964)] 21:00:29.692185 run osmo-stp_10.42.42.5(pid=26964): stdout: | (launched: 2022-12-12_21:00:28.161382) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:00:29.837719 run osmo-stp_10.42.42.5(pid=26964): stderr: | 20221212210028354 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210028354 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210028355 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210028355 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210028356 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210028356 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210028356 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:00:29.982911 run osmo-stp_10.42.42.5(pid=26964): stdout: | (launched: 2022-12-12_21:00:28.161382) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:00:30.122525 run osmo-stp_10.42.42.5(pid=26964): stderr: | 20221212210028354 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210028354 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210028355 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210028355 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210028356 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210028356 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210028356 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:00:30.287807 run patchelf(pid=26967): Terminating (SIGINT) 21:00:30.479749 run patchelf(pid=26967): Terminated: ok {rc=0} 21:00:30.617645 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=26964): Process ended prematurely: osmo-stp_10.42.42.5(pid=26964) [trial-2382↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26964)] [trial-2382↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 21:00:30.628095 tst cs_paging_gprs_active.py:38: Test FAILED (9.2 sec) 21:00:30.657923 run osmo-hlr_10.42.42.2(pid=26961): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26961)] 21:00:30.709637 run osmo-hlr_10.42.42.2(pid=26961): stdout: | (launched: 2022-12-12_21:00:27.103268) 21:00:30.763271 run osmo-hlr_10.42.42.2(pid=26961): stderr: | 20221212210027303 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212210027303 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212210027303 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212210027303 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212210027303 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212210027303 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212210027316 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-b200+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212210027324 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212210027325 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212210027325 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:00:30.817538 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26954): Terminating (SIGTERM) 21:00:30.865316 run iperf3-srv_10.42.42.10(pid=26955): Terminating (SIGTERM) 21:00:30.909600 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26956): Terminating (SIGTERM) 21:00:30.954007 run iperf3-srv_10.42.42.10(pid=26957): Terminating (SIGTERM) 21:00:30.997970 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26960): Terminating (SIGTERM) 21:00:31.042139 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26963): Terminating (SIGTERM) 21:00:31.086522 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26966): Terminating (SIGTERM) 21:00:31.130890 --- ParallelTerminationStrategy: PID 26954 died... 21:00:31.151686 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26954): Terminated: ok {rc=0} 21:00:31.200617 --- ParallelTerminationStrategy: PID 26955 died... 21:00:31.221425 run iperf3-srv_10.42.42.10(pid=26955): Terminated {rc=256} 21:00:31.270103 --- ParallelTerminationStrategy: PID 26956 died... 21:00:31.290773 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26956): Terminated: ok {rc=0} 21:00:31.339937 --- ParallelTerminationStrategy: PID 26957 died... 21:00:31.360547 run iperf3-srv_10.42.42.10(pid=26957): Terminated {rc=256} 21:00:31.409758 --- ParallelTerminationStrategy: PID 26960 died... 21:00:31.430420 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26960): Terminated: ok {rc=0} 21:00:31.479355 --- ParallelTerminationStrategy: PID 26963 died... 21:00:31.500222 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26963): Terminated: ok {rc=0} 21:00:31.549161 --- ParallelTerminationStrategy: PID 26966 died... 21:00:31.569892 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26966): Terminated: ok {rc=0} 21:00:31.661816 bus /gobi_0: Setting Powered False 21:00:32.763659 bus /gobi_0: Setting Powered False 21:00:33.881860 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:trx-b200+mod-bts0-egprs iperf3.py ---------------------------------------------- 21:00:35.033546 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:00:35.045093 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:00:35.099507 tst iperf3.py: using LAC 31473 21:00:35.225448 tst iperf3.py: using RAC 108 21:00:35.352249 tst iperf3.py: using CellId 31473 21:00:35.478823 tst iperf3.py: using BVCI 31474 21:00:35.596351 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:00:35.607398 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:00:35.618079 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:00:35.628681 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:00:35.639346 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:00:35.650049 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:00:35.660792 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:00:35.671441 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:00:35.682225 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:00:35.798520 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 21:00:36.011681 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:00:36.330765 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26968): Launched 21:00:36.607537 run iperf3-srv_10.42.42.10(pid=26969): Launched 21:00:36.726541 tst iperf3.py:8: start network... 21:00:36.939566 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:00:37.431486 run create_hlr_db(pid=26970): Launched 21:00:37.559628 bus /gobi_6: Setting Powered False 21:00:38.622694 run create_hlr_db(pid=26970): Terminated: ok {rc=0} 21:00:39.062273 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26972): Launched 21:00:39.379133 run osmo-hlr_10.42.42.2(pid=26973): Launched 21:00:39.499410 run osmo-stp_10.42.42.5: Starting osmo-stp 21:00:40.042798 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26975): Launched 21:00:40.359094 run osmo-stp_10.42.42.5(pid=26976): Launched 21:00:40.481082 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:00:41.025482 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26978): Launched 21:00:41.146756 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:00:41.415210 run patchelf(pid=26979): Launched 21:00:41.590114 run osmo-stp_10.42.42.5(pid=26976): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26976)] 21:00:41.723364 run osmo-stp_10.42.42.5(pid=26976): stdout: | (launched: 2022-12-12_21:00:40.301064) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:00:41.858397 run osmo-stp_10.42.42.5(pid=26976): stderr: | 20221212210040471 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210040471 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210040471 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210040472 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210040472 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210040472 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210040472 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:00:41.993582 run osmo-stp_10.42.42.5(pid=26976): stdout: | (launched: 2022-12-12_21:00:40.301064) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:00:42.122986 run osmo-stp_10.42.42.5(pid=26976): stderr: | 20221212210040471 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210040471 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210040471 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210040472 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210040472 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210040472 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210040472 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:00:42.276166 run patchelf(pid=26979): Terminating (SIGINT) 21:00:42.453593 run patchelf(pid=26979): Terminated: ok {rc=0} 21:00:42.582531 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26976): Process ended prematurely: osmo-stp_10.42.42.5(pid=26976) [trial-2382↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26976)] [trial-2382↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8] 21:00:42.592084 tst iperf3.py:8: Test FAILED (7.6 sec) 21:00:42.619600 run osmo-hlr_10.42.42.2(pid=26973): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26973)] 21:00:42.668139 run osmo-hlr_10.42.42.2(pid=26973): stdout: | (launched: 2022-12-12_21:00:39.321295) 21:00:42.718603 run osmo-hlr_10.42.42.2(pid=26973): stderr: | 20221212210039497 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212210039497 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212210039498 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212210039498 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212210039498 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212210039498 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212210039522 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-b200+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212210039532 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212210039533 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212210039533 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:00:42.769652 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26968): Terminating (SIGTERM) 21:00:42.810288 run iperf3-srv_10.42.42.10(pid=26969): Terminating (SIGTERM) 21:00:42.850765 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26972): Terminating (SIGTERM) 21:00:42.891244 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26975): Terminating (SIGTERM) 21:00:42.931712 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26978): Terminating (SIGTERM) 21:00:42.972284 --- ParallelTerminationStrategy: PID 26968 died... 21:00:42.991778 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26968): Terminated: ok {rc=0} 21:00:43.036838 --- ParallelTerminationStrategy: PID 26969 died... 21:00:43.055792 run iperf3-srv_10.42.42.10(pid=26969): Terminated {rc=256} 21:00:43.101210 --- ParallelTerminationStrategy: PID 26972 died... 21:00:43.120136 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26972): Terminated: ok {rc=0} 21:00:43.165519 --- ParallelTerminationStrategy: PID 26975 died... 21:00:43.184398 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26975): Terminated: ok {rc=0} 21:00:43.229146 --- ParallelTerminationStrategy: PID 26978 died... 21:00:43.248195 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26978): Terminated: ok {rc=0} 21:00:43.335488 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:trx-b200+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 21:00:44.487734 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:00:44.499314 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:00:44.550901 tst iperf3m4.py: using LAC 31474 21:00:44.686106 tst iperf3m4.py: using RAC 109 21:00:44.820911 tst iperf3m4.py: using CellId 31474 21:00:44.953673 tst iperf3m4.py: using BVCI 31475 21:00:45.079316 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:00:45.091055 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:00:45.102391 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:00:45.114384 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:00:45.126423 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:00:45.138390 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:00:45.150648 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:00:45.162490 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:00:45.174643 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:00:45.295607 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:00:45.417820 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:00:45.544902 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:00:45.664787 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 21:00:45.882702 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:00:46.212117 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26980): Launched 21:00:46.504910 run iperf3-srv_10.42.42.10(pid=26981): Launched 21:00:46.639168 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 21:00:46.855948 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:00:47.181659 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26982): Launched 21:00:47.475499 run iperf3-srv_10.42.42.10(pid=26983): Launched 21:00:47.593835 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 21:00:47.805470 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:00:48.122835 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26984): Launched 21:00:48.399324 run iperf3-srv_10.42.42.10(pid=26985): Launched 21:00:48.518138 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 21:00:48.731826 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:00:49.049961 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26986): Launched 21:00:49.325055 run iperf3-srv_10.42.42.10(pid=26987): Launched 21:00:49.443526 tst iperf3m4.py:8: start network... 21:00:49.655524 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:00:50.145560 run create_hlr_db(pid=26988): Launched 21:00:50.275448 bus /gobi_6: Setting Powered False 21:00:51.338232 run create_hlr_db(pid=26988): Terminated: ok {rc=0} 21:00:51.778133 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26990): Launched 21:00:52.096220 run osmo-hlr_10.42.42.2(pid=26991): Launched 21:00:52.216614 run osmo-stp_10.42.42.5: Starting osmo-stp 21:00:52.778595 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26993): Launched 21:00:53.095006 run osmo-stp_10.42.42.5(pid=26994): Launched 21:00:53.217427 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:00:53.763256 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26996): Launched 21:00:53.883765 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:00:54.150944 run patchelf(pid=26997): Launched 21:00:54.328363 run osmo-stp_10.42.42.5(pid=26994): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26994)] 21:00:54.462007 run osmo-stp_10.42.42.5(pid=26994): stdout: | (launched: 2022-12-12_21:00:53.036429) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:00:54.596934 run osmo-stp_10.42.42.5(pid=26994): stderr: | 20221212210053210 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210053210 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210053210 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210053210 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210053211 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210053211 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210053211 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:00:54.732645 run osmo-stp_10.42.42.5(pid=26994): stdout: | (launched: 2022-12-12_21:00:53.036429) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:00:54.862332 run osmo-stp_10.42.42.5(pid=26994): stderr: | 20221212210053210 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210053210 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210053210 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210053210 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210053211 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210053211 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210053211 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:00:55.015677 run patchelf(pid=26997): Terminating (SIGINT) 21:00:55.193855 run patchelf(pid=26997): Terminated: ok {rc=0} 21:00:55.321948 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26994): Process ended prematurely: osmo-stp_10.42.42.5(pid=26994) [trial-2382↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26994)] [trial-2382↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8] 21:00:55.331415 tst iperf3m4.py:8: Test FAILED (10.9 sec) 21:00:55.359501 run osmo-hlr_10.42.42.2(pid=26991): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26991)] 21:00:55.408573 run osmo-hlr_10.42.42.2(pid=26991): stdout: | (launched: 2022-12-12_21:00:52.037144) 21:00:55.459473 run osmo-hlr_10.42.42.2(pid=26991): stderr: | 20221212210052216 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212210052216 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212210052216 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212210052216 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212210052216 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212210052216 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212210052228 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-b200+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212210052236 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212210052236 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212210052237 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:00:55.510687 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26980): Terminating (SIGTERM) 21:00:55.551407 run iperf3-srv_10.42.42.10(pid=26981): Terminating (SIGTERM) 21:00:55.592056 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26982): Terminating (SIGTERM) 21:00:55.632723 run iperf3-srv_10.42.42.10(pid=26983): Terminating (SIGTERM) 21:00:55.673137 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26984): Terminating (SIGTERM) 21:00:55.714338 run iperf3-srv_10.42.42.10(pid=26985): Terminating (SIGTERM) 21:00:55.754543 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26986): Terminating (SIGTERM) 21:00:55.794832 run iperf3-srv_10.42.42.10(pid=26987): Terminating (SIGTERM) 21:00:55.835020 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26990): Terminating (SIGTERM) 21:00:55.875683 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26993): Terminating (SIGTERM) 21:00:55.916017 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26996): Terminating (SIGTERM) 21:00:55.956675 --- ParallelTerminationStrategy: PID 26980 died... 21:00:55.976124 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26980): Terminated: ok {rc=0} 21:00:56.021495 --- ParallelTerminationStrategy: PID 26981 died... 21:00:56.040366 run iperf3-srv_10.42.42.10(pid=26981): Terminated {rc=256} 21:00:56.084638 --- ParallelTerminationStrategy: PID 26982 died... 21:00:56.103683 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26982): Terminated: ok {rc=0} 21:00:56.148072 --- ParallelTerminationStrategy: PID 26983 died... 21:00:56.167102 run iperf3-srv_10.42.42.10(pid=26983): Terminated {rc=256} 21:00:56.211592 --- ParallelTerminationStrategy: PID 26984 died... 21:00:56.230507 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26984): Terminated: ok {rc=0} 21:00:56.275027 --- ParallelTerminationStrategy: PID 26985 died... 21:00:56.293922 run iperf3-srv_10.42.42.10(pid=26985): Terminated {rc=256} 21:00:56.338426 --- ParallelTerminationStrategy: PID 26986 died... 21:00:56.357289 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26986): Terminated: ok {rc=0} 21:00:56.401771 --- ParallelTerminationStrategy: PID 26987 died... 21:00:56.420558 run iperf3-srv_10.42.42.10(pid=26987): Terminated {rc=256} 21:00:56.465311 --- ParallelTerminationStrategy: PID 26990 died... 21:00:56.484420 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26990): Terminated: ok {rc=0} 21:00:56.529201 --- ParallelTerminationStrategy: PID 26993 died... 21:00:56.548092 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26993): Terminated: ok {rc=0} 21:00:56.592880 --- ParallelTerminationStrategy: PID 26996 died... 21:00:56.611932 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26996): Terminated: ok {rc=0} 21:00:56.699830 bus /gobi_4: Setting Powered False 21:00:57.803013 bus /gobi_4: Setting Powered False 21:00:58.920506 bus /gobi_1: Setting Powered False 21:01:00.021996 bus /gobi_1: Setting Powered False 21:01:01.140397 bus /gobi_0: Setting Powered False 21:01:02.248524 bus /gobi_0: Setting Powered False 21:01:03.366851 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:trx-b200+mod-bts0-egprs ping.py ---------------------------------------------- 21:01:04.473111 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:01:04.485071 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:01:04.535392 tst ping.py: using LAC 31475 21:01:04.657550 tst ping.py: using RAC 110 21:01:04.781910 tst ping.py: using CellId 31475 21:01:04.902367 tst ping.py: using BVCI 31476 21:01:05.017840 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:01:05.028785 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:01:05.039600 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:01:05.050669 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:01:05.061621 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:01:05.072442 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:01:05.083359 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:01:05.094466 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:01:05.213714 tst ping.py:19: start network... 21:01:05.420497 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:01:05.900746 run create_hlr_db(pid=26998): Launched 21:01:06.026875 bus /gobi_6: Setting Powered False 21:01:07.088803 run create_hlr_db(pid=26998): Terminated: ok {rc=0} 21:01:07.522137 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27000): Launched 21:01:07.834126 run osmo-hlr_10.42.42.2(pid=27001): Launched 21:01:07.954008 run osmo-stp_10.42.42.5: Starting osmo-stp 21:01:08.508796 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27003): Launched 21:01:08.819728 run osmo-stp_10.42.42.5(pid=27004): Launched 21:01:08.937037 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:01:09.473330 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27006): Launched 21:01:09.591508 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:01:09.853631 run patchelf(pid=27007): Launched 21:01:10.026054 run osmo-stp_10.42.42.5(pid=27004): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27004)] 21:01:10.157420 run osmo-stp_10.42.42.5(pid=27004): stdout: | (launched: 2022-12-12_21:01:08.762532) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:01:10.290365 run osmo-stp_10.42.42.5(pid=27004): stderr: | 20221212210108932 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210108932 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210108932 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210108933 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210108933 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210108933 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210108933 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:01:10.423371 run osmo-stp_10.42.42.5(pid=27004): stdout: | (launched: 2022-12-12_21:01:08.762532) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:01:10.550858 run osmo-stp_10.42.42.5(pid=27004): stderr: | 20221212210108932 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210108932 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210108932 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210108933 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210108933 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210108933 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210108933 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:01:10.701454 run patchelf(pid=27007): Terminating (SIGINT) 21:01:10.877397 run patchelf(pid=27007): Terminated: ok {rc=0} 21:01:11.003261 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=27004): Process ended prematurely: osmo-stp_10.42.42.5(pid=27004) [trial-2382↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27004)] [trial-2382↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22] 21:01:11.012310 tst ping.py:22: Test FAILED (6.5 sec) 21:01:11.039740 run osmo-hlr_10.42.42.2(pid=27001): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-b200+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27001)] 21:01:11.089282 run osmo-hlr_10.42.42.2(pid=27001): stdout: | (launched: 2022-12-12_21:01:07.776268) 21:01:11.140298 run osmo-hlr_10.42.42.2(pid=27001): stderr: | 20221212210107954 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212210107954 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212210107954 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212210107955 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212210107955 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212210107955 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212210107967 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-b200+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212210107975 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212210107975 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212210107975 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:01:11.191667 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27000): Terminating (SIGTERM) 21:01:11.232618 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27003): Terminating (SIGTERM) 21:01:11.273628 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27006): Terminating (SIGTERM) 21:01:11.315022 --- ParallelTerminationStrategy: PID 27000 died... 21:01:11.334809 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27000): Terminated: ok {rc=0} 21:01:11.380317 --- ParallelTerminationStrategy: PID 27003 died... 21:01:11.399364 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27003): Terminated: ok {rc=0} 21:01:11.444637 --- ParallelTerminationStrategy: PID 27006 died... 21:01:11.463864 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27006): Terminated: ok {rc=0} 21:01:11.550150 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:trx-b200+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 21:01:12.639273 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:01:12.652256 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:01:12.712290 tst ping_idle_ping.py: using LAC 31476 21:01:12.842372 tst ping_idle_ping.py: using RAC 111 21:01:12.974388 tst ping_idle_ping.py: using CellId 31476 21:01:13.106241 tst ping_idle_ping.py: using BVCI 31477 21:01:13.230401 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:01:13.242283 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:01:13.253933 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:01:13.266493 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:01:13.278836 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:01:13.292073 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:01:13.303554 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:01:13.314529 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:01:13.430611 tst ping_idle_ping.py:24: start network... 21:01:13.639625 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:01:14.126293 run create_hlr_db(pid=27009): Launched 21:01:14.258207 bus /gobi_6: Setting Powered False 21:01:15.320324 run create_hlr_db(pid=27009): Terminated: ok {rc=0} 21:01:15.776050 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27011): Launched 21:01:16.159394 run osmo-hlr_10.42.42.2(pid=27012): Launched 21:01:16.428931 run osmo-stp_10.42.42.5: Starting osmo-stp 21:01:17.213996 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27014): Launched 21:01:17.563569 run osmo-stp_10.42.42.5(pid=27015): Launched 21:01:17.692157 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:01:18.272484 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27017): Launched 21:01:18.402844 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:01:18.687870 run patchelf(pid=27018): Launched 21:01:18.876471 run osmo-stp_10.42.42.5(pid=27015): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27015)] 21:01:19.018805 run osmo-stp_10.42.42.5(pid=27015): stdout: | (launched: 2022-12-12_21:01:17.502397) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:01:19.162869 run osmo-stp_10.42.42.5(pid=27015): stderr: | 20221212210117692 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210117692 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210117692 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210117692 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210117693 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210117693 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210117693 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:01:19.307081 run osmo-stp_10.42.42.5(pid=27015): stdout: | (launched: 2022-12-12_21:01:17.502397) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:01:19.445591 run osmo-stp_10.42.42.5(pid=27015): stderr: | 20221212210117692 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210117692 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210117692 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210117692 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210117693 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210117693 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210117693 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:01:19.609153 run patchelf(pid=27018): Terminating (SIGINT) 21:01:19.798237 run patchelf(pid=27018): Terminated: ok {rc=0} 21:01:19.934542 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=27015): Process ended prematurely: osmo-stp_10.42.42.5(pid=27015) [trial-2382↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27015)] [trial-2382↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27] 21:01:19.944313 tst ping_idle_ping.py:27: Test FAILED (7.3 sec) 21:01:19.973914 run osmo-hlr_10.42.42.2(pid=27012): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27012)] 21:01:20.025978 run osmo-hlr_10.42.42.2(pid=27012): stdout: | (launched: 2022-12-12_21:01:16.098528) 21:01:20.079942 run osmo-hlr_10.42.42.2(pid=27012): stderr: | 20221212210116359 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212210116359 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212210116359 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212210116359 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212210116359 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212210116359 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212210116374 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-b200+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212210116394 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212210116394 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212210116394 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:01:20.134618 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27011): Terminating (SIGTERM) 21:01:20.178154 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27014): Terminating (SIGTERM) 21:01:20.221477 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27017): Terminating (SIGTERM) 21:01:20.265231 --- ParallelTerminationStrategy: PID 27011 died... 21:01:20.285898 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27011): Terminated: ok {rc=0} 21:01:20.334660 --- ParallelTerminationStrategy: PID 27014 died... 21:01:20.354968 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27014): Terminated: ok {rc=0} 21:01:20.403880 --- ParallelTerminationStrategy: PID 27017 died... 21:01:20.424659 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27017): Terminated: ok {rc=0} 21:01:20.515979 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2382 gprs:trx-b200+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 gprs:trx-b200+mod-bts0-dynts-ipa --------------------------------------------------------------------- 21:01:21.825624 tst gprs:trx-b200+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:01:21.831766 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 21:01:21.865211 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 21:01:21.904207 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 21:01:21.992840 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 21:01:22.026798 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 21:01:22.065499 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 21:01:22.657706 tst gprs:trx-b200+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2382 gprs:trx-b200+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 21:01:22.708582 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:01:22.719703 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 21:01:22.789284 tst cs_paging_gprs_active.py: using LAC 31477 21:01:22.914622 tst cs_paging_gprs_active.py: using RAC 112 21:01:23.038891 tst cs_paging_gprs_active.py: using CellId 31477 21:01:23.165383 tst cs_paging_gprs_active.py: using BVCI 31478 21:01:23.280654 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:01:23.291759 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:01:23.302635 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:01:23.313528 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:01:23.324208 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:01:23.335066 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:01:23.346164 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:01:23.356830 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:01:23.367814 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:01:23.491551 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:01:23.616170 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 21:01:23.847744 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:01:24.190194 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27022): Launched 21:01:24.488689 run iperf3-srv_10.42.42.10(pid=27023): Launched 21:01:24.616724 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 21:01:24.848018 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:01:25.191680 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27024): Launched 21:01:25.487867 run iperf3-srv_10.42.42.10(pid=27025): Launched 21:01:25.616009 tst cs_paging_gprs_active.py:38: start network... 21:01:25.847199 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:01:26.376206 run create_hlr_db(pid=27026): Launched 21:01:26.507304 bus /gobi_6: Setting Powered False 21:01:27.574144 run create_hlr_db(pid=27026): Terminated: ok {rc=0} 21:01:28.046787 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27028): Launched 21:01:28.386721 run osmo-hlr_10.42.42.2(pid=27029): Launched 21:01:28.519525 run osmo-stp_10.42.42.5: Starting osmo-stp 21:01:29.104020 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27031): Launched 21:01:29.444855 run osmo-stp_10.42.42.5(pid=27032): Launched 21:01:29.577518 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:01:30.164173 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27034): Launched 21:01:30.295431 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:01:30.584131 run patchelf(pid=27035): Launched 21:01:30.772769 run osmo-stp_10.42.42.5(pid=27032): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27032)] 21:01:30.918542 run osmo-stp_10.42.42.5(pid=27032): stdout: | (launched: 2022-12-12_21:01:29.382644) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:01:31.065830 run osmo-stp_10.42.42.5(pid=27032): stderr: | 20221212210129579 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210129579 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210129580 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210129580 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210129580 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210129581 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210129581 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:01:31.214944 run osmo-stp_10.42.42.5(pid=27032): stdout: | (launched: 2022-12-12_21:01:29.382644) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:01:31.358569 run osmo-stp_10.42.42.5(pid=27032): stderr: | 20221212210129579 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210129579 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210129580 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210129580 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210129580 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210129581 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210129581 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:01:31.528369 run patchelf(pid=27035): Terminating (SIGINT) 21:01:31.723797 run patchelf(pid=27035): Terminated: ok {rc=0} 21:01:31.865290 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=27032): Process ended prematurely: osmo-stp_10.42.42.5(pid=27032) [trial-2382↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27032)] [trial-2382↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 21:01:31.876672 tst cs_paging_gprs_active.py:38: Test FAILED (9.2 sec) 21:01:31.910345 run osmo-hlr_10.42.42.2(pid=27029): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27029)] 21:01:31.964199 run osmo-hlr_10.42.42.2(pid=27029): stdout: | (launched: 2022-12-12_21:01:28.324623) 21:01:32.019898 run osmo-hlr_10.42.42.2(pid=27029): stderr: | 20221212210128524 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212210128524 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212210128524 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212210128524 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212210128524 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212210128524 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212210128564 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-b200+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212210128574 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212210128574 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212210128574 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:01:32.076281 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27022): Terminating (SIGTERM) 21:01:32.121860 run iperf3-srv_10.42.42.10(pid=27023): Terminating (SIGTERM) 21:01:32.166875 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27024): Terminating (SIGTERM) 21:01:32.212209 run iperf3-srv_10.42.42.10(pid=27025): Terminating (SIGTERM) 21:01:32.255568 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27028): Terminating (SIGTERM) 21:01:32.298570 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27031): Terminating (SIGTERM) 21:01:32.341973 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27034): Terminating (SIGTERM) 21:01:32.385250 --- ParallelTerminationStrategy: PID 27022 died... 21:01:32.405591 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27022): Terminated: ok {rc=0} 21:01:32.454420 --- ParallelTerminationStrategy: PID 27023 died... 21:01:32.474532 run iperf3-srv_10.42.42.10(pid=27023): Terminated {rc=256} 21:01:32.522287 --- ParallelTerminationStrategy: PID 27024 died... 21:01:32.542357 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27024): Terminated: ok {rc=0} 21:01:32.589964 --- ParallelTerminationStrategy: PID 27025 died... 21:01:32.609896 run iperf3-srv_10.42.42.10(pid=27025): Terminated {rc=256} 21:01:32.657505 --- ParallelTerminationStrategy: PID 27028 died... 21:01:32.677336 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27028): Terminated: ok {rc=0} 21:01:32.725299 --- ParallelTerminationStrategy: PID 27031 died... 21:01:32.745239 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27031): Terminated: ok {rc=0} 21:01:32.792713 --- ParallelTerminationStrategy: PID 27034 died... 21:01:32.812702 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27034): Terminated: ok {rc=0} 21:01:32.903013 bus /gobi_0: Setting Powered False 21:01:34.005133 bus /gobi_0: Setting Powered False 21:01:35.122807 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:trx-b200+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 21:01:36.277360 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:01:36.289617 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 21:01:36.369070 tst iperf3.py: using LAC 31478 21:01:36.501299 tst iperf3.py: using RAC 113 21:01:36.632124 tst iperf3.py: using CellId 31478 21:01:36.763794 tst iperf3.py: using BVCI 31479 21:01:36.880299 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:01:36.891545 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:01:36.902587 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:01:36.913958 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:01:36.925114 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:01:36.936258 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:01:36.947624 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:01:36.958549 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:01:36.970187 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:01:37.091482 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 21:01:37.320290 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:01:37.661478 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27036): Launched 21:01:37.959230 run iperf3-srv_10.42.42.10(pid=27037): Launched 21:01:38.086394 tst iperf3.py:8: start network... 21:01:38.315696 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:01:38.841906 run create_hlr_db(pid=27038): Launched 21:01:38.971671 bus /gobi_6: Setting Powered False 21:01:40.037851 run create_hlr_db(pid=27038): Terminated: ok {rc=0} 21:01:40.486903 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27040): Launched 21:01:40.802279 run osmo-hlr_10.42.42.2(pid=27041): Launched 21:01:40.924038 run osmo-stp_10.42.42.5: Starting osmo-stp 21:01:41.483769 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27043): Launched 21:01:41.800877 run osmo-stp_10.42.42.5(pid=27044): Launched 21:01:41.921251 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:01:42.466426 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27046): Launched 21:01:42.587895 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:01:42.855915 run patchelf(pid=27047): Launched 21:01:43.032105 run osmo-stp_10.42.42.5(pid=27044): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27044)] 21:01:43.165934 run osmo-stp_10.42.42.5(pid=27044): stdout: | (launched: 2022-12-12_21:01:41.742863) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:01:43.300762 run osmo-stp_10.42.42.5(pid=27044): stderr: | 20221212210141916 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210141916 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210141917 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210141917 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210141918 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210141918 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210141918 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:01:43.435728 run osmo-stp_10.42.42.5(pid=27044): stdout: | (launched: 2022-12-12_21:01:41.742863) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:01:43.565537 run osmo-stp_10.42.42.5(pid=27044): stderr: | 20221212210141916 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210141916 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210141917 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210141917 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210141918 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210141918 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210141918 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:01:43.719078 run patchelf(pid=27047): Terminating (SIGINT) 21:01:43.896736 run patchelf(pid=27047): Terminated: ok {rc=0} 21:01:44.025179 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27044): Process ended prematurely: osmo-stp_10.42.42.5(pid=27044) [trial-2382↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27044)] [trial-2382↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8] 21:01:44.034759 tst iperf3.py:8: Test FAILED (7.8 sec) 21:01:44.062742 run osmo-hlr_10.42.42.2(pid=27041): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27041)] 21:01:44.111826 run osmo-hlr_10.42.42.2(pid=27041): stdout: | (launched: 2022-12-12_21:01:40.744399) 21:01:44.162702 run osmo-hlr_10.42.42.2(pid=27041): stderr: | 20221212210140921 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212210140921 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212210140921 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212210140921 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212210140922 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212210140922 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212210140934 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212210140942 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212210140942 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212210140942 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:01:44.214044 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27036): Terminating (SIGTERM) 21:01:44.255098 run iperf3-srv_10.42.42.10(pid=27037): Terminating (SIGTERM) 21:01:44.296350 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27040): Terminating (SIGTERM) 21:01:44.337741 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27043): Terminating (SIGTERM) 21:01:44.378917 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27046): Terminating (SIGTERM) 21:01:44.420603 --- ParallelTerminationStrategy: PID 27036 died... 21:01:44.440508 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27036): Terminated: ok {rc=0} 21:01:44.486516 --- ParallelTerminationStrategy: PID 27037 died... 21:01:44.505888 run iperf3-srv_10.42.42.10(pid=27037): Terminated {rc=256} 21:01:44.551449 --- ParallelTerminationStrategy: PID 27040 died... 21:01:44.570793 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27040): Terminated: ok {rc=0} 21:01:44.616252 --- ParallelTerminationStrategy: PID 27043 died... 21:01:44.635648 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27043): Terminated: ok {rc=0} 21:01:44.681329 --- ParallelTerminationStrategy: PID 27046 died... 21:01:44.700669 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27046): Terminated: ok {rc=0} 21:01:44.786253 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:trx-b200+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 21:01:45.967339 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:01:45.979956 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 21:01:46.051710 tst iperf3m4.py: using LAC 31479 21:01:46.188216 tst iperf3m4.py: using RAC 114 21:01:46.326284 tst iperf3m4.py: using CellId 31479 21:01:46.487402 tst iperf3m4.py: using BVCI 31480 21:01:46.615888 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:01:46.628078 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:01:46.641573 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:01:46.655156 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:01:46.669317 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:01:46.681800 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:01:46.694957 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:01:46.708415 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:01:46.723736 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:01:46.854562 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:01:46.989091 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:01:47.147329 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:01:47.282503 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 21:01:47.517718 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:01:47.858827 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27048): Launched 21:01:48.155135 run iperf3-srv_10.42.42.10(pid=27049): Launched 21:01:48.282917 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 21:01:48.513901 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:01:48.855010 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27050): Launched 21:01:49.150285 run iperf3-srv_10.42.42.10(pid=27051): Launched 21:01:49.279399 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 21:01:49.509468 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:01:49.850786 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27052): Launched 21:01:50.146217 run iperf3-srv_10.42.42.10(pid=27053): Launched 21:01:50.273917 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 21:01:50.504524 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:01:50.846134 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27054): Launched 21:01:51.142535 run iperf3-srv_10.42.42.10(pid=27055): Launched 21:01:51.270044 tst iperf3m4.py:8: start network... 21:01:51.499998 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:01:52.027200 run create_hlr_db(pid=27056): Launched 21:01:52.157857 bus /gobi_6: Setting Powered False 21:01:53.224360 run create_hlr_db(pid=27056): Terminated: ok {rc=0} 21:01:53.695786 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27058): Launched 21:01:54.037950 run osmo-hlr_10.42.42.2(pid=27059): Launched 21:01:54.170015 run osmo-stp_10.42.42.5: Starting osmo-stp 21:01:54.761614 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27061): Launched 21:01:55.105773 run osmo-stp_10.42.42.5(pid=27062): Launched 21:01:55.236071 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:01:55.823916 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27064): Launched 21:01:55.955105 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:01:56.242703 run patchelf(pid=27065): Launched 21:01:56.432002 run osmo-stp_10.42.42.5(pid=27062): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27062)] 21:01:56.575657 run osmo-stp_10.42.42.5(pid=27062): stdout: | (launched: 2022-12-12_21:01:55.043157) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:01:56.720624 run osmo-stp_10.42.42.5(pid=27062): stderr: | 20221212210155237 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210155237 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210155237 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210155238 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210155238 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210155238 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210155238 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:01:56.865380 run osmo-stp_10.42.42.5(pid=27062): stdout: | (launched: 2022-12-12_21:01:55.043157) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:01:57.004528 run osmo-stp_10.42.42.5(pid=27062): stderr: | 20221212210155237 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210155237 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210155237 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210155238 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210155238 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210155238 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210155238 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:01:57.170170 run patchelf(pid=27065): Terminating (SIGINT) 21:01:57.361588 run patchelf(pid=27065): Terminated: ok {rc=0} 21:01:57.500411 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27062): Process ended prematurely: osmo-stp_10.42.42.5(pid=27062) [trial-2382↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27062)] [trial-2382↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8] 21:01:57.510854 tst iperf3m4.py:8: Test FAILED (11.6 sec) 21:01:57.540572 run osmo-hlr_10.42.42.2(pid=27059): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27059)] 21:01:57.592546 run osmo-hlr_10.42.42.2(pid=27059): stdout: | (launched: 2022-12-12_21:01:53.975681) 21:01:57.645741 run osmo-hlr_10.42.42.2(pid=27059): stderr: | 20221212210154175 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212210154175 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212210154175 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212210154175 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212210154175 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212210154176 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212210154188 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212210154196 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212210154197 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212210154197 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:01:57.699487 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27048): Terminating (SIGTERM) 21:01:57.742816 run iperf3-srv_10.42.42.10(pid=27049): Terminating (SIGTERM) 21:01:57.786021 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27050): Terminating (SIGTERM) 21:01:57.829196 run iperf3-srv_10.42.42.10(pid=27051): Terminating (SIGTERM) 21:01:57.872122 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27052): Terminating (SIGTERM) 21:01:57.915463 run iperf3-srv_10.42.42.10(pid=27053): Terminating (SIGTERM) 21:01:57.958594 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27054): Terminating (SIGTERM) 21:01:58.001781 run iperf3-srv_10.42.42.10(pid=27055): Terminating (SIGTERM) 21:01:58.044852 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27058): Terminating (SIGTERM) 21:01:58.088035 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27061): Terminating (SIGTERM) 21:01:58.130982 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27064): Terminating (SIGTERM) 21:01:58.174234 --- ParallelTerminationStrategy: PID 27048 died... 21:01:58.194662 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27048): Terminated: ok {rc=0} 21:01:58.243296 --- ParallelTerminationStrategy: PID 27049 died... 21:01:58.263446 run iperf3-srv_10.42.42.10(pid=27049): Terminated {rc=256} 21:01:58.311760 --- ParallelTerminationStrategy: PID 27050 died... 21:01:58.331849 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27050): Terminated: ok {rc=0} 21:01:58.379816 --- ParallelTerminationStrategy: PID 27051 died... 21:01:58.399969 run iperf3-srv_10.42.42.10(pid=27051): Terminated {rc=256} 21:01:58.448045 --- ParallelTerminationStrategy: PID 27052 died... 21:01:58.468499 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27052): Terminated: ok {rc=0} 21:01:58.516789 --- ParallelTerminationStrategy: PID 27053 died... 21:01:58.537307 run iperf3-srv_10.42.42.10(pid=27053): Terminated {rc=256} 21:01:58.585195 --- ParallelTerminationStrategy: PID 27054 died... 21:01:58.605189 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27054): Terminated: ok {rc=0} 21:01:58.653095 --- ParallelTerminationStrategy: PID 27055 died... 21:01:58.673165 run iperf3-srv_10.42.42.10(pid=27055): Terminated {rc=256} 21:01:58.720907 --- ParallelTerminationStrategy: PID 27058 died... 21:01:58.741086 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27058): Terminated: ok {rc=0} 21:01:58.788890 --- ParallelTerminationStrategy: PID 27061 died... 21:01:58.809105 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27061): Terminated: ok {rc=0} 21:01:58.856922 --- ParallelTerminationStrategy: PID 27064 died... 21:01:58.877130 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27064): Terminated: ok {rc=0} 21:01:58.968281 bus /gobi_4: Setting Powered False 21:02:00.069802 bus /gobi_4: Setting Powered False 21:02:01.195039 bus /gobi_1: Setting Powered False 21:02:02.308351 bus /gobi_1: Setting Powered False 21:02:03.428345 bus /gobi_0: Setting Powered False 21:02:04.530821 bus /gobi_0: Setting Powered False 21:02:05.650283 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:trx-b200+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 21:02:06.756588 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:02:06.770900 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 21:02:06.841994 tst ping.py: using LAC 31480 21:02:06.963805 tst ping.py: using RAC 115 21:02:07.086821 tst ping.py: using CellId 31480 21:02:07.210315 tst ping.py: using BVCI 31481 21:02:07.325228 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:02:07.336421 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:02:07.347658 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:02:07.358699 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:02:07.369591 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:02:07.380365 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:02:07.391395 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:02:07.402372 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:02:07.523451 tst ping.py:19: start network... 21:02:07.738559 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:02:08.225663 run create_hlr_db(pid=27066): Launched 21:02:08.353710 bus /gobi_6: Setting Powered False 21:02:09.416581 run create_hlr_db(pid=27066): Terminated: ok {rc=0} 21:02:09.850879 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27068): Launched 21:02:10.162214 run osmo-hlr_10.42.42.2(pid=27069): Launched 21:02:10.280310 run osmo-stp_10.42.42.5: Starting osmo-stp 21:02:10.818605 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27071): Launched 21:02:11.130190 run osmo-stp_10.42.42.5(pid=27072): Launched 21:02:11.249508 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:02:11.787350 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27074): Launched 21:02:11.906703 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:02:12.170172 run patchelf(pid=27075): Launched 21:02:12.345249 run osmo-stp_10.42.42.5(pid=27072): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27072)] 21:02:12.476875 run osmo-stp_10.42.42.5(pid=27072): stdout: | (launched: 2022-12-12_21:02:11.072673) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:02:12.610250 run osmo-stp_10.42.42.5(pid=27072): stderr: | 20221212210211242 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210211242 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210211243 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210211243 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210211244 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210211244 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210211244 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:02:12.743519 run osmo-stp_10.42.42.5(pid=27072): stdout: | (launched: 2022-12-12_21:02:11.072673) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:02:12.870836 run osmo-stp_10.42.42.5(pid=27072): stderr: | 20221212210211242 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210211242 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210211243 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210211243 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210211244 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210211244 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210211244 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:02:13.021850 run patchelf(pid=27075): Terminating (SIGINT) 21:02:13.196566 run patchelf(pid=27075): Terminated: ok {rc=0} 21:02:13.323620 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=27072): Process ended prematurely: osmo-stp_10.42.42.5(pid=27072) [trial-2382↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27072)] [trial-2382↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22] 21:02:13.332588 tst ping.py:22: Test FAILED (6.6 sec) 21:02:13.360113 run osmo-hlr_10.42.42.2(pid=27069): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27069)] 21:02:13.409244 run osmo-hlr_10.42.42.2(pid=27069): stdout: | (launched: 2022-12-12_21:02:10.104920) 21:02:13.460302 run osmo-hlr_10.42.42.2(pid=27069): stderr: | 20221212210210280 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212210210280 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212210210280 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212210210280 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212210210280 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212210210280 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212210210292 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-b200+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212210210300 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212210210301 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212210210301 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:02:13.511991 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27068): Terminating (SIGTERM) 21:02:13.553235 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27071): Terminating (SIGTERM) 21:02:13.594405 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27074): Terminating (SIGTERM) 21:02:13.635778 --- ParallelTerminationStrategy: PID 27068 died... 21:02:13.655522 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27068): Terminated: ok {rc=0} 21:02:13.701211 --- ParallelTerminationStrategy: PID 27071 died... 21:02:13.720656 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27071): Terminated: ok {rc=0} 21:02:13.766030 --- ParallelTerminationStrategy: PID 27074 died... 21:02:13.785294 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27074): Terminated: ok {rc=0} 21:02:13.874375 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:trx-b200+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 21:02:14.964788 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:02:14.976760 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 21:02:15.048440 tst ping_idle_ping.py: using LAC 31481 21:02:15.173273 tst ping_idle_ping.py: using RAC 116 21:02:15.297308 tst ping_idle_ping.py: using CellId 31481 21:02:15.425755 tst ping_idle_ping.py: using BVCI 31482 21:02:15.540560 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:02:15.551791 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:02:15.562664 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:02:15.573697 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:02:15.584566 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:02:15.596013 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:02:15.607070 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:02:15.618009 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:02:15.740623 tst ping_idle_ping.py:24: start network... 21:02:15.977796 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:02:16.512649 run create_hlr_db(pid=27076): Launched 21:02:16.679644 bus /gobi_6: Setting Powered False 21:02:17.745732 run create_hlr_db(pid=27076): Terminated: ok {rc=0} 21:02:18.209372 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27078): Launched 21:02:18.546290 run osmo-hlr_10.42.42.2(pid=27079): Launched 21:02:18.675227 run osmo-stp_10.42.42.5: Starting osmo-stp 21:02:19.254391 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27081): Launched 21:02:19.590296 run osmo-stp_10.42.42.5(pid=27082): Launched 21:02:19.719335 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:02:20.295579 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27084): Launched 21:02:20.424687 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:02:20.707591 run patchelf(pid=27085): Launched 21:02:20.898039 run osmo-stp_10.42.42.5(pid=27082): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27082)] 21:02:21.039271 run osmo-stp_10.42.42.5(pid=27082): stdout: | (launched: 2022-12-12_21:02:19.529496) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:02:21.182190 run osmo-stp_10.42.42.5(pid=27082): stderr: | 20221212210219723 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210219723 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210219723 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210219724 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210219724 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210219724 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210219724 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:02:21.325280 run osmo-stp_10.42.42.5(pid=27082): stdout: | (launched: 2022-12-12_21:02:19.529496) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:02:21.463197 run osmo-stp_10.42.42.5(pid=27082): stderr: | 20221212210219723 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210219723 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210219723 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210219724 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210219724 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210219724 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210219724 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:02:21.625633 run patchelf(pid=27085): Terminating (SIGINT) 21:02:21.812743 run patchelf(pid=27085): Terminated: ok {rc=0} 21:02:21.948141 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=27082): Process ended prematurely: osmo-stp_10.42.42.5(pid=27082) [trial-2382↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27082)] [trial-2382↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 21:02:21.958015 tst ping_idle_ping.py:27: Test FAILED (7.0 sec) 21:02:21.987215 run osmo-hlr_10.42.42.2(pid=27079): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27079)] 21:02:22.039168 run osmo-hlr_10.42.42.2(pid=27079): stdout: | (launched: 2022-12-12_21:02:18.484367) 21:02:22.092763 run osmo-hlr_10.42.42.2(pid=27079): stderr: | 20221212210218683 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212210218683 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212210218683 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212210218683 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212210218683 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212210218684 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212210218695 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-b200+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212210218704 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212210218704 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212210218704 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:02:22.147034 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27078): Terminating (SIGTERM) 21:02:22.190441 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27081): Terminating (SIGTERM) 21:02:22.233756 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27084): Terminating (SIGTERM) 21:02:22.277195 --- ParallelTerminationStrategy: PID 27078 died... 21:02:22.297841 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27078): Terminated: ok {rc=0} 21:02:22.345917 --- ParallelTerminationStrategy: PID 27081 died... 21:02:22.365999 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27081): Terminated: ok {rc=0} 21:02:22.413792 --- ParallelTerminationStrategy: PID 27084 died... 21:02:22.433839 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27084): Terminated: ok {rc=0} 21:02:22.524284 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2382 gprs:trx-b200+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 gprs:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 21:02:23.838774 tst gprs:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:02:23.845538 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 21:02:23.881044 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 21:02:23.921410 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 21:02:24.010999 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 21:02:24.045565 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 21:02:24.085429 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 21:02:24.683153 tst gprs:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2382 gprs:trx-b200+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 21:02:24.737934 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:02:24.749502 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 21:02:24.822009 tst cs_paging_gprs_active.py: using LAC 31482 21:02:24.955594 tst cs_paging_gprs_active.py: using RAC 117 21:02:25.088845 tst cs_paging_gprs_active.py: using CellId 31482 21:02:25.215467 tst cs_paging_gprs_active.py: using BVCI 31483 21:02:25.332887 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:02:25.344173 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:02:25.355677 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:02:25.367060 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:02:25.378462 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:02:25.389740 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:02:25.400811 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:02:25.411896 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:02:25.423079 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 21:02:25.542618 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 21:02:25.668603 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 21:02:25.899699 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:02:26.241547 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27090): Launched 21:02:26.539835 run iperf3-srv_10.42.42.10(pid=27091): Launched 21:02:26.670721 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 21:02:26.902230 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:02:27.244382 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27092): Launched 21:02:27.541504 run iperf3-srv_10.42.42.10(pid=27093): Launched 21:02:27.669830 tst cs_paging_gprs_active.py:38: start network... 21:02:27.902028 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:02:28.433606 run create_hlr_db(pid=27094): Launched 21:02:28.565056 bus /gobi_6: Setting Powered False 21:02:29.631865 run create_hlr_db(pid=27094): Terminated: ok {rc=0} 21:02:30.103033 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27096): Launched 21:02:30.443163 run osmo-hlr_10.42.42.2(pid=27097): Launched 21:02:30.575291 run osmo-stp_10.42.42.5: Starting osmo-stp 21:02:31.184659 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27099): Launched 21:02:31.536642 run osmo-stp_10.42.42.5(pid=27100): Launched 21:02:31.743244 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:02:32.426082 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27102): Launched 21:02:32.556329 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:02:32.844817 run patchelf(pid=27103): Launched 21:02:33.033818 run osmo-stp_10.42.42.5(pid=27100): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27100)] 21:02:33.177845 run osmo-stp_10.42.42.5(pid=27100): stdout: | (launched: 2022-12-12_21:02:31.473512) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:02:33.323168 run osmo-stp_10.42.42.5(pid=27100): stderr: | 20221212210231788 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210231794 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210231795 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210231795 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210231796 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210231796 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210231796 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:02:33.469584 run osmo-stp_10.42.42.5(pid=27100): stdout: | (launched: 2022-12-12_21:02:31.473512) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:02:33.608880 run osmo-stp_10.42.42.5(pid=27100): stderr: | 20221212210231788 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210231794 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210231795 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210231795 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210231796 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210231796 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210231796 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:02:33.774404 run patchelf(pid=27103): Terminating (SIGINT) 21:02:33.965772 run patchelf(pid=27103): Terminated: ok {rc=0} 21:02:34.103829 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=27100): Process ended prematurely: osmo-stp_10.42.42.5(pid=27100) [trial-2382↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27100)] [trial-2382↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 21:02:34.114477 tst cs_paging_gprs_active.py:38: Test FAILED (9.4 sec) 21:02:34.144414 run osmo-hlr_10.42.42.2(pid=27097): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27097)] 21:02:34.196199 run osmo-hlr_10.42.42.2(pid=27097): stdout: | (launched: 2022-12-12_21:02:30.381460) 21:02:34.249936 run osmo-hlr_10.42.42.2(pid=27097): stderr: | 20221212210230582 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212210230582 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212210230582 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212210230582 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212210230582 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212210230582 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212210230595 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-b200+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212210230605 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212210230605 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212210230605 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:02:34.304095 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27090): Terminating (SIGTERM) 21:02:34.347380 run iperf3-srv_10.42.42.10(pid=27091): Terminating (SIGTERM) 21:02:34.390550 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27092): Terminating (SIGTERM) 21:02:34.433755 run iperf3-srv_10.42.42.10(pid=27093): Terminating (SIGTERM) 21:02:34.477225 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27096): Terminating (SIGTERM) 21:02:34.520588 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27099): Terminating (SIGTERM) 21:02:34.563884 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27102): Terminating (SIGTERM) 21:02:34.607285 --- ParallelTerminationStrategy: PID 27090 died... 21:02:34.627718 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27090): Terminated: ok {rc=0} 21:02:34.675900 --- ParallelTerminationStrategy: PID 27091 died... 21:02:34.695904 run iperf3-srv_10.42.42.10(pid=27091): Terminated {rc=256} 21:02:34.743736 --- ParallelTerminationStrategy: PID 27092 died... 21:02:34.763801 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27092): Terminated: ok {rc=0} 21:02:34.811583 --- ParallelTerminationStrategy: PID 27093 died... 21:02:34.831551 run iperf3-srv_10.42.42.10(pid=27093): Terminated {rc=256} 21:02:34.879609 --- ParallelTerminationStrategy: PID 27096 died... 21:02:34.899564 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27096): Terminated: ok {rc=0} 21:02:34.947231 --- ParallelTerminationStrategy: PID 27099 died... 21:02:34.967213 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27099): Terminated: ok {rc=0} 21:02:35.015050 --- ParallelTerminationStrategy: PID 27102 died... 21:02:35.035058 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27102): Terminated: ok {rc=0} 21:02:35.125538 bus /gobi_0: Setting Powered False 21:02:36.228399 bus /gobi_0: Setting Powered False 21:02:37.345792 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:trx-b200+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 21:02:38.500048 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:02:38.512454 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 21:02:38.588809 tst iperf3.py: using LAC 31483 21:02:38.722227 tst iperf3.py: using RAC 118 21:02:38.856832 tst iperf3.py: using CellId 31483 21:02:38.982187 tst iperf3.py: using BVCI 31484 21:02:39.098393 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:02:39.109653 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:02:39.120422 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:02:39.131486 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:02:39.142584 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:02:39.153780 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:02:39.164774 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:02:39.175614 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:02:39.186662 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 21:02:39.309978 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 21:02:39.540930 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:02:39.881495 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27104): Launched 21:02:40.179117 run iperf3-srv_10.42.42.10(pid=27105): Launched 21:02:40.307792 tst iperf3.py:8: start network... 21:02:40.538167 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:02:41.064316 run create_hlr_db(pid=27106): Launched 21:02:41.196633 bus /gobi_6: Setting Powered False 21:02:42.263555 run create_hlr_db(pid=27106): Terminated: ok {rc=0} 21:02:42.733907 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27108): Launched 21:02:43.074191 run osmo-hlr_10.42.42.2(pid=27109): Launched 21:02:43.205087 run osmo-stp_10.42.42.5: Starting osmo-stp 21:02:43.795656 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27111): Launched 21:02:44.137280 run osmo-stp_10.42.42.5(pid=27112): Launched 21:02:44.267362 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:02:44.853413 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27114): Launched 21:02:44.983241 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:02:45.271935 run patchelf(pid=27115): Launched 21:02:45.460337 run osmo-stp_10.42.42.5(pid=27112): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27112)] 21:02:45.604172 run osmo-stp_10.42.42.5(pid=27112): stdout: | (launched: 2022-12-12_21:02:44.074922) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:02:45.749160 run osmo-stp_10.42.42.5(pid=27112): stderr: | 20221212210244266 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210244267 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210244267 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210244267 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210244268 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210244268 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210244268 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:02:45.906334 run osmo-stp_10.42.42.5(pid=27112): stdout: | (launched: 2022-12-12_21:02:44.074922) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:02:46.048426 run osmo-stp_10.42.42.5(pid=27112): stderr: | 20221212210244266 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210244267 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210244267 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210244267 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210244268 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210244268 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210244268 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:02:46.215946 run patchelf(pid=27115): Terminating (SIGINT) 21:02:46.410255 run patchelf(pid=27115): Terminated: ok {rc=0} 21:02:46.551101 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27112): Process ended prematurely: osmo-stp_10.42.42.5(pid=27112) [trial-2382↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27112)] [trial-2382↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8] 21:02:46.562234 tst iperf3.py:8: Test FAILED (8.1 sec) 21:02:46.592473 run osmo-hlr_10.42.42.2(pid=27109): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27109)] 21:02:46.645782 run osmo-hlr_10.42.42.2(pid=27109): stdout: | (launched: 2022-12-12_21:02:43.012112) 21:02:46.700365 run osmo-hlr_10.42.42.2(pid=27109): stderr: | 20221212210243212 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212210243212 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212210243212 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212210243212 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212210243212 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212210243212 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212210243224 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212210243233 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212210243233 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212210243233 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:02:46.755367 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27104): Terminating (SIGTERM) 21:02:46.799899 run iperf3-srv_10.42.42.10(pid=27105): Terminating (SIGTERM) 21:02:46.845510 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27108): Terminating (SIGTERM) 21:02:46.890018 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27111): Terminating (SIGTERM) 21:02:46.934319 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27114): Terminating (SIGTERM) 21:02:46.978710 --- ParallelTerminationStrategy: PID 27104 died... 21:02:46.999687 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27104): Terminated: ok {rc=0} 21:02:47.048579 --- ParallelTerminationStrategy: PID 27105 died... 21:02:47.069274 run iperf3-srv_10.42.42.10(pid=27105): Terminated {rc=256} 21:02:47.118206 --- ParallelTerminationStrategy: PID 27108 died... 21:02:47.138913 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27108): Terminated: ok {rc=0} 21:02:47.187288 --- ParallelTerminationStrategy: PID 27111 died... 21:02:47.207854 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27111): Terminated: ok {rc=0} 21:02:47.257118 --- ParallelTerminationStrategy: PID 27114 died... 21:02:47.277213 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27114): Terminated: ok {rc=0} 21:02:47.368082 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:trx-b200+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 21:02:48.518574 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:02:48.530618 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 21:02:48.602614 tst iperf3m4.py: using LAC 31484 21:02:48.730019 tst iperf3m4.py: using RAC 119 21:02:48.856028 tst iperf3m4.py: using CellId 31484 21:02:48.983151 tst iperf3m4.py: using BVCI 31485 21:02:49.100601 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:02:49.111799 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:02:49.123141 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:02:49.134798 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:02:49.146308 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:02:49.157955 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:02:49.169657 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:02:49.181053 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:02:49.192752 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 21:02:49.312698 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 21:02:49.436463 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 21:02:49.555509 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 21:02:49.674780 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 21:02:49.906860 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:02:50.249419 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27116): Launched 21:02:50.547664 run iperf3-srv_10.42.42.10(pid=27117): Launched 21:02:50.677871 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 21:02:50.909110 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:02:51.251569 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27118): Launched 21:02:51.547136 run iperf3-srv_10.42.42.10(pid=27119): Launched 21:02:51.675050 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 21:02:51.905025 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:02:52.246327 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27120): Launched 21:02:52.541949 run iperf3-srv_10.42.42.10(pid=27121): Launched 21:02:52.671851 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 21:02:52.902374 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:02:53.244103 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27122): Launched 21:02:53.540780 run iperf3-srv_10.42.42.10(pid=27123): Launched 21:02:53.669930 tst iperf3m4.py:8: start network... 21:02:53.899007 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:02:54.425601 run create_hlr_db(pid=27124): Launched 21:02:54.556373 bus /gobi_6: Setting Powered False 21:02:55.624101 run create_hlr_db(pid=27124): Terminated: ok {rc=0} 21:02:56.094837 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27126): Launched 21:02:56.435898 run osmo-hlr_10.42.42.2(pid=27127): Launched 21:02:56.567973 run osmo-stp_10.42.42.5: Starting osmo-stp 21:02:57.154194 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27129): Launched 21:02:57.493298 run osmo-stp_10.42.42.5(pid=27130): Launched 21:02:57.625061 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:02:58.210448 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27132): Launched 21:02:58.341897 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:02:58.629921 run patchelf(pid=27133): Launched 21:02:58.819519 run osmo-stp_10.42.42.5(pid=27130): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27130)] 21:02:58.963127 run osmo-stp_10.42.42.5(pid=27130): stdout: | (launched: 2022-12-12_21:02:57.430892) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:02:59.108283 run osmo-stp_10.42.42.5(pid=27130): stderr: | 20221212210257624 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210257625 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210257625 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210257625 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210257626 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210257626 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210257626 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:02:59.253642 run osmo-stp_10.42.42.5(pid=27130): stdout: | (launched: 2022-12-12_21:02:57.430892) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:02:59.393507 run osmo-stp_10.42.42.5(pid=27130): stderr: | 20221212210257624 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210257625 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210257625 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210257625 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210257626 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210257626 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210257626 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:02:59.559356 run patchelf(pid=27133): Terminating (SIGINT) 21:02:59.750599 run patchelf(pid=27133): Terminated: ok {rc=0} 21:02:59.887897 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27130): Process ended prematurely: osmo-stp_10.42.42.5(pid=27130) [trial-2382↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27130)] [trial-2382↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8] 21:02:59.898417 tst iperf3m4.py:8: Test FAILED (11.4 sec) 21:02:59.928374 run osmo-hlr_10.42.42.2(pid=27127): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27127)] 21:02:59.980570 run osmo-hlr_10.42.42.2(pid=27127): stdout: | (launched: 2022-12-12_21:02:56.373908) 21:03:00.034450 run osmo-hlr_10.42.42.2(pid=27127): stderr: | 20221212210256578 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212210256578 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212210256578 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212210256578 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212210256578 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212210256578 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212210256589 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212210256597 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212210256598 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212210256598 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:03:00.089468 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27116): Terminating (SIGTERM) 21:03:00.132801 run iperf3-srv_10.42.42.10(pid=27117): Terminating (SIGTERM) 21:03:00.176098 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27118): Terminating (SIGTERM) 21:03:00.219377 run iperf3-srv_10.42.42.10(pid=27119): Terminating (SIGTERM) 21:03:00.262352 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27120): Terminating (SIGTERM) 21:03:00.305080 run iperf3-srv_10.42.42.10(pid=27121): Terminating (SIGTERM) 21:03:00.348289 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27122): Terminating (SIGTERM) 21:03:00.391485 run iperf3-srv_10.42.42.10(pid=27123): Terminating (SIGTERM) 21:03:00.434452 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27126): Terminating (SIGTERM) 21:03:00.478084 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27129): Terminating (SIGTERM) 21:03:00.521289 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27132): Terminating (SIGTERM) 21:03:00.564502 --- ParallelTerminationStrategy: PID 27116 died... 21:03:00.585126 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27116): Terminated: ok {rc=0} 21:03:00.633183 --- ParallelTerminationStrategy: PID 27117 died... 21:03:00.653199 run iperf3-srv_10.42.42.10(pid=27117): Terminated {rc=256} 21:03:00.701543 --- ParallelTerminationStrategy: PID 27118 died... 21:03:00.721648 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27118): Terminated: ok {rc=0} 21:03:00.769382 --- ParallelTerminationStrategy: PID 27119 died... 21:03:00.789357 run iperf3-srv_10.42.42.10(pid=27119): Terminated {rc=256} 21:03:00.837305 --- ParallelTerminationStrategy: PID 27120 died... 21:03:00.857733 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27120): Terminated: ok {rc=0} 21:03:00.906405 --- ParallelTerminationStrategy: PID 27121 died... 21:03:00.927071 run iperf3-srv_10.42.42.10(pid=27121): Terminated {rc=256} 21:03:00.975484 --- ParallelTerminationStrategy: PID 27122 died... 21:03:00.996111 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27122): Terminated: ok {rc=0} 21:03:01.044569 --- ParallelTerminationStrategy: PID 27123 died... 21:03:01.065273 run iperf3-srv_10.42.42.10(pid=27123): Terminated {rc=256} 21:03:01.113773 --- ParallelTerminationStrategy: PID 27126 died... 21:03:01.134439 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27126): Terminated: ok {rc=0} 21:03:01.183111 --- ParallelTerminationStrategy: PID 27129 died... 21:03:01.203863 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27129): Terminated: ok {rc=0} 21:03:01.254343 --- ParallelTerminationStrategy: PID 27132 died... 21:03:01.275075 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27132): Terminated: ok {rc=0} 21:03:01.374197 bus /gobi_4: Setting Powered False 21:03:02.487580 bus /gobi_4: Setting Powered False 21:03:03.606554 bus /gobi_1: Setting Powered False 21:03:04.708477 bus /gobi_1: Setting Powered False 21:03:05.828268 bus /gobi_0: Setting Powered False 21:03:06.930264 bus /gobi_0: Setting Powered False 21:03:08.048735 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:trx-b200+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 21:03:09.154555 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:03:09.166614 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 21:03:09.238150 tst ping.py: using LAC 31485 21:03:09.361436 tst ping.py: using RAC 120 21:03:09.494483 tst ping.py: using CellId 31485 21:03:09.625360 tst ping.py: using BVCI 31486 21:03:09.749254 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:03:09.760924 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:03:09.772528 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:03:09.784316 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:03:09.795992 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:03:09.807665 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:03:09.819516 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:03:09.831290 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 21:03:09.951555 tst ping.py:19: start network... 21:03:10.161296 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:03:10.642637 run create_hlr_db(pid=27135): Launched 21:03:10.772162 bus /gobi_6: Setting Powered False 21:03:11.837315 run create_hlr_db(pid=27135): Terminated: ok {rc=0} 21:03:12.301722 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27137): Launched 21:03:12.638264 run osmo-hlr_10.42.42.2(pid=27138): Launched 21:03:12.768040 run osmo-stp_10.42.42.5: Starting osmo-stp 21:03:13.319917 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27140): Launched 21:03:13.631221 run osmo-stp_10.42.42.5(pid=27141): Launched 21:03:13.750945 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:03:14.287319 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27143): Launched 21:03:14.406232 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:03:14.668706 run patchelf(pid=27144): Launched 21:03:14.841823 run osmo-stp_10.42.42.5(pid=27141): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27141)] 21:03:14.972889 run osmo-stp_10.42.42.5(pid=27141): stdout: | (launched: 2022-12-12_21:03:13.574102) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:03:15.105568 run osmo-stp_10.42.42.5(pid=27141): stderr: | 20221212210313747 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210313747 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210313747 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210313748 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210313748 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210313748 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210313748 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:03:15.238262 run osmo-stp_10.42.42.5(pid=27141): stdout: | (launched: 2022-12-12_21:03:13.574102) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:03:15.364832 run osmo-stp_10.42.42.5(pid=27141): stderr: | 20221212210313747 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210313747 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210313747 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210313748 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210313748 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210313748 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210313748 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:03:15.515515 run patchelf(pid=27144): Terminating (SIGINT) 21:03:15.689776 run patchelf(pid=27144): Terminated: ok {rc=0} 21:03:15.816069 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=27141): Process ended prematurely: osmo-stp_10.42.42.5(pid=27141) [trial-2382↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27141)] [trial-2382↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22] 21:03:15.825213 tst ping.py:22: Test FAILED (6.7 sec) 21:03:15.855821 run osmo-hlr_10.42.42.2(pid=27138): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27138)] 21:03:15.921217 run osmo-hlr_10.42.42.2(pid=27138): stdout: | (launched: 2022-12-12_21:03:12.577314) 21:03:15.978957 run osmo-hlr_10.42.42.2(pid=27138): stderr: | 20221212210312775 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212210312775 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212210312775 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212210312775 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212210312775 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212210312775 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212210312787 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-b200+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212210312796 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212210312797 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212210312797 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:03:16.036053 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27137): Terminating (SIGTERM) 21:03:16.082753 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27140): Terminating (SIGTERM) 21:03:16.131047 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27143): Terminating (SIGTERM) 21:03:16.179032 --- ParallelTerminationStrategy: PID 27137 died... 21:03:16.200503 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27137): Terminated: ok {rc=0} 21:03:16.252669 --- ParallelTerminationStrategy: PID 27140 died... 21:03:16.274471 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27140): Terminated: ok {rc=0} 21:03:16.327097 --- ParallelTerminationStrategy: PID 27143 died... 21:03:16.348556 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27143): Terminated: ok {rc=0} 21:03:16.443749 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:trx-b200+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 21:03:17.536015 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:03:17.548723 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 21:03:17.627260 tst ping_idle_ping.py: using LAC 31486 21:03:17.758300 tst ping_idle_ping.py: using RAC 121 21:03:17.888350 tst ping_idle_ping.py: using CellId 31486 21:03:18.018388 tst ping_idle_ping.py: using BVCI 31487 21:03:18.142401 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:03:18.154205 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:03:18.165553 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:03:18.177393 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:03:18.189074 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:03:18.200804 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:03:18.212682 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:03:18.224279 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 21:03:18.342896 tst ping_idle_ping.py:24: start network... 21:03:18.550923 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:03:19.036264 run create_hlr_db(pid=27145): Launched 21:03:19.164563 bus /gobi_6: Setting Powered False 21:03:20.226784 run create_hlr_db(pid=27145): Terminated: ok {rc=0} 21:03:20.661013 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27147): Launched 21:03:20.973184 run osmo-hlr_10.42.42.2(pid=27148): Launched 21:03:21.091497 run osmo-stp_10.42.42.5: Starting osmo-stp 21:03:21.644533 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27150): Launched 21:03:21.957932 run osmo-stp_10.42.42.5(pid=27151): Launched 21:03:22.077175 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:03:22.617874 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27153): Launched 21:03:22.736436 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:03:22.999805 run patchelf(pid=27154): Launched 21:03:23.172583 run osmo-stp_10.42.42.5(pid=27151): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27151)] 21:03:23.304334 run osmo-stp_10.42.42.5(pid=27151): stdout: | (launched: 2022-12-12_21:03:21.900381) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:03:23.438063 run osmo-stp_10.42.42.5(pid=27151): stderr: | 20221212210322070 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210322070 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210322071 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210322071 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210322071 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210322072 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210322072 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:03:23.571817 run osmo-stp_10.42.42.5(pid=27151): stdout: | (launched: 2022-12-12_21:03:21.900381) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:03:23.699599 run osmo-stp_10.42.42.5(pid=27151): stderr: | 20221212210322070 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210322070 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210322071 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210322071 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210322071 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210322072 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210322072 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:03:23.852438 run patchelf(pid=27154): Terminating (SIGINT) 21:03:24.027893 run patchelf(pid=27154): Terminated: ok {rc=0} 21:03:24.154230 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=27151): Process ended prematurely: osmo-stp_10.42.42.5(pid=27151) [trial-2382↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27151)] [trial-2382↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 21:03:24.163191 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 21:03:24.190463 run osmo-hlr_10.42.42.2(pid=27148): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27148)] 21:03:24.239266 run osmo-hlr_10.42.42.2(pid=27148): stdout: | (launched: 2022-12-12_21:03:20.915913) 21:03:24.289480 run osmo-hlr_10.42.42.2(pid=27148): stderr: | 20221212210321091 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212210321091 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212210321091 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212210321091 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212210321091 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212210321091 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212210321103 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-b200+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212210321113 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212210321113 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212210321113 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:03:24.340219 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27147): Terminating (SIGTERM) 21:03:24.380842 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27150): Terminating (SIGTERM) 21:03:24.421410 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27153): Terminating (SIGTERM) 21:03:24.462239 --- ParallelTerminationStrategy: PID 27147 died... 21:03:24.481746 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27147): Terminated: ok {rc=0} 21:03:24.526518 --- ParallelTerminationStrategy: PID 27150 died... 21:03:24.545502 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27150): Terminated: ok {rc=0} 21:03:24.590303 --- ParallelTerminationStrategy: PID 27153 died... 21:03:24.609443 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27153): Terminated: ok {rc=0} 21:03:24.697666 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2382 gprs:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 21:03:26.014560 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:03:26.021739 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 21:03:26.057057 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 21:03:26.097377 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 21:03:26.187055 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 21:03:26.221803 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 21:03:26.262120 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 21:03:26.862770 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2382 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 21:03:26.918401 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:03:26.930395 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 21:03:26.984311 tst cs_paging_gprs_active.py: using LAC 31487 21:03:27.120013 tst cs_paging_gprs_active.py: using RAC 122 21:03:27.250858 tst cs_paging_gprs_active.py: using CellId 31487 21:03:27.383929 tst cs_paging_gprs_active.py: using BVCI 31488 21:03:27.508446 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:03:27.520498 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:03:27.532368 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:03:27.544390 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:03:27.556331 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:03:27.568367 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:03:27.580531 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:03:27.592391 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:03:27.604530 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 21:03:27.725732 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 21:03:27.846195 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 21:03:28.061766 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:03:28.382512 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27159): Launched 21:03:28.661438 run iperf3-srv_10.42.42.10(pid=27160): Launched 21:03:28.781121 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 21:03:28.996292 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:03:29.318084 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27161): Launched 21:03:29.597403 run iperf3-srv_10.42.42.10(pid=27162): Launched 21:03:29.717337 tst cs_paging_gprs_active.py:38: start network... 21:03:29.933474 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:03:30.430130 run create_hlr_db(pid=27163): Launched 21:03:30.561458 bus /gobi_6: Setting Powered False 21:03:31.653034 run create_hlr_db(pid=27163): Terminated: ok {rc=0} 21:03:32.192874 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27165): Launched 21:03:32.522085 run osmo-hlr_10.42.42.2(pid=27166): Launched 21:03:32.644875 run osmo-stp_10.42.42.5: Starting osmo-stp 21:03:33.204735 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27168): Launched 21:03:33.521657 run osmo-stp_10.42.42.5(pid=27169): Launched 21:03:33.642292 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:03:34.193313 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27171): Launched 21:03:34.314448 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:03:34.583528 run patchelf(pid=27172): Launched 21:03:34.760094 run osmo-stp_10.42.42.5(pid=27169): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27169)] 21:03:34.894483 run osmo-stp_10.42.42.5(pid=27169): stdout: | (launched: 2022-12-12_21:03:33.463600) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:03:35.030390 run osmo-stp_10.42.42.5(pid=27169): stderr: | 20221212210333636 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210333636 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210333636 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210333636 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210333637 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210333637 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210333637 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:03:35.165849 run osmo-stp_10.42.42.5(pid=27169): stdout: | (launched: 2022-12-12_21:03:33.463600) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:03:35.296215 run osmo-stp_10.42.42.5(pid=27169): stderr: | 20221212210333636 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210333636 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210333636 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210333636 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210333637 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210333637 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210333637 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:03:35.451019 run patchelf(pid=27172): Terminating (SIGINT) 21:03:35.629602 run patchelf(pid=27172): Terminated: ok {rc=0} 21:03:35.758286 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=27169): Process ended prematurely: osmo-stp_10.42.42.5(pid=27169) [trial-2382↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27169)] [trial-2382↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 21:03:35.767888 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 21:03:35.795794 run osmo-hlr_10.42.42.2(pid=27166): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27166)] 21:03:35.844941 run osmo-hlr_10.42.42.2(pid=27166): stdout: | (launched: 2022-12-12_21:03:32.463677) 21:03:35.896077 run osmo-hlr_10.42.42.2(pid=27166): stderr: | 20221212210332642 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212210332642 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212210332642 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212210332642 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212210332642 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212210332642 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212210332654 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212210332663 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212210332663 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212210332663 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:03:35.948166 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27159): Terminating (SIGTERM) 21:03:35.989060 run iperf3-srv_10.42.42.10(pid=27160): Terminating (SIGTERM) 21:03:36.029972 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27161): Terminating (SIGTERM) 21:03:36.070778 run iperf3-srv_10.42.42.10(pid=27162): Terminating (SIGTERM) 21:03:36.111355 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27165): Terminating (SIGTERM) 21:03:36.151937 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27168): Terminating (SIGTERM) 21:03:36.192540 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27171): Terminating (SIGTERM) 21:03:36.233255 --- ParallelTerminationStrategy: PID 27159 died... 21:03:36.252674 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27159): Terminated: ok {rc=0} 21:03:36.298001 --- ParallelTerminationStrategy: PID 27160 died... 21:03:36.317123 run iperf3-srv_10.42.42.10(pid=27160): Terminated {rc=256} 21:03:36.362607 --- ParallelTerminationStrategy: PID 27161 died... 21:03:36.381729 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27161): Terminated: ok {rc=0} 21:03:36.426615 --- ParallelTerminationStrategy: PID 27162 died... 21:03:36.445641 run iperf3-srv_10.42.42.10(pid=27162): Terminated {rc=256} 21:03:36.490965 --- ParallelTerminationStrategy: PID 27165 died... 21:03:36.510014 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27165): Terminated: ok {rc=0} 21:03:36.554877 --- ParallelTerminationStrategy: PID 27168 died... 21:03:36.573943 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27168): Terminated: ok {rc=0} 21:03:36.618739 --- ParallelTerminationStrategy: PID 27171 died... 21:03:36.637806 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27171): Terminated: ok {rc=0} 21:03:36.725631 bus /gobi_0: Setting Powered False 21:03:37.827405 bus /gobi_0: Setting Powered False 21:03:38.946038 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 21:03:40.103353 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:03:40.116236 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 21:03:40.177452 tst iperf3.py: using LAC 31488 21:03:40.310635 tst iperf3.py: using RAC 123 21:03:40.442093 tst iperf3.py: using CellId 31488 21:03:40.576567 tst iperf3.py: using BVCI 31489 21:03:40.702283 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:03:40.714211 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:03:40.726044 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:03:40.738139 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:03:40.750087 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:03:40.761898 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:03:40.774133 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:03:40.786081 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:03:40.798383 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 21:03:40.924620 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 21:03:41.138696 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:03:41.457214 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27174): Launched 21:03:41.733474 run iperf3-srv_10.42.42.10(pid=27175): Launched 21:03:41.852898 tst iperf3.py:8: start network... 21:03:42.068505 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:03:42.564650 run create_hlr_db(pid=27176): Launched 21:03:42.694981 bus /gobi_6: Setting Powered False 21:03:43.758222 run create_hlr_db(pid=27176): Terminated: ok {rc=0} 21:03:44.198083 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27178): Launched 21:03:44.516027 run osmo-hlr_10.42.42.2(pid=27179): Launched 21:03:44.637389 run osmo-stp_10.42.42.5: Starting osmo-stp 21:03:45.197859 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27181): Launched 21:03:45.513917 run osmo-stp_10.42.42.5(pid=27182): Launched 21:03:45.646466 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:03:46.268703 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27184): Launched 21:03:46.395778 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:03:46.674519 run patchelf(pid=27185): Launched 21:03:46.871592 run osmo-stp_10.42.42.5(pid=27182): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27182)] 21:03:47.010719 run osmo-stp_10.42.42.5(pid=27182): stdout: | (launched: 2022-12-12_21:03:45.455812) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:03:47.151097 run osmo-stp_10.42.42.5(pid=27182): stderr: | 20221212210345646 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210345646 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210345646 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210345647 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210345647 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210345647 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210345647 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:03:47.287359 run osmo-stp_10.42.42.5(pid=27182): stdout: | (launched: 2022-12-12_21:03:45.455812) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:03:47.417234 run osmo-stp_10.42.42.5(pid=27182): stderr: | 20221212210345646 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210345646 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210345646 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210345647 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210345647 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210345647 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210345647 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:03:47.571214 run patchelf(pid=27185): Terminating (SIGINT) 21:03:47.750300 run patchelf(pid=27185): Terminated: ok {rc=0} 21:03:47.879655 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27182): Process ended prematurely: osmo-stp_10.42.42.5(pid=27182) [trial-2382↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27182)] [trial-2382↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 21:03:47.889471 tst iperf3.py:8: Test FAILED (7.8 sec) 21:03:47.917564 run osmo-hlr_10.42.42.2(pid=27179): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27179)] 21:03:47.966663 run osmo-hlr_10.42.42.2(pid=27179): stdout: | (launched: 2022-12-12_21:03:44.457611) 21:03:48.017944 run osmo-hlr_10.42.42.2(pid=27179): stderr: | 20221212210344636 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212210344636 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212210344636 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212210344636 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212210344636 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212210344636 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212210344648 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212210344657 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212210344657 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212210344657 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:03:48.069531 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27174): Terminating (SIGTERM) 21:03:48.110446 run iperf3-srv_10.42.42.10(pid=27175): Terminating (SIGTERM) 21:03:48.151252 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27178): Terminating (SIGTERM) 21:03:48.192273 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27181): Terminating (SIGTERM) 21:03:48.233244 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27184): Terminating (SIGTERM) 21:03:48.274238 --- ParallelTerminationStrategy: PID 27174 died... 21:03:48.293899 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27174): Terminated: ok {rc=0} 21:03:48.339174 --- ParallelTerminationStrategy: PID 27175 died... 21:03:48.358226 run iperf3-srv_10.42.42.10(pid=27175): Terminated {rc=256} 21:03:48.403292 --- ParallelTerminationStrategy: PID 27178 died... 21:03:48.422475 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27178): Terminated: ok {rc=0} 21:03:48.467603 --- ParallelTerminationStrategy: PID 27181 died... 21:03:48.486766 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27181): Terminated: ok {rc=0} 21:03:48.532415 --- ParallelTerminationStrategy: PID 27184 died... 21:03:48.551609 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27184): Terminated: ok {rc=0} 21:03:48.640000 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 21:03:49.793267 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:03:49.805656 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 21:03:49.859153 tst iperf3m4.py: using LAC 31489 21:03:49.983970 tst iperf3m4.py: using RAC 124 21:03:50.111118 tst iperf3m4.py: using CellId 31489 21:03:50.236339 tst iperf3m4.py: using BVCI 31490 21:03:50.363093 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:03:50.375376 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:03:50.387156 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:03:50.399951 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:03:50.412718 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:03:50.425628 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:03:50.439390 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:03:50.452010 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:03:50.463925 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 21:03:50.586214 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 21:03:50.714566 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 21:03:50.839260 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 21:03:50.961941 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 21:03:51.176386 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:03:51.495621 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27186): Launched 21:03:51.772442 run iperf3-srv_10.42.42.10(pid=27187): Launched 21:03:51.891972 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 21:03:52.107144 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:03:52.427193 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27188): Launched 21:03:52.703771 run iperf3-srv_10.42.42.10(pid=27189): Launched 21:03:52.823128 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 21:03:53.036583 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:03:53.356867 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27190): Launched 21:03:53.633097 run iperf3-srv_10.42.42.10(pid=27191): Launched 21:03:53.752187 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 21:03:53.965529 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:03:54.284816 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27192): Launched 21:03:54.560468 run iperf3-srv_10.42.42.10(pid=27193): Launched 21:03:54.679644 tst iperf3m4.py:8: start network... 21:03:54.892707 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:03:55.385180 run create_hlr_db(pid=27194): Launched 21:03:55.513954 bus /gobi_6: Setting Powered False 21:03:56.581764 run create_hlr_db(pid=27194): Terminated: ok {rc=0} 21:03:57.053241 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27196): Launched 21:03:57.395427 run osmo-hlr_10.42.42.2(pid=27197): Launched 21:03:57.528062 run osmo-stp_10.42.42.5: Starting osmo-stp 21:03:58.123702 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27199): Launched 21:03:58.466004 run osmo-stp_10.42.42.5(pid=27200): Launched 21:03:58.597746 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:03:59.186041 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27202): Launched 21:03:59.316155 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:03:59.604592 run patchelf(pid=27203): Launched 21:03:59.794259 run osmo-stp_10.42.42.5(pid=27200): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27200)] 21:03:59.937862 run osmo-stp_10.42.42.5(pid=27200): stdout: | (launched: 2022-12-12_21:03:58.403721) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:04:00.082494 run osmo-stp_10.42.42.5(pid=27200): stderr: | 20221212210358598 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210358598 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210358598 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210358598 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210358599 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210358599 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210358599 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:04:00.227772 run osmo-stp_10.42.42.5(pid=27200): stdout: | (launched: 2022-12-12_21:03:58.403721) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:04:00.367185 run osmo-stp_10.42.42.5(pid=27200): stderr: | 20221212210358598 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210358598 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210358598 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210358598 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210358599 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210358599 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210358599 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:04:00.532697 run patchelf(pid=27203): Terminating (SIGINT) 21:04:00.723606 run patchelf(pid=27203): Terminated: ok {rc=0} 21:04:00.866848 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27200): Process ended prematurely: osmo-stp_10.42.42.5(pid=27200) [trial-2382↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27200)] [trial-2382↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 21:04:00.878249 tst iperf3m4.py:8: Test FAILED (11.1 sec) 21:04:00.911283 run osmo-hlr_10.42.42.2(pid=27197): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27197)] 21:04:00.966017 run osmo-hlr_10.42.42.2(pid=27197): stdout: | (launched: 2022-12-12_21:03:57.333347) 21:04:01.022005 run osmo-hlr_10.42.42.2(pid=27197): stderr: | 20221212210357533 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212210357533 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212210357533 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212210357533 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212210357533 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212210357533 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212210357546 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212210357554 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212210357554 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212210357554 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:04:01.078706 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27186): Terminating (SIGTERM) 21:04:01.124704 run iperf3-srv_10.42.42.10(pid=27187): Terminating (SIGTERM) 21:04:01.172860 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27188): Terminating (SIGTERM) 21:04:01.219109 run iperf3-srv_10.42.42.10(pid=27189): Terminating (SIGTERM) 21:04:01.267359 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27190): Terminating (SIGTERM) 21:04:01.313747 run iperf3-srv_10.42.42.10(pid=27191): Terminating (SIGTERM) 21:04:01.362184 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27192): Terminating (SIGTERM) 21:04:01.408725 run iperf3-srv_10.42.42.10(pid=27193): Terminating (SIGTERM) 21:04:01.457343 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27196): Terminating (SIGTERM) 21:04:01.503552 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27199): Terminating (SIGTERM) 21:04:01.549291 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27202): Terminating (SIGTERM) 21:04:01.595845 --- ParallelTerminationStrategy: PID 27186 died... 21:04:01.617402 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27186): Terminated: ok {rc=0} 21:04:01.668898 --- ParallelTerminationStrategy: PID 27187 died... 21:04:01.690258 run iperf3-srv_10.42.42.10(pid=27187): Terminated {rc=256} 21:04:01.741407 --- ParallelTerminationStrategy: PID 27188 died... 21:04:01.762772 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27188): Terminated: ok {rc=0} 21:04:01.819395 --- ParallelTerminationStrategy: PID 27189 died... 21:04:01.844729 run iperf3-srv_10.42.42.10(pid=27189): Terminated {rc=256} 21:04:01.904636 --- ParallelTerminationStrategy: PID 27190 died... 21:04:01.930599 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27190): Terminated: ok {rc=0} 21:04:01.987885 --- ParallelTerminationStrategy: PID 27191 died... 21:04:02.012221 run iperf3-srv_10.42.42.10(pid=27191): Terminated {rc=256} 21:04:02.068671 --- ParallelTerminationStrategy: PID 27192 died... 21:04:02.090628 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27192): Terminated: ok {rc=0} 21:04:02.148728 --- ParallelTerminationStrategy: PID 27193 died... 21:04:02.170070 run iperf3-srv_10.42.42.10(pid=27193): Terminated {rc=256} 21:04:02.216915 --- ParallelTerminationStrategy: PID 27196 died... 21:04:02.237378 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27196): Terminated: ok {rc=0} 21:04:02.283536 --- ParallelTerminationStrategy: PID 27199 died... 21:04:02.302961 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27199): Terminated: ok {rc=0} 21:04:02.354028 --- ParallelTerminationStrategy: PID 27202 died... 21:04:02.374659 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27202): Terminated: ok {rc=0} 21:04:02.467739 bus /gobi_4: Setting Powered False 21:04:03.570543 bus /gobi_4: Setting Powered False 21:04:04.690617 bus /gobi_1: Setting Powered False 21:04:05.791470 bus /gobi_1: Setting Powered False 21:04:06.912599 bus /gobi_0: Setting Powered False 21:04:08.014402 bus /gobi_0: Setting Powered False 21:04:09.133490 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 21:04:10.238526 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:04:10.250460 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 21:04:10.303332 tst ping.py: using LAC 31490 21:04:10.423300 tst ping.py: using RAC 125 21:04:10.544844 tst ping.py: using CellId 31490 21:04:10.664637 tst ping.py: using BVCI 31491 21:04:10.775818 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:04:10.787185 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:04:10.798307 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:04:10.809424 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:04:10.820340 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:04:10.831507 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:04:10.842688 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:04:10.853712 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 21:04:10.970338 tst ping.py:19: start network... 21:04:11.174032 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:04:11.645405 run create_hlr_db(pid=27204): Launched 21:04:11.771829 bus /gobi_6: Setting Powered False 21:04:12.837147 run create_hlr_db(pid=27204): Terminated: ok {rc=0} 21:04:13.282336 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27206): Launched 21:04:13.587082 run osmo-hlr_10.42.42.2(pid=27207): Launched 21:04:13.701796 run osmo-stp_10.42.42.5: Starting osmo-stp 21:04:14.226589 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27209): Launched 21:04:14.531884 run osmo-stp_10.42.42.5(pid=27210): Launched 21:04:14.646843 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:04:15.172093 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27212): Launched 21:04:15.288718 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:04:15.546683 run patchelf(pid=27213): Launched 21:04:15.715854 run osmo-stp_10.42.42.5(pid=27210): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27210)] 21:04:15.852734 run osmo-stp_10.42.42.5(pid=27210): stdout: | (launched: 2022-12-12_21:04:14.475583) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:04:16.007853 run osmo-stp_10.42.42.5(pid=27210): stderr: | 20221212210414642 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210414643 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210414643 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210414643 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210414644 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210414644 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210414644 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:04:16.154171 run osmo-stp_10.42.42.5(pid=27210): stdout: | (launched: 2022-12-12_21:04:14.475583) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:04:16.293667 run osmo-stp_10.42.42.5(pid=27210): stderr: | 20221212210414642 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210414643 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210414643 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210414643 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210414644 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210414644 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210414644 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:04:16.459861 run patchelf(pid=27213): Terminating (SIGINT) 21:04:16.651139 run patchelf(pid=27213): Terminated: ok {rc=0} 21:04:16.793864 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=27210): Process ended prematurely: osmo-stp_10.42.42.5(pid=27210) [trial-2382↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27210)] [trial-2382↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 21:04:16.806358 tst ping.py:22: Test FAILED (6.6 sec) 21:04:16.840821 run osmo-hlr_10.42.42.2(pid=27207): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27207)] 21:04:16.900290 run osmo-hlr_10.42.42.2(pid=27207): stdout: | (launched: 2022-12-12_21:04:13.531078) 21:04:16.963207 run osmo-hlr_10.42.42.2(pid=27207): stderr: | 20221212210413703 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212210413703 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212210413704 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212210413704 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212210413704 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212210413704 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212210413719 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212210413731 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212210413731 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212210413731 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:04:17.023657 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27206): Terminating (SIGTERM) 21:04:17.072020 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27209): Terminating (SIGTERM) 21:04:17.120062 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27212): Terminating (SIGTERM) 21:04:17.167365 --- ParallelTerminationStrategy: PID 27206 died... 21:04:17.188643 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27206): Terminated: ok {rc=0} 21:04:17.240766 --- ParallelTerminationStrategy: PID 27209 died... 21:04:17.262469 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27209): Terminated: ok {rc=0} 21:04:17.312166 --- ParallelTerminationStrategy: PID 27212 died... 21:04:17.333398 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27212): Terminated: ok {rc=0} 21:04:17.425241 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 21:04:18.514873 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:04:18.527281 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 21:04:18.581156 tst ping_idle_ping.py: using LAC 31491 21:04:18.711729 tst ping_idle_ping.py: using RAC 126 21:04:18.845146 tst ping_idle_ping.py: using CellId 31491 21:04:18.974354 tst ping_idle_ping.py: using BVCI 31492 21:04:19.094806 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:04:19.107037 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:04:19.119027 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:04:19.131252 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:04:19.143278 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:04:19.155238 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:04:19.167381 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:04:19.180195 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 21:04:19.303558 tst ping_idle_ping.py:24: start network... 21:04:19.527292 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:04:20.039642 run create_hlr_db(pid=27214): Launched 21:04:20.165950 bus /gobi_6: Setting Powered False 21:04:21.229986 run create_hlr_db(pid=27214): Terminated: ok {rc=0} 21:04:21.669705 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27216): Launched 21:04:21.977674 run osmo-hlr_10.42.42.2(pid=27217): Launched 21:04:22.094065 run osmo-stp_10.42.42.5: Starting osmo-stp 21:04:22.620272 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27219): Launched 21:04:22.926367 run osmo-stp_10.42.42.5(pid=27220): Launched 21:04:23.042436 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:04:23.569645 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27222): Launched 21:04:23.686326 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:04:23.944040 run patchelf(pid=27223): Launched 21:04:24.114476 run osmo-stp_10.42.42.5(pid=27220): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27220)] 21:04:24.244018 run osmo-stp_10.42.42.5(pid=27220): stdout: | (launched: 2022-12-12_21:04:22.870098) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:04:24.375983 run osmo-stp_10.42.42.5(pid=27220): stderr: | 20221212210423036 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210423036 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210423037 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210423037 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210423038 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210423038 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210423038 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:04:24.507064 run osmo-stp_10.42.42.5(pid=27220): stdout: | (launched: 2022-12-12_21:04:22.870098) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:04:24.632724 run osmo-stp_10.42.42.5(pid=27220): stderr: | 20221212210423036 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210423036 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210423037 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210423037 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210423038 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210423038 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210423038 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:04:24.781539 run patchelf(pid=27223): Terminating (SIGINT) 21:04:24.953293 run patchelf(pid=27223): Terminated: ok {rc=0} 21:04:25.077484 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=27220): Process ended prematurely: osmo-stp_10.42.42.5(pid=27220) [trial-2382↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27220)] [trial-2382↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 21:04:25.086371 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 21:04:25.113512 run osmo-hlr_10.42.42.2(pid=27217): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27217)] 21:04:25.162416 run osmo-hlr_10.42.42.2(pid=27217): stdout: | (launched: 2022-12-12_21:04:21.921365) 21:04:25.213313 run osmo-hlr_10.42.42.2(pid=27217): stderr: | 20221212210422094 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212210422094 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212210422094 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212210422094 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212210422094 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212210422094 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212210422106 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212210422115 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212210422115 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212210422115 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:04:25.264347 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27216): Terminating (SIGTERM) 21:04:25.304838 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27219): Terminating (SIGTERM) 21:04:25.345520 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27222): Terminating (SIGTERM) 21:04:25.386310 --- ParallelTerminationStrategy: PID 27216 died... 21:04:25.405843 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27216): Terminated: ok {rc=0} 21:04:25.450837 --- ParallelTerminationStrategy: PID 27219 died... 21:04:25.469970 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27219): Terminated: ok {rc=0} 21:04:25.514832 --- ParallelTerminationStrategy: PID 27222 died... 21:04:25.533798 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27222): Terminated: ok {rc=0} 21:04:25.618699 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2382 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 21:04:26.933171 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:04:26.941056 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 21:04:26.978557 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 21:04:27.013001 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 21:04:27.067020 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 21:04:27.103507 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 21:04:27.139969 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 21:04:27.693702 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2382 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 21:04:27.699200 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:04:27.711137 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 21:04:27.783883 tst switch_tch_pdch.py: using LAC 31492 21:04:27.913515 tst switch_tch_pdch.py: using RAC 127 21:04:28.042370 tst switch_tch_pdch.py: using CellId 31492 21:04:28.172283 tst switch_tch_pdch.py: using BVCI 31493 21:04:28.286046 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:04:28.297474 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:04:28.308595 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:04:28.320037 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:04:28.331719 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:04:28.343061 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:04:28.354722 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:04:28.366188 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:04:28.482143 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:04:28.603187 tst switch_tch_pdch.py:51: start network... 21:04:28.823733 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:04:29.330604 run create_hlr_db(pid=27227): Launched 21:04:29.456096 bus /gobi_6: Setting Powered False 21:04:30.522175 run create_hlr_db(pid=27227): Terminated: ok {rc=0} 21:04:30.996354 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27229): Launched 21:04:31.346614 run osmo-hlr_10.42.42.2(pid=27230): Launched 21:04:31.584835 run osmo-stp_10.42.42.5: Starting osmo-stp 21:04:32.273709 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27232): Launched 21:04:32.586546 run osmo-stp_10.42.42.5(pid=27234): Launched 21:04:32.703330 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:04:33.230075 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27236): Launched 21:04:33.346143 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:04:33.603691 run patchelf(pid=27237): Launched 21:04:33.773330 run osmo-stp_10.42.42.5(pid=27234): ERR: Terminated: ERROR {rc=1} [trial-2382↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27234)] 21:04:33.904381 run osmo-stp_10.42.42.5(pid=27234): stdout: | (launched: 2022-12-12_21:04:32.530110) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:04:34.035146 run osmo-stp_10.42.42.5(pid=27234): stderr: | 20221212210432698 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210432698 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210432698 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210432699 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210432699 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210432699 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210432699 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:04:34.166071 run osmo-stp_10.42.42.5(pid=27234): stdout: | (launched: 2022-12-12_21:04:32.530110) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:04:34.291217 run osmo-stp_10.42.42.5(pid=27234): stderr: | 20221212210432698 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210432698 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210432698 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210432699 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210432699 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210432699 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210432699 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:04:34.441535 run patchelf(pid=27237): Terminating (SIGINT) 21:04:34.613641 run patchelf(pid=27237): Terminated: ok {rc=0} 21:04:34.737734 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=27234): Process ended prematurely: osmo-stp_10.42.42.5(pid=27234) [trial-2382↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27234)] [trial-2382↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 21:04:34.746534 tst switch_tch_pdch.py:54: Test FAILED (7.0 sec) 21:04:34.773652 run osmo-hlr_10.42.42.2(pid=27230): ERR: Terminated: ERROR {rc=237} [trial-2382↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27230)] 21:04:34.822470 run osmo-hlr_10.42.42.2(pid=27230): stdout: | (launched: 2022-12-12_21:04:31.283615) 21:04:34.873260 run osmo-hlr_10.42.42.2(pid=27230): stderr: | 20221212210431618 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212210431618 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212210431618 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212210431618 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212210431618 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212210431619 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212210431634 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212210431651 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212210431651 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212210431651 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:04:34.924256 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27229): Terminating (SIGTERM) 21:04:34.965172 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27232): Terminating (SIGTERM) 21:04:35.005796 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27236): Terminating (SIGTERM) 21:04:35.046830 --- ParallelTerminationStrategy: PID 27229 died... 21:04:35.066587 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27229): Terminated: ok {rc=0} 21:04:35.111674 --- ParallelTerminationStrategy: PID 27232 died... 21:04:35.130764 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27232): Terminated: ok {rc=0} 21:04:35.175549 --- ParallelTerminationStrategy: PID 27236 died... 21:04:35.194555 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27236): Terminated: ok {rc=0} 21:04:35.281595 bus /gobi_0: Setting Powered False 21:04:36.383218 bus /gobi_0: Setting Powered False 21:04:37.500492 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2382 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 dynts:trx-b200+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 21:04:38.756307 tst dynts:trx-b200+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:04:38.761896 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 21:04:38.794766 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 21:04:38.829133 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 21:04:38.882330 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 21:04:38.915342 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 21:04:38.949769 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 21:04:39.502841 tst dynts:trx-b200+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2382 dynts:trx-b200+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 21:04:39.507800 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 21:04:39.518719 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 21:04:39.590804 tst switch_tch_pdch.py: using LAC 31493 21:04:39.709835 tst switch_tch_pdch.py: using RAC 128 21:04:39.827429 tst switch_tch_pdch.py: using CellId 31493 21:04:39.945030 tst switch_tch_pdch.py: using BVCI 31494 21:04:40.059047 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 21:04:40.070008 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 21:04:40.080652 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 21:04:40.091503 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 21:04:40.102285 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 21:04:40.113067 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 21:04:40.123885 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 21:04:40.134612 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 21:04:40.253839 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 21:04:40.370970 tst switch_tch_pdch.py:51: start network... 21:04:40.575361 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:04:41.019162 run create_hlr_db(pid=27242): Launched 21:04:41.143595 bus /gobi_6: Setting Powered False 21:04:42.205273 run create_hlr_db(pid=27242): Terminated: ok {rc=0} 21:04:42.625102 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27244): Launched 21:04:42.953237 run osmo-hlr_10.42.42.2(pid=27245): Launched 21:04:43.078346 run osmo-stp_10.42.42.5: Starting osmo-stp 21:04:43.612401 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27247): Launched 21:04:43.938865 run osmo-stp_10.42.42.5(pid=27248): Launched 21:04:44.063024 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:04:44.600450 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27250): Launched 21:04:44.725710 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:04:45.001890 run patchelf(pid=27251): Launched 21:04:45.183428 run osmo-stp_10.42.42.5(pid=27248): ERR: Terminated: ERROR {rc=1} [trial-2382↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27248)] 21:04:45.321705 run osmo-stp_10.42.42.5(pid=27248): stdout: | (launched: 2022-12-12_21:04:43.879426) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:04:45.461803 run osmo-stp_10.42.42.5(pid=27248): stderr: | 20221212210444066 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210444066 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210444066 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210444067 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210444067 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210444067 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210444067 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:04:45.602526 run osmo-stp_10.42.42.5(pid=27248): stdout: | (launched: 2022-12-12_21:04:43.879426) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:04:45.736204 run osmo-stp_10.42.42.5(pid=27248): stderr: | 20221212210444066 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210444066 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210444066 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210444067 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210444067 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210444067 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210444067 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:04:45.914060 run patchelf(pid=27251): Terminating (SIGINT) 21:04:46.090030 run patchelf(pid=27251): Terminated: ok {rc=0} 21:04:46.218393 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=27248): Process ended prematurely: osmo-stp_10.42.42.5(pid=27248) [trial-2382↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27248)] [trial-2382↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 21:04:46.228559 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 21:04:46.257405 run osmo-hlr_10.42.42.2(pid=27245): ERR: Terminated: ERROR {rc=237} [trial-2382↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27245)] 21:04:46.307404 run osmo-hlr_10.42.42.2(pid=27245): stdout: | (launched: 2022-12-12_21:04:42.893685) 21:04:46.360885 run osmo-hlr_10.42.42.2(pid=27245): stderr: | 20221212210443087 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212210443087 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212210443087 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212210443087 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212210443087 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212210443087 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212210443099 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/dynts:trx-b200+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212210443110 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212210443110 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212210443111 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:04:46.415008 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27244): Terminating (SIGTERM) 21:04:46.457932 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27247): Terminating (SIGTERM) 21:04:46.502529 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27250): Terminating (SIGTERM) 21:04:46.548085 --- ParallelTerminationStrategy: PID 27244 died... 21:04:46.568316 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27244): Terminated: ok {rc=0} 21:04:46.615596 --- ParallelTerminationStrategy: PID 27247 died... 21:04:46.635727 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27247): Terminated: ok {rc=0} 21:04:46.682346 --- ParallelTerminationStrategy: PID 27250 died... 21:04:46.702329 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27250): Terminated: ok {rc=0} 21:04:46.791519 bus /gobi_0: Setting Powered False 21:04:47.890061 bus /gobi_0: Setting Powered False 21:04:49.010835 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2382 dynts:trx-b200+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 nitb_sms:trx-sysmocell5000 --------------------------------------------------------------------- 21:04:50.268509 tst nitb_sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:04:50.272321 tst nitb_sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 21:04:50.305692 tst nitb_sms:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 21:04:50.312336 tst nitb_sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 21:04:50.365056 tst nitb_sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 21:04:50.398793 tst nitb_sms:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 21:04:50.405485 tst nitb_sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 21:04:50.942639 tst nitb_sms:trx-sysmocell5000: RESERVED RESOURCES for nitb_sms: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 nitb_sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 21:04:50.947427 tst nitb_sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 21:04:50.958403 tst nitb_sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 21:04:51.006446 tst mo_mt_sms.py: using LAC 31494 21:04:51.124654 tst mo_mt_sms.py: using RAC 129 21:04:51.244182 tst mo_mt_sms.py: using CellId 31494 21:04:51.364226 tst mo_mt_sms.py: using BVCI 31495 21:04:51.474818 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 21:04:51.593367 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 21:04:51.711376 tst mo_mt_sms.py:9: start nitb and bts... 21:04:51.931182 run osmo-nitb_10.42.42.2: Starting osmo-nitb 21:04:52.590051 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=27255): Launched 21:04:52.913621 run osmo-nitb_10.42.42.2(pid=27256): Launched 21:04:53.096438 run osmo-nitb_10.42.42.2(pid=27256): ERR: Terminated: ERROR {rc=2} [trial-2382↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27256)] 21:04:53.243238 run osmo-nitb_10.42.42.2(pid=27256): stdout: | (launched: 2022-12-12_21:04:52.855384) 21:04:53.391374 run osmo-nitb_10.42.42.2(pid=27256): stderr: | (launched: 2022-12-12_21:04:52.903432) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 21:04:53.539718 run osmo-nitb_10.42.42.2(pid=27256): stdout: | (launched: 2022-12-12_21:04:52.855384) 21:04:53.681633 run osmo-nitb_10.42.42.2(pid=27256): stderr: | (launched: 2022-12-12_21:04:52.903432) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7ff6b86c2268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=27256): Process ended prematurely: osmo-nitb_10.42.42.2(pid=27256) [trial-2382↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27256)] 21:04:54.038663 tst osmo-nitb_10.42.42.2(pid=27256): stdout: | (launched: 2022-12-12_21:04:52.855384) 21:04:54.171400 tst osmo-nitb_10.42.42.2(pid=27256): stderr: | (launched: 2022-12-12_21:04:52.903432) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 21:04:54.327319 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=27256): Process ended prematurely: osmo-nitb_10.42.42.2(pid=27256) [trial-2382↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27256)] [trial-2382↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11] 21:04:54.336628 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 21:04:54.344019 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=27255): Terminating (SIGTERM) 21:04:54.556406 --- ParallelTerminationStrategy: PID 27255 died... 21:04:54.578670 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=27255): Terminated: ok {rc=0} 21:04:54.669414 bus /sierra_3: Setting Powered False 21:04:55.769107 bus /sierra_3: Setting Powered False 21:04:56.889031 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 nitb_sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 sms:trx-sysmocell5000 --------------------------------------------------------------------- 21:04:58.093131 tst sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:04:58.097678 tst sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 21:04:58.133710 tst sms:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 21:04:58.161379 tst sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 21:04:58.215548 tst sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 21:04:58.250400 tst sms:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 21:04:58.277839 tst sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 21:04:58.826024 tst sms:trx-sysmocell5000: RESERVED RESOURCES for sms: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 21:04:58.831076 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:04:58.842311 tst sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 21:04:58.892347 tst mo_mt_sms.py: using LAC 31495 21:04:59.019869 tst mo_mt_sms.py: using RAC 130 21:04:59.146155 tst mo_mt_sms.py: using CellId 31495 21:04:59.273210 tst mo_mt_sms.py: using BVCI 31496 21:04:59.392902 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:04:59.404236 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:04:59.415441 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:04:59.426860 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:04:59.438767 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:04:59.450189 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 21:04:59.568323 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 21:04:59.684448 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:05:00.153717 run create_hlr_db(pid=27260): Launched 21:05:00.279140 bus /sierra_2: Setting Powered False 21:05:01.345415 run create_hlr_db(pid=27260): Terminated: ok {rc=0} 21:05:01.801122 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27265): Launched 21:05:02.119124 run osmo-hlr_10.42.42.2(pid=27266): Launched 21:05:02.254727 run osmo-stp_10.42.42.5: Starting osmo-stp 21:05:02.789170 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27268): Launched 21:05:03.089417 run osmo-stp_10.42.42.5(pid=27269): Launched 21:05:03.204290 run osmo-msc_10.42.42.6: Starting osmo-msc 21:05:03.751747 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27271): Launched 21:05:04.077783 run osmo-msc_10.42.42.6(pid=27272): Launched 21:05:04.259629 run osmo-stp_10.42.42.5(pid=27269): ERR: Terminated: ERROR {rc=1} [trial-2382↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27269)] 21:05:04.397880 run osmo-stp_10.42.42.5(pid=27269): stdout: | (launched: 2022-12-12_21:05:03.034353) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:05:04.538476 run osmo-stp_10.42.42.5(pid=27269): stderr: | 20221212210503201 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210503201 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210503201 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210503202 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210503202 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210503202 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210503203 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:05:04.676006 run osmo-stp_10.42.42.5(pid=27269): stdout: | (launched: 2022-12-12_21:05:03.034353) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:05:04.805768 run osmo-stp_10.42.42.5(pid=27269): stderr: | 20221212210503201 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210503201 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210503201 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210503202 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210503202 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210503202 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210503203 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:05:04.960494 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=27269): Process ended prematurely: osmo-stp_10.42.42.5(pid=27269) [trial-2382↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27269)] [trial-2382↪sms:trx-sysmocell5000↪mo_mt_sms.py:16] 21:05:04.969653 tst mo_mt_sms.py:16: Test FAILED (6.1 sec) 21:05:04.997572 run osmo-hlr_10.42.42.2(pid=27266): ERR: Terminated: ERROR {rc=237} [trial-2382↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27266)] 21:05:05.049729 run osmo-hlr_10.42.42.2(pid=27266): stdout: | (launched: 2022-12-12_21:05:02.063797) 21:05:05.102858 run osmo-hlr_10.42.42.2(pid=27266): stderr: | 20221212210502294 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212210502294 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212210502294 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212210502294 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212210502294 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212210502294 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212210502316 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/sms:trx-sysmocell5000/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212210502326 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212210502326 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212210502326 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:05:05.176458 run osmo-msc_10.42.42.6(pid=27272): ERR: Terminated: ERROR {rc=2} [trial-2382↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27272)] 21:05:05.227627 run osmo-msc_10.42.42.6(pid=27272): stdout: | (launched: 2022-12-12_21:05:04.019254) 21:05:05.280361 run osmo-msc_10.42.42.6(pid=27272): stderr: | 20221212210504336 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212210504336 DLGLOBAL DEBUG validating counter group 0x7fde9a10ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212210504336 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212210504336 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212210504336 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212210504337 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212210504338 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212210504339 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212210504339 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212210504339 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:05:05.334047 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27265): Terminating (SIGTERM) 21:05:05.376988 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27268): Terminating (SIGTERM) 21:05:05.419868 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27271): Terminating (SIGTERM) 21:05:05.463058 --- ParallelTerminationStrategy: PID 27265 died... 21:05:05.483517 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27265): Terminated: ok {rc=0} 21:05:05.531779 --- ParallelTerminationStrategy: PID 27268 died... 21:05:05.552051 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27268): Terminated: ok {rc=0} 21:05:05.600045 --- ParallelTerminationStrategy: PID 27271 died... 21:05:05.620078 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27271): Terminated: ok {rc=0} 21:05:05.709509 bus /sierra_3: Setting Powered False 21:05:06.811738 bus /sierra_3: Setting Powered False 21:05:07.929149 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 nitb_ussd:trx-sysmocell5000 --------------------------------------------------------------------- 21:05:09.170092 tst nitb_ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:05:09.174352 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 21:05:09.210267 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 21:05:09.217306 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 21:05:09.251351 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 21:05:09.286407 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 21:05:09.293649 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 21:05:09.816037 tst nitb_ussd:trx-sysmocell5000: RESERVED RESOURCES for nitb_ussd: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2382 nitb_ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 21:05:09.821523 tst nitb_ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 21:05:09.832881 tst nitb_ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 21:05:09.883019 tst assert_extension.py: using LAC 31496 21:05:10.012198 tst assert_extension.py: using RAC 131 21:05:10.142498 tst assert_extension.py: using CellId 31496 21:05:10.273043 tst assert_extension.py: using BVCI 31497 21:05:10.391238 tst nitb_ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 21:05:10.507599 tst assert_extension.py:10: start nitb and bts... 21:05:10.710649 run osmo-nitb_10.42.42.2: Starting osmo-nitb 21:05:11.329103 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=27277): Launched 21:05:11.632724 run osmo-nitb_10.42.42.2(pid=27278): Launched 21:05:11.800624 run osmo-nitb_10.42.42.2(pid=27278): ERR: Terminated: ERROR {rc=2} [trial-2382↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27278)] 21:05:11.936892 run osmo-nitb_10.42.42.2(pid=27278): stdout: | (launched: 2022-12-12_21:05:11.577110) 21:05:12.074832 run osmo-nitb_10.42.42.2(pid=27278): stderr: | (launched: 2022-12-12_21:05:11.622055) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 21:05:12.212123 run osmo-nitb_10.42.42.2(pid=27278): stdout: | (launched: 2022-12-12_21:05:11.577110) 21:05:12.344443 run osmo-nitb_10.42.42.2(pid=27278): stderr: | (launched: 2022-12-12_21:05:11.622055) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7ff6b86c2268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=27278): Process ended prematurely: osmo-nitb_10.42.42.2(pid=27278) [trial-2382↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27278)] 21:05:12.747756 tst osmo-nitb_10.42.42.2(pid=27278): stdout: | (launched: 2022-12-12_21:05:11.577110) 21:05:12.871209 tst osmo-nitb_10.42.42.2(pid=27278): stderr: | (launched: 2022-12-12_21:05:11.622055) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 21:05:13.016091 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=27278): Process ended prematurely: osmo-nitb_10.42.42.2(pid=27278) [trial-2382↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27278)] [trial-2382↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12] 21:05:13.024731 tst assert_extension.py:12: Test FAILED (3.2 sec) 21:05:13.031330 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=27277): Terminating (SIGTERM) 21:05:13.240690 --- ParallelTerminationStrategy: PID 27277 died... 21:05:13.261716 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=27277): Terminated: ok {rc=0} 21:05:13.348709 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 nitb_ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 ussd:trx-sysmocell5000 --------------------------------------------------------------------- 21:05:14.533107 tst ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:05:14.537550 tst ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 21:05:14.575632 tst ussd:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 21:05:14.603448 tst ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 21:05:14.640054 tst ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 21:05:14.675564 tst ussd:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 21:05:14.703645 tst ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 21:05:15.237652 tst ussd:trx-sysmocell5000: RESERVED RESOURCES for ussd: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2382 ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 21:05:15.243918 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:05:15.255923 tst ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 21:05:15.304181 tst assert_extension.py: using LAC 31497 21:05:15.423969 tst assert_extension.py: using RAC 132 21:05:15.542034 tst assert_extension.py: using CellId 31497 21:05:15.658828 tst assert_extension.py: using BVCI 31498 21:05:15.767964 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:05:15.778808 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:05:15.789464 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:05:15.799986 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:05:15.810553 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:05:15.821062 tst ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 21:05:15.952211 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:05:16.480640 run create_hlr_db(pid=27282): Launched 21:05:16.626204 bus /sierra_2: Setting Powered False 21:05:17.685753 run create_hlr_db(pid=27282): Terminated: ok {rc=0} 21:05:18.128087 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27284): Launched 21:05:18.454080 run osmo-hlr_10.42.42.2(pid=27285): Launched 21:05:18.579673 run osmo-stp_10.42.42.5: Starting osmo-stp 21:05:19.233307 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27287): Launched 21:05:19.555268 run osmo-stp_10.42.42.5(pid=27288): Launched 21:05:19.679136 run osmo-msc_10.42.42.6: Starting osmo-msc 21:05:20.260262 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27290): Launched 21:05:20.581637 run osmo-msc_10.42.42.6(pid=27291): Launched 21:05:20.760105 run osmo-stp_10.42.42.5(pid=27288): ERR: Terminated: ERROR {rc=1} [trial-2382↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27288)] 21:05:20.896680 run osmo-stp_10.42.42.5(pid=27288): stdout: | (launched: 2022-12-12_21:05:19.496543) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:05:21.033907 run osmo-stp_10.42.42.5(pid=27288): stderr: | 20221212210519683 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210519684 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210519684 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210519684 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210519685 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210519685 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210519685 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:05:21.170413 run osmo-stp_10.42.42.5(pid=27288): stdout: | (launched: 2022-12-12_21:05:19.496543) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:05:21.298519 run osmo-stp_10.42.42.5(pid=27288): stderr: | 20221212210519683 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210519684 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210519684 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210519684 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210519685 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210519685 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210519685 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:05:21.452392 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=27288): Process ended prematurely: osmo-stp_10.42.42.5(pid=27288) [trial-2382↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27288)] [trial-2382↪ussd:trx-sysmocell5000↪assert_extension.py:17] 21:05:21.461625 tst assert_extension.py:17: Test FAILED (6.2 sec) 21:05:21.489838 run osmo-hlr_10.42.42.2(pid=27285): ERR: Terminated: ERROR {rc=237} [trial-2382↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27285)] 21:05:21.541612 run osmo-hlr_10.42.42.2(pid=27285): stdout: | (launched: 2022-12-12_21:05:18.395116) 21:05:21.595214 run osmo-hlr_10.42.42.2(pid=27285): stderr: | 20221212210518588 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212210518589 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212210518589 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212210518589 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212210518589 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212210518589 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212210518601 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/ussd:trx-sysmocell5000/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212210518610 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212210518611 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212210518611 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:05:21.669351 run osmo-msc_10.42.42.6(pid=27291): ERR: Terminated: ERROR {rc=2} [trial-2382↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27291)] 21:05:21.720719 run osmo-msc_10.42.42.6(pid=27291): stdout: | (launched: 2022-12-12_21:05:20.522503) 21:05:21.773715 run osmo-msc_10.42.42.6(pid=27291): stderr: | 20221212210520841 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212210520841 DLGLOBAL DEBUG validating counter group 0x7fa816b20c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212210520841 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212210520841 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212210520841 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212210520842 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212210520843 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212210520844 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212210520844 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212210520844 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:05:21.827228 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27284): Terminating (SIGTERM) 21:05:21.869960 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27287): Terminating (SIGTERM) 21:05:21.913258 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27290): Terminating (SIGTERM) 21:05:21.956330 --- ParallelTerminationStrategy: PID 27284 died... 21:05:21.976703 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27284): Terminated: ok {rc=0} 21:05:22.024342 --- ParallelTerminationStrategy: PID 27287 died... 21:05:22.044189 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27287): Terminated: ok {rc=0} 21:05:22.091609 --- ParallelTerminationStrategy: PID 27290 died... 21:05:22.111566 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27290): Terminated: ok {rc=0} 21:05:22.202799 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 21:05:23.420485 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:05:23.427752 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 21:05:23.463177 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 21:05:23.490721 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 21:05:23.543173 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 21:05:23.577912 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 21:05:23.605674 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 21:05:24.158827 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 21:05:24.212747 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:05:24.224534 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 21:05:24.296359 tst mo_mt_call.py: using LAC 31498 21:05:24.426571 tst mo_mt_call.py: using RAC 133 21:05:24.556126 tst mo_mt_call.py: using CellId 31498 21:05:24.689440 tst mo_mt_call.py: using BVCI 31499 21:05:24.809776 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:05:24.821591 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:05:24.833136 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:05:24.844995 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:05:24.857083 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:05:24.869094 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 21:05:24.985750 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 21:05:25.102626 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:05:25.578321 run create_hlr_db(pid=27296): Launched 21:05:25.707924 bus /sierra_2: Setting Powered False 21:05:26.772662 run create_hlr_db(pid=27296): Terminated: ok {rc=0} 21:05:27.227449 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27298): Launched 21:05:27.555043 run osmo-hlr_10.42.42.2(pid=27299): Launched 21:05:27.680705 run osmo-stp_10.42.42.5: Starting osmo-stp 21:05:28.246509 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27301): Launched 21:05:28.574265 run osmo-stp_10.42.42.5(pid=27302): Launched 21:05:28.698107 run osmo-msc_10.42.42.6: Starting osmo-msc 21:05:29.288023 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27304): Launched 21:05:29.615850 run osmo-msc_10.42.42.6(pid=27305): Launched 21:05:29.796838 run osmo-stp_10.42.42.5(pid=27302): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27302)] 21:05:29.934542 run osmo-stp_10.42.42.5(pid=27302): stdout: | (launched: 2022-12-12_21:05:28.514313) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:05:30.072064 run osmo-stp_10.42.42.5(pid=27302): stderr: | 20221212210528703 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210528703 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210528703 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210528704 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210528704 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210528704 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210528704 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:05:30.209159 run osmo-stp_10.42.42.5(pid=27302): stdout: | (launched: 2022-12-12_21:05:28.514313) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:05:30.339527 run osmo-stp_10.42.42.5(pid=27302): stderr: | 20221212210528703 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210528703 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210528703 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210528704 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210528704 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210528704 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210528704 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:05:30.495896 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27302): Process ended prematurely: osmo-stp_10.42.42.5(pid=27302) [trial-2382↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27302)] [trial-2382↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 21:05:30.505568 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 21:05:30.533864 run osmo-hlr_10.42.42.2(pid=27299): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27299)] 21:05:30.585816 run osmo-hlr_10.42.42.2(pid=27299): stdout: | (launched: 2022-12-12_21:05:27.495115) 21:05:30.638862 run osmo-hlr_10.42.42.2(pid=27299): stderr: | 20221212210527688 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212210527689 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212210527689 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212210527689 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212210527689 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212210527689 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212210527702 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212210527711 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212210527711 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212210527712 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:05:30.712521 run osmo-msc_10.42.42.6(pid=27305): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27305)] 21:05:30.763605 run osmo-msc_10.42.42.6(pid=27305): stdout: | (launched: 2022-12-12_21:05:29.555886) 21:05:30.816336 run osmo-msc_10.42.42.6(pid=27305): stderr: | 20221212210529877 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212210529877 DLGLOBAL DEBUG validating counter group 0x7fc75c0ffc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212210529877 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212210529877 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212210529878 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212210529878 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212210529880 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212210529880 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212210529880 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212210529880 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:05:30.886941 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27298): Terminating (SIGTERM) 21:05:30.933153 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27301): Terminating (SIGTERM) 21:05:30.978466 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27304): Terminating (SIGTERM) 21:05:31.024223 --- ParallelTerminationStrategy: PID 27298 died... 21:05:31.044793 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27298): Terminated: ok {rc=0} 21:05:31.095023 --- ParallelTerminationStrategy: PID 27301 died... 21:05:31.115257 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27301): Terminated: ok {rc=0} 21:05:31.164521 --- ParallelTerminationStrategy: PID 27304 died... 21:05:31.184511 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27304): Terminated: ok {rc=0} 21:05:31.279744 bus /sierra_3: Setting Powered False 21:05:32.390751 bus /sierra_3: Setting Powered False 21:05:33.508524 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2382 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 21:05:34.656533 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:05:34.668341 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 21:05:34.739672 tst mo_mt_call_osmux.py: using LAC 31499 21:05:34.860390 tst mo_mt_call_osmux.py: using RAC 134 21:05:34.985995 tst mo_mt_call_osmux.py: using CellId 31499 21:05:35.114789 tst mo_mt_call_osmux.py: using BVCI 31500 21:05:35.234650 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:05:35.246606 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:05:35.258354 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:05:35.270107 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:05:35.282256 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:05:35.293977 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 21:05:35.414845 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 21:05:35.532406 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:05:36.005299 run create_hlr_db(pid=27307): Launched 21:05:36.131064 bus /sierra_2: Setting Powered False 21:05:37.192026 run create_hlr_db(pid=27307): Terminated: ok {rc=0} 21:05:37.639409 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27309): Launched 21:05:37.967579 run osmo-hlr_10.42.42.2(pid=27310): Launched 21:05:38.091815 run osmo-stp_10.42.42.5: Starting osmo-stp 21:05:38.656529 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27312): Launched 21:05:38.986001 run osmo-stp_10.42.42.5(pid=27313): Launched 21:05:39.111216 run osmo-msc_10.42.42.6: Starting osmo-msc 21:05:39.703931 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27315): Launched 21:05:40.031895 run osmo-msc_10.42.42.6(pid=27316): Launched 21:05:40.214988 run osmo-stp_10.42.42.5(pid=27313): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27313)] 21:05:40.353170 run osmo-stp_10.42.42.5(pid=27313): stdout: | (launched: 2022-12-12_21:05:38.925594) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:05:40.491831 run osmo-stp_10.42.42.5(pid=27313): stderr: | 20221212210539114 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210539114 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210539114 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210539115 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210539115 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210539115 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210539116 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:05:40.629190 run osmo-stp_10.42.42.5(pid=27313): stdout: | (launched: 2022-12-12_21:05:38.925594) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:05:40.759705 run osmo-stp_10.42.42.5(pid=27313): stderr: | 20221212210539114 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210539114 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210539114 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210539115 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210539115 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210539115 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210539116 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:05:40.916567 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27313): Process ended prematurely: osmo-stp_10.42.42.5(pid=27313) [trial-2382↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27313)] [trial-2382↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 21:05:40.926527 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 21:05:40.954976 run osmo-hlr_10.42.42.2(pid=27310): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27310)] 21:05:41.006554 run osmo-hlr_10.42.42.2(pid=27310): stdout: | (launched: 2022-12-12_21:05:37.908060) 21:05:41.059820 run osmo-hlr_10.42.42.2(pid=27310): stderr: | 20221212210538101 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212210538101 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212210538101 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212210538101 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212210538102 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212210538102 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212210538114 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212210538124 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212210538124 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212210538124 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:05:41.133808 run osmo-msc_10.42.42.6(pid=27316): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27316)] 21:05:41.184892 run osmo-msc_10.42.42.6(pid=27316): stdout: | (launched: 2022-12-12_21:05:39.972452) 21:05:41.237899 run osmo-msc_10.42.42.6(pid=27316): stderr: | 20221212210540291 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212210540291 DLGLOBAL DEBUG validating counter group 0x7fba53913c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212210540291 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212210540291 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212210540291 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212210540291 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212210540293 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212210540293 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212210540294 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212210540294 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:05:41.291352 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27309): Terminating (SIGTERM) 21:05:41.333822 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27312): Terminating (SIGTERM) 21:05:41.376383 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27315): Terminating (SIGTERM) 21:05:41.419157 --- ParallelTerminationStrategy: PID 27309 died... 21:05:41.439488 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27309): Terminated: ok {rc=0} 21:05:41.487612 --- ParallelTerminationStrategy: PID 27312 died... 21:05:41.507426 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27312): Terminated: ok {rc=0} 21:05:41.555728 --- ParallelTerminationStrategy: PID 27315 died... 21:05:41.575515 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27315): Terminated: ok {rc=0} 21:05:41.665203 bus /sierra_3: Setting Powered False 21:05:42.763949 bus /sierra_3: Setting Powered False 21:05:43.880207 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 21:05:45.132720 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:05:45.139209 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 21:05:45.172400 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 21:05:45.198782 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 21:05:45.250902 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 21:05:45.284563 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 21:05:45.311047 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 21:05:45.869462 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 21:05:45.939177 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:05:45.952724 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 21:05:46.021812 tst mo_mt_call.py: using LAC 31500 21:05:46.144561 tst mo_mt_call.py: using RAC 135 21:05:46.276501 tst mo_mt_call.py: using CellId 31500 21:05:46.399162 tst mo_mt_call.py: using BVCI 31501 21:05:46.513420 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:05:46.525493 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:05:46.537765 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:05:46.549381 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:05:46.561298 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:05:46.572735 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 21:05:46.693562 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 21:05:46.834844 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:05:47.360118 run create_hlr_db(pid=27321): Launched 21:05:47.486101 bus /sierra_2: Setting Powered False 21:05:48.551791 run create_hlr_db(pid=27321): Terminated: ok {rc=0} 21:05:48.990324 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27323): Launched 21:05:49.295887 run osmo-hlr_10.42.42.2(pid=27324): Launched 21:05:49.411372 run osmo-stp_10.42.42.5: Starting osmo-stp 21:05:49.950681 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27326): Launched 21:05:50.254568 run osmo-stp_10.42.42.5(pid=27327): Launched 21:05:50.370462 run osmo-msc_10.42.42.6: Starting osmo-msc 21:05:50.926449 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27329): Launched 21:05:51.233392 run osmo-msc_10.42.42.6(pid=27330): Launched 21:05:51.404933 run osmo-stp_10.42.42.5(pid=27327): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27327)] 21:05:51.535614 run osmo-stp_10.42.42.5(pid=27327): stdout: | (launched: 2022-12-12_21:05:50.199267) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:05:51.665491 run osmo-stp_10.42.42.5(pid=27327): stderr: | 20221212210550367 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210550367 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210550367 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210550368 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210550368 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210550368 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210550368 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:05:51.793265 run osmo-stp_10.42.42.5(pid=27327): stdout: | (launched: 2022-12-12_21:05:50.199267) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:05:51.915632 run osmo-stp_10.42.42.5(pid=27327): stderr: | 20221212210550367 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210550367 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210550367 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210550368 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210550368 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210550368 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210550368 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:05:52.062199 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27327): Process ended prematurely: osmo-stp_10.42.42.5(pid=27327) [trial-2382↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27327)] [trial-2382↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 21:05:52.071154 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 21:05:52.097658 run osmo-hlr_10.42.42.2(pid=27324): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27324)] 21:05:52.146300 run osmo-hlr_10.42.42.2(pid=27324): stdout: | (launched: 2022-12-12_21:05:49.240201) 21:05:52.196793 run osmo-hlr_10.42.42.2(pid=27324): stderr: | 20221212210549414 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212210549414 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212210549414 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212210549414 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212210549415 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212210549415 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212210549427 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212210549436 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212210549436 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212210549436 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:05:52.267473 run osmo-msc_10.42.42.6(pid=27330): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27330)] 21:05:52.316277 run osmo-msc_10.42.42.6(pid=27330): stdout: | (launched: 2022-12-12_21:05:51.177341) 21:05:52.366782 run osmo-msc_10.42.42.6(pid=27330): stderr: | 20221212210551446 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212210551447 DLGLOBAL DEBUG validating counter group 0x7f01e2b40c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212210551447 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212210551447 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212210551447 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212210551447 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212210551449 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212210551449 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212210551449 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212210551449 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:05:52.417626 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27323): Terminating (SIGTERM) 21:05:52.457891 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27326): Terminating (SIGTERM) 21:05:52.498233 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27329): Terminating (SIGTERM) 21:05:52.538780 --- ParallelTerminationStrategy: PID 27323 died... 21:05:52.558064 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27323): Terminated: ok {rc=0} 21:05:52.602466 --- ParallelTerminationStrategy: PID 27326 died... 21:05:52.621310 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27326): Terminated: ok {rc=0} 21:05:52.665586 --- ParallelTerminationStrategy: PID 27329 died... 21:05:52.684428 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27329): Terminated: ok {rc=0} 21:05:52.771731 bus /sierra_3: Setting Powered False 21:05:53.873225 bus /sierra_3: Setting Powered False 21:05:54.993861 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2382 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 21:05:56.147193 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:05:56.159718 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 21:05:56.232357 tst mo_mt_call_osmux.py: using LAC 31501 21:05:56.363495 tst mo_mt_call_osmux.py: using RAC 136 21:05:56.494267 tst mo_mt_call_osmux.py: using CellId 31501 21:05:56.630289 tst mo_mt_call_osmux.py: using BVCI 31502 21:05:56.751329 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:05:56.763346 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:05:56.775046 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:05:56.787035 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:05:56.798900 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:05:56.810931 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 21:05:56.932405 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 21:05:57.052008 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:05:57.560485 run create_hlr_db(pid=27332): Launched 21:05:57.686363 bus /sierra_2: Setting Powered False 21:05:58.751652 run create_hlr_db(pid=27332): Terminated: ok {rc=0} 21:05:59.207251 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27334): Launched 21:05:59.535740 run osmo-hlr_10.42.42.2(pid=27335): Launched 21:05:59.662671 run osmo-stp_10.42.42.5: Starting osmo-stp 21:06:00.235686 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27337): Launched 21:06:00.566194 run osmo-stp_10.42.42.5(pid=27338): Launched 21:06:00.691700 run osmo-msc_10.42.42.6: Starting osmo-msc 21:06:01.325906 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27340): Launched 21:06:01.671346 run osmo-msc_10.42.42.6(pid=27341): Launched 21:06:02.131302 run osmo-stp_10.42.42.5(pid=27338): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27338)] 21:06:02.324834 run osmo-stp_10.42.42.5(pid=27338): stdout: | (launched: 2022-12-12_21:06:00.505822) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:06:02.462818 run osmo-stp_10.42.42.5(pid=27338): stderr: | 20221212210600693 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210600693 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210600694 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210600694 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210600695 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210600695 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210600695 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:06:02.600553 run osmo-stp_10.42.42.5(pid=27338): stdout: | (launched: 2022-12-12_21:06:00.505822) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:06:02.732118 run osmo-stp_10.42.42.5(pid=27338): stderr: | 20221212210600693 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210600693 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210600694 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210600694 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210600695 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210600695 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210600695 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:06:02.889327 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27338): Process ended prematurely: osmo-stp_10.42.42.5(pid=27338) [trial-2382↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27338)] [trial-2382↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 21:06:02.899116 tst mo_mt_call_osmux.py:8: Test FAILED (6.8 sec) 21:06:02.927538 run osmo-hlr_10.42.42.2(pid=27335): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27335)] 21:06:02.979668 run osmo-hlr_10.42.42.2(pid=27335): stdout: | (launched: 2022-12-12_21:05:59.475905) 21:06:03.033356 run osmo-hlr_10.42.42.2(pid=27335): stderr: | 20221212210559671 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212210559671 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212210559671 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212210559671 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212210559671 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212210559672 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212210559684 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212210559692 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212210559692 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212210559692 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:06:03.107817 run osmo-msc_10.42.42.6(pid=27341): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27341)] 21:06:03.159374 run osmo-msc_10.42.42.6(pid=27341): stdout: | (launched: 2022-12-12_21:06:01.610748) 21:06:03.212661 run osmo-msc_10.42.42.6(pid=27341): stderr: | 20221212210602030 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212210602030 DLGLOBAL DEBUG validating counter group 0x7fee2984fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212210602030 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212210602030 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212210602030 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212210602030 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212210602032 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212210602032 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212210602033 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212210602033 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:06:03.266422 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27334): Terminating (SIGTERM) 21:06:03.309351 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27337): Terminating (SIGTERM) 21:06:03.352514 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27340): Terminating (SIGTERM) 21:06:03.396189 --- ParallelTerminationStrategy: PID 27334 died... 21:06:03.416502 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27334): Terminated: ok {rc=0} 21:06:03.464366 --- ParallelTerminationStrategy: PID 27337 died... 21:06:03.484364 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27337): Terminated: ok {rc=0} 21:06:03.532168 --- ParallelTerminationStrategy: PID 27340 died... 21:06:03.552084 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27340): Terminated: ok {rc=0} 21:06:03.642662 bus /sierra_3: Setting Powered False 21:06:04.741888 bus /sierra_3: Setting Powered False 21:06:05.859169 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 21:06:07.115107 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:06:07.122507 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 21:06:07.158010 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 21:06:07.185603 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 21:06:07.239503 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 21:06:07.274496 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 21:06:07.302058 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 21:06:07.853251 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 21:06:07.906684 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:06:07.918773 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 21:06:07.990869 tst mo_mt_call.py: using LAC 31502 21:06:08.119346 tst mo_mt_call.py: using RAC 137 21:06:08.247595 tst mo_mt_call.py: using CellId 31502 21:06:08.376411 tst mo_mt_call.py: using BVCI 31503 21:06:08.490049 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:06:08.501625 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:06:08.512790 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:06:08.524589 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:06:08.536414 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:06:08.548187 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 21:06:08.667173 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 21:06:08.787818 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:06:09.297485 run create_hlr_db(pid=27346): Launched 21:06:09.425659 bus /sierra_2: Setting Powered False 21:06:10.491405 run create_hlr_db(pid=27346): Terminated: ok {rc=0} 21:06:10.930096 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27348): Launched 21:06:11.237056 run osmo-hlr_10.42.42.2(pid=27349): Launched 21:06:11.354528 run osmo-stp_10.42.42.5: Starting osmo-stp 21:06:11.885727 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27351): Launched 21:06:12.215663 run osmo-stp_10.42.42.5(pid=27352): Launched 21:06:12.340616 run osmo-msc_10.42.42.6: Starting osmo-msc 21:06:12.935589 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27354): Launched 21:06:13.266103 run osmo-msc_10.42.42.6(pid=27355): Launched 21:06:13.449368 run osmo-stp_10.42.42.5(pid=27352): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27352)] 21:06:13.588811 run osmo-stp_10.42.42.5(pid=27352): stdout: | (launched: 2022-12-12_21:06:12.155466) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:06:13.728678 run osmo-stp_10.42.42.5(pid=27352): stderr: | 20221212210612345 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210612345 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210612345 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210612346 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210612346 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210612347 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210612347 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:06:13.866272 run osmo-stp_10.42.42.5(pid=27352): stdout: | (launched: 2022-12-12_21:06:12.155466) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:06:13.998177 run osmo-stp_10.42.42.5(pid=27352): stderr: | 20221212210612345 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210612345 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210612345 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210612346 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210612346 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210612347 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210612347 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:06:14.155429 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27352): Process ended prematurely: osmo-stp_10.42.42.5(pid=27352) [trial-2382↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27352)] [trial-2382↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 21:06:14.165282 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 21:06:14.193843 run osmo-hlr_10.42.42.2(pid=27349): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27349)] 21:06:14.245500 run osmo-hlr_10.42.42.2(pid=27349): stdout: | (launched: 2022-12-12_21:06:11.181207) 21:06:14.298583 run osmo-hlr_10.42.42.2(pid=27349): stderr: | 20221212210611355 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212210611355 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212210611355 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212210611355 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212210611355 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212210611355 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212210611367 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212210611375 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212210611376 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212210611376 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:06:14.372767 run osmo-msc_10.42.42.6(pid=27355): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27355)] 21:06:14.423944 run osmo-msc_10.42.42.6(pid=27355): stdout: | (launched: 2022-12-12_21:06:13.206551) 21:06:14.477073 run osmo-msc_10.42.42.6(pid=27355): stderr: | 20221212210613526 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212210613526 DLGLOBAL DEBUG validating counter group 0x7fb14d49ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212210613526 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212210613526 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212210613527 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212210613527 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212210613528 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212210613529 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212210613529 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212210613529 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:06:14.530579 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27348): Terminating (SIGTERM) 21:06:14.573699 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27351): Terminating (SIGTERM) 21:06:14.616615 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27354): Terminating (SIGTERM) 21:06:14.659721 --- ParallelTerminationStrategy: PID 27348 died... 21:06:14.680032 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27348): Terminated: ok {rc=0} 21:06:14.728205 --- ParallelTerminationStrategy: PID 27351 died... 21:06:14.748317 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27351): Terminated: ok {rc=0} 21:06:14.795969 --- ParallelTerminationStrategy: PID 27354 died... 21:06:14.815881 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27354): Terminated: ok {rc=0} 21:06:14.904502 bus /sierra_3: Setting Powered False 21:06:16.008786 bus /sierra_3: Setting Powered False 21:06:17.141430 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2382 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 21:06:18.298428 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:06:18.310912 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 21:06:18.382703 tst mo_mt_call_osmux.py: using LAC 31503 21:06:18.512025 tst mo_mt_call_osmux.py: using RAC 138 21:06:18.642195 tst mo_mt_call_osmux.py: using CellId 31503 21:06:18.775945 tst mo_mt_call_osmux.py: using BVCI 31504 21:06:18.898092 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:06:18.909873 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:06:18.921392 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:06:18.933251 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:06:18.945150 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:06:18.956847 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 21:06:19.077425 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 21:06:19.196498 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:06:19.675608 run create_hlr_db(pid=27357): Launched 21:06:19.801692 bus /sierra_2: Setting Powered False 21:06:20.863117 run create_hlr_db(pid=27357): Terminated: ok {rc=0} 21:06:21.311779 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27359): Launched 21:06:21.643283 run osmo-hlr_10.42.42.2(pid=27360): Launched 21:06:21.769278 run osmo-stp_10.42.42.5: Starting osmo-stp 21:06:22.338212 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27362): Launched 21:06:22.667408 run osmo-stp_10.42.42.5(pid=27363): Launched 21:06:22.792274 run osmo-msc_10.42.42.6: Starting osmo-msc 21:06:23.387798 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27365): Launched 21:06:23.718172 run osmo-msc_10.42.42.6(pid=27366): Launched 21:06:23.903693 run osmo-stp_10.42.42.5(pid=27363): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27363)] 21:06:24.043333 run osmo-stp_10.42.42.5(pid=27363): stdout: | (launched: 2022-12-12_21:06:22.607509) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:06:24.183622 run osmo-stp_10.42.42.5(pid=27363): stderr: | 20221212210622795 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210622795 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210622795 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210622796 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210622796 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210622797 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210622797 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:06:24.321289 run osmo-stp_10.42.42.5(pid=27363): stdout: | (launched: 2022-12-12_21:06:22.607509) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:06:24.453122 run osmo-stp_10.42.42.5(pid=27363): stderr: | 20221212210622795 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210622795 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210622795 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210622796 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210622796 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210622797 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210622797 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:06:24.611003 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27363): Process ended prematurely: osmo-stp_10.42.42.5(pid=27363) [trial-2382↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27363)] [trial-2382↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 21:06:24.621092 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 21:06:24.649715 run osmo-hlr_10.42.42.2(pid=27360): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27360)] 21:06:24.701416 run osmo-hlr_10.42.42.2(pid=27360): stdout: | (launched: 2022-12-12_21:06:21.582950) 21:06:24.754931 run osmo-hlr_10.42.42.2(pid=27360): stderr: | 20221212210621778 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212210621778 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212210621778 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212210621778 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212210621778 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212210621778 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212210621790 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212210621799 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212210621800 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212210621800 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:06:24.828756 run osmo-msc_10.42.42.6(pid=27366): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27366)] 21:06:24.879909 run osmo-msc_10.42.42.6(pid=27366): stdout: | (launched: 2022-12-12_21:06:23.658306) 21:06:24.932689 run osmo-msc_10.42.42.6(pid=27366): stderr: | 20221212210623977 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212210623977 DLGLOBAL DEBUG validating counter group 0x7fa58731fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212210623977 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212210623977 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212210623977 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212210623977 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212210623979 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212210623979 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212210623980 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212210623980 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:06:24.986188 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27359): Terminating (SIGTERM) 21:06:25.028863 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27362): Terminating (SIGTERM) 21:06:25.071461 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27365): Terminating (SIGTERM) 21:06:25.114381 --- ParallelTerminationStrategy: PID 27359 died... 21:06:25.134837 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27359): Terminated: ok {rc=0} 21:06:25.182384 --- ParallelTerminationStrategy: PID 27362 died... 21:06:25.202324 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27362): Terminated: ok {rc=0} 21:06:25.249580 --- ParallelTerminationStrategy: PID 27365 died... 21:06:25.269569 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27365): Terminated: ok {rc=0} 21:06:25.360324 bus /sierra_3: Setting Powered False 21:06:26.461074 bus /sierra_3: Setting Powered False 21:06:27.581914 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 21:06:28.839303 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:06:28.846526 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 21:06:28.882024 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 21:06:28.909717 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 21:06:28.963822 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 21:06:28.998659 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 21:06:29.025879 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 21:06:29.582841 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 21:06:29.635960 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:06:29.647628 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 21:06:29.719098 tst mo_mt_call.py: using LAC 31504 21:06:29.849710 tst mo_mt_call.py: using RAC 139 21:06:29.971567 tst mo_mt_call.py: using CellId 31504 21:06:30.094327 tst mo_mt_call.py: using BVCI 31505 21:06:30.208726 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:06:30.220141 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:06:30.231352 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:06:30.242692 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:06:30.254140 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:06:30.265258 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 21:06:30.385041 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 21:06:30.507987 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:06:31.061342 run create_hlr_db(pid=27371): Launched 21:06:31.225689 bus /sierra_2: Setting Powered False 21:06:32.288676 run create_hlr_db(pid=27371): Terminated: ok {rc=0} 21:06:32.729166 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27373): Launched 21:06:33.034890 run osmo-hlr_10.42.42.2(pid=27374): Launched 21:06:33.150715 run osmo-stp_10.42.42.5: Starting osmo-stp 21:06:33.675360 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27376): Launched 21:06:33.981544 run osmo-stp_10.42.42.5(pid=27377): Launched 21:06:34.099026 run osmo-msc_10.42.42.6: Starting osmo-msc 21:06:34.656212 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27379): Launched 21:06:34.963527 run osmo-msc_10.42.42.6(pid=27380): Launched 21:06:35.134469 run osmo-stp_10.42.42.5(pid=27377): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27377)] 21:06:35.263602 run osmo-stp_10.42.42.5(pid=27377): stdout: | (launched: 2022-12-12_21:06:33.925442) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:06:35.393850 run osmo-stp_10.42.42.5(pid=27377): stderr: | 20221212210634092 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210634092 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210634092 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210634093 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210634093 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210634093 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210634093 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:06:35.522343 run osmo-stp_10.42.42.5(pid=27377): stdout: | (launched: 2022-12-12_21:06:33.925442) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:06:35.644920 run osmo-stp_10.42.42.5(pid=27377): stderr: | 20221212210634092 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210634092 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210634092 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210634093 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210634093 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210634093 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210634093 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:06:35.791697 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27377): Process ended prematurely: osmo-stp_10.42.42.5(pid=27377) [trial-2382↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27377)] [trial-2382↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 21:06:35.800741 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 21:06:35.827816 run osmo-hlr_10.42.42.2(pid=27374): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27374)] 21:06:35.876587 run osmo-hlr_10.42.42.2(pid=27374): stdout: | (launched: 2022-12-12_21:06:32.979315) 21:06:35.927105 run osmo-hlr_10.42.42.2(pid=27374): stderr: | 20221212210633152 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212210633152 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212210633152 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212210633152 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212210633152 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212210633152 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212210633165 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212210633173 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212210633173 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212210633173 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:06:35.997381 run osmo-msc_10.42.42.6(pid=27380): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27380)] 21:06:36.045636 run osmo-msc_10.42.42.6(pid=27380): stdout: | (launched: 2022-12-12_21:06:34.907595) 21:06:36.095564 run osmo-msc_10.42.42.6(pid=27380): stderr: | 20221212210635177 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212210635177 DLGLOBAL DEBUG validating counter group 0x7fade2420c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212210635177 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212210635177 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212210635177 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212210635178 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212210635179 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212210635180 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212210635180 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212210635180 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:06:36.145998 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27373): Terminating (SIGTERM) 21:06:36.186387 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27376): Terminating (SIGTERM) 21:06:36.227067 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27379): Terminating (SIGTERM) 21:06:36.267979 --- ParallelTerminationStrategy: PID 27373 died... 21:06:36.287350 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27373): Terminated: ok {rc=0} 21:06:36.332275 --- ParallelTerminationStrategy: PID 27376 died... 21:06:36.351329 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27376): Terminated: ok {rc=0} 21:06:36.396077 --- ParallelTerminationStrategy: PID 27379 died... 21:06:36.415012 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27379): Terminated: ok {rc=0} 21:06:36.501772 bus /sierra_3: Setting Powered False 21:06:37.602838 bus /sierra_3: Setting Powered False 21:06:38.717624 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2382 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 21:06:39.869637 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:06:39.882038 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 21:06:39.954212 tst mo_mt_call_osmux.py: using LAC 31505 21:06:40.082601 tst mo_mt_call_osmux.py: using RAC 140 21:06:40.214050 tst mo_mt_call_osmux.py: using CellId 31505 21:06:40.335425 tst mo_mt_call_osmux.py: using BVCI 31506 21:06:40.448682 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:06:40.460171 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:06:40.471451 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:06:40.482930 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:06:40.494341 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:06:40.505748 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 21:06:40.625097 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 21:06:40.745172 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:06:41.256715 run create_hlr_db(pid=27382): Launched 21:06:41.383301 bus /sierra_2: Setting Powered False 21:06:42.444682 run create_hlr_db(pid=27382): Terminated: ok {rc=0} 21:06:42.903552 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27384): Launched 21:06:43.234178 run osmo-hlr_10.42.42.2(pid=27385): Launched 21:06:43.360185 run osmo-stp_10.42.42.5: Starting osmo-stp 21:06:43.927762 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27387): Launched 21:06:44.259321 run osmo-stp_10.42.42.5(pid=27388): Launched 21:06:44.385580 run osmo-msc_10.42.42.6: Starting osmo-msc 21:06:44.982674 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27390): Launched 21:06:45.312074 run osmo-msc_10.42.42.6(pid=27391): Launched 21:06:45.495537 run osmo-stp_10.42.42.5(pid=27388): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27388)] 21:06:45.638532 run osmo-stp_10.42.42.5(pid=27388): stdout: | (launched: 2022-12-12_21:06:44.199080) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:06:45.776763 run osmo-stp_10.42.42.5(pid=27388): stderr: | 20221212210644389 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210644389 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210644389 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210644390 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210644390 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210644390 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210644390 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:06:45.933920 run osmo-stp_10.42.42.5(pid=27388): stdout: | (launched: 2022-12-12_21:06:44.199080) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:06:46.067662 run osmo-stp_10.42.42.5(pid=27388): stderr: | 20221212210644389 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210644389 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210644389 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210644390 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210644390 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210644390 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210644390 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:06:46.219405 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27388): Process ended prematurely: osmo-stp_10.42.42.5(pid=27388) [trial-2382↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27388)] [trial-2382↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 21:06:46.229528 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 21:06:46.257864 run osmo-hlr_10.42.42.2(pid=27385): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27385)] 21:06:46.307772 run osmo-hlr_10.42.42.2(pid=27385): stdout: | (launched: 2022-12-12_21:06:43.173910) 21:06:46.362752 run osmo-hlr_10.42.42.2(pid=27385): stderr: | 20221212210643369 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212210643370 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212210643370 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212210643370 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212210643370 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212210643370 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212210643382 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212210643391 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212210643391 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212210643391 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:06:46.435425 run osmo-msc_10.42.42.6(pid=27391): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27391)] 21:06:46.485842 run osmo-msc_10.42.42.6(pid=27391): stdout: | (launched: 2022-12-12_21:06:45.252300) 21:06:46.539414 run osmo-msc_10.42.42.6(pid=27391): stderr: | 20221212210645575 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212210645575 DLGLOBAL DEBUG validating counter group 0x7fb4b69f8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212210645575 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212210645575 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212210645575 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212210645576 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212210645577 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212210645578 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212210645578 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212210645578 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:06:46.592690 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27384): Terminating (SIGTERM) 21:06:46.635446 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27387): Terminating (SIGTERM) 21:06:46.679727 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27390): Terminating (SIGTERM) 21:06:46.726375 --- ParallelTerminationStrategy: PID 27384 died... 21:06:46.746354 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27384): Terminated: ok {rc=0} 21:06:46.795197 --- ParallelTerminationStrategy: PID 27387 died... 21:06:46.814807 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27387): Terminated: ok {rc=0} 21:06:46.860700 --- ParallelTerminationStrategy: PID 27390 died... 21:06:46.880440 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27390): Terminated: ok {rc=0} 21:06:46.972000 bus /sierra_3: Setting Powered False 21:06:48.075053 bus /sierra_3: Setting Powered False 21:06:49.192615 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 21:06:50.448150 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:06:50.455393 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 21:06:50.491127 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 21:06:50.518322 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 21:06:50.571260 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 21:06:50.606703 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 21:06:50.634285 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 21:06:51.186892 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 21:06:51.240304 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:06:51.252055 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 21:06:51.329343 tst mo_mt_call.py: using LAC 31506 21:06:51.458762 tst mo_mt_call.py: using RAC 141 21:06:51.591144 tst mo_mt_call.py: using CellId 31506 21:06:51.714870 tst mo_mt_call.py: using BVCI 31507 21:06:51.826747 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:06:51.837958 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:06:51.849041 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:06:51.860014 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:06:51.871084 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:06:51.882021 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 21:06:52.002723 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 21:06:52.126322 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:06:52.636515 run create_hlr_db(pid=27398): Launched 21:06:52.763075 bus /sierra_2: Setting Powered False 21:06:53.829029 run create_hlr_db(pid=27398): Terminated: ok {rc=0} 21:06:54.268087 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27400): Launched 21:06:54.600108 run osmo-hlr_10.42.42.2(pid=27401): Launched 21:06:54.726412 run osmo-stp_10.42.42.5: Starting osmo-stp 21:06:55.293589 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27403): Launched 21:06:55.625702 run osmo-stp_10.42.42.5(pid=27404): Launched 21:06:55.753251 run osmo-msc_10.42.42.6: Starting osmo-msc 21:06:56.351778 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27406): Launched 21:06:56.682425 run osmo-msc_10.42.42.6(pid=27407): Launched 21:06:56.867900 run osmo-stp_10.42.42.5(pid=27404): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27404)] 21:06:57.007460 run osmo-stp_10.42.42.5(pid=27404): stdout: | (launched: 2022-12-12_21:06:55.564926) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:06:57.147522 run osmo-stp_10.42.42.5(pid=27404): stderr: | 20221212210655756 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210655756 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210655756 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210655757 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210655757 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210655757 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210655757 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:06:57.285171 run osmo-stp_10.42.42.5(pid=27404): stdout: | (launched: 2022-12-12_21:06:55.564926) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:06:57.417453 run osmo-stp_10.42.42.5(pid=27404): stderr: | 20221212210655756 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210655756 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210655756 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210655757 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210655757 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210655757 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210655757 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:06:57.575541 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27404): Process ended prematurely: osmo-stp_10.42.42.5(pid=27404) [trial-2382↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27404)] [trial-2382↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 21:06:57.585495 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 21:06:57.614306 run osmo-hlr_10.42.42.2(pid=27401): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27401)] 21:06:57.665744 run osmo-hlr_10.42.42.2(pid=27401): stdout: | (launched: 2022-12-12_21:06:54.539445) 21:06:57.719079 run osmo-hlr_10.42.42.2(pid=27401): stderr: | 20221212210654736 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212210654736 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212210654736 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212210654736 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212210654736 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212210654736 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212210654748 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212210654756 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212210654756 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212210654757 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:06:57.793250 run osmo-msc_10.42.42.6(pid=27407): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27407)] 21:06:57.844479 run osmo-msc_10.42.42.6(pid=27407): stdout: | (launched: 2022-12-12_21:06:56.622496) 21:06:57.897727 run osmo-msc_10.42.42.6(pid=27407): stderr: | 20221212210656941 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212210656942 DLGLOBAL DEBUG validating counter group 0x7f717923dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212210656942 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212210656942 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212210656942 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212210656942 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212210656944 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212210656944 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212210656944 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212210656944 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:06:57.951614 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27400): Terminating (SIGTERM) 21:06:57.994278 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27403): Terminating (SIGTERM) 21:06:58.036670 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27406): Terminating (SIGTERM) 21:06:58.079607 --- ParallelTerminationStrategy: PID 27400 died... 21:06:58.099964 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27400): Terminated: ok {rc=0} 21:06:58.147903 --- ParallelTerminationStrategy: PID 27403 died... 21:06:58.167780 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27403): Terminated: ok {rc=0} 21:06:58.215730 --- ParallelTerminationStrategy: PID 27406 died... 21:06:58.235630 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27406): Terminated: ok {rc=0} 21:06:58.325694 bus /sierra_3: Setting Powered False 21:06:59.425485 bus /sierra_3: Setting Powered False 21:07:00.543041 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2382 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 21:07:01.695858 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:07:01.708372 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 21:07:01.785587 tst mo_mt_call_osmux.py: using LAC 31507 21:07:01.945171 tst mo_mt_call_osmux.py: using RAC 142 21:07:02.115524 tst mo_mt_call_osmux.py: using CellId 31507 21:07:02.271876 tst mo_mt_call_osmux.py: using BVCI 31508 21:07:02.394085 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:07:02.406113 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:07:02.417826 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:07:02.429894 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:07:02.441951 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:07:02.453962 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 21:07:02.571572 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 21:07:02.693524 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:07:03.174455 run create_hlr_db(pid=27409): Launched 21:07:03.301579 bus /sierra_2: Setting Powered False 21:07:04.363458 run create_hlr_db(pid=27409): Terminated: ok {rc=0} 21:07:04.812582 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27411): Launched 21:07:05.142648 run osmo-hlr_10.42.42.2(pid=27412): Launched 21:07:05.267997 run osmo-stp_10.42.42.5: Starting osmo-stp 21:07:05.834544 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27414): Launched 21:07:06.163394 run osmo-stp_10.42.42.5(pid=27415): Launched 21:07:06.288710 run osmo-msc_10.42.42.6: Starting osmo-msc 21:07:06.884688 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27417): Launched 21:07:07.214073 run osmo-msc_10.42.42.6(pid=27418): Launched 21:07:07.399038 run osmo-stp_10.42.42.5(pid=27415): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27415)] 21:07:07.537825 run osmo-stp_10.42.42.5(pid=27415): stdout: | (launched: 2022-12-12_21:07:06.103757) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:07:07.677822 run osmo-stp_10.42.42.5(pid=27415): stderr: | 20221212210706290 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210706291 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210706291 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210706291 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210706292 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210706292 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210706292 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:07:07.815372 run osmo-stp_10.42.42.5(pid=27415): stdout: | (launched: 2022-12-12_21:07:06.103757) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:07:07.946979 run osmo-stp_10.42.42.5(pid=27415): stderr: | 20221212210706290 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210706291 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210706291 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210706291 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210706292 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210706292 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210706292 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:07:08.104359 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27415): Process ended prematurely: osmo-stp_10.42.42.5(pid=27415) [trial-2382↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27415)] [trial-2382↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 21:07:08.114226 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 21:07:08.142923 run osmo-hlr_10.42.42.2(pid=27412): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27412)] 21:07:08.194283 run osmo-hlr_10.42.42.2(pid=27412): stdout: | (launched: 2022-12-12_21:07:05.082344) 21:07:08.247267 run osmo-hlr_10.42.42.2(pid=27412): stderr: | 20221212210705277 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212210705277 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212210705277 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212210705277 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212210705277 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212210705277 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212210705289 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212210705299 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212210705299 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212210705299 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:07:08.320872 run osmo-msc_10.42.42.6(pid=27418): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27418)] 21:07:08.372290 run osmo-msc_10.42.42.6(pid=27418): stdout: | (launched: 2022-12-12_21:07:07.154329) 21:07:08.425280 run osmo-msc_10.42.42.6(pid=27418): stderr: | 20221212210707474 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212210707474 DLGLOBAL DEBUG validating counter group 0x7fbe206cbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212210707474 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212210707474 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212210707474 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212210707474 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212210707476 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212210707476 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212210707477 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212210707477 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:07:08.478769 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27411): Terminating (SIGTERM) 21:07:08.521249 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27414): Terminating (SIGTERM) 21:07:08.563740 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27417): Terminating (SIGTERM) 21:07:08.606952 --- ParallelTerminationStrategy: PID 27411 died... 21:07:08.627418 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27411): Terminated: ok {rc=0} 21:07:08.675023 --- ParallelTerminationStrategy: PID 27414 died... 21:07:08.694805 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27414): Terminated: ok {rc=0} 21:07:08.742075 --- ParallelTerminationStrategy: PID 27417 died... 21:07:08.761890 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27417): Terminated: ok {rc=0} 21:07:08.851277 bus /sierra_3: Setting Powered False 21:07:09.950001 bus /sierra_3: Setting Powered False 21:07:11.066432 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 21:07:12.322657 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:07:12.329074 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 21:07:12.362601 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 21:07:12.388808 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 21:07:12.442551 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 21:07:12.477595 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 21:07:12.504852 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 21:07:13.054226 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 21:07:13.103279 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:07:13.114777 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 21:07:13.185009 tst mo_mt_call.py: using LAC 31508 21:07:13.305106 tst mo_mt_call.py: using RAC 143 21:07:13.427623 tst mo_mt_call.py: using CellId 31508 21:07:13.550425 tst mo_mt_call.py: using BVCI 31509 21:07:13.664552 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:07:13.675889 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:07:13.686936 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:07:13.698032 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:07:13.709109 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:07:13.720134 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:07:13.840528 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:07:13.959149 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:07:14.469558 run create_hlr_db(pid=27423): Launched 21:07:14.598442 bus /sierra_2: Setting Powered False 21:07:15.664165 run create_hlr_db(pid=27423): Terminated: ok {rc=0} 21:07:16.145402 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27425): Launched 21:07:16.483845 run osmo-hlr_10.42.42.2(pid=27426): Launched 21:07:16.736434 run osmo-stp_10.42.42.5: Starting osmo-stp 21:07:17.494051 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27428): Launched 21:07:17.815273 run osmo-stp_10.42.42.5(pid=27429): Launched 21:07:17.941268 run osmo-msc_10.42.42.6: Starting osmo-msc 21:07:18.537076 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27431): Launched 21:07:18.868106 run osmo-msc_10.42.42.6(pid=27432): Launched 21:07:19.051801 run osmo-stp_10.42.42.5(pid=27429): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27429)] 21:07:19.191682 run osmo-stp_10.42.42.5(pid=27429): stdout: | (launched: 2022-12-12_21:07:17.755041) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:07:19.331983 run osmo-stp_10.42.42.5(pid=27429): stderr: | 20221212210717944 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210717944 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210717945 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210717945 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210717945 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210717946 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210717946 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:07:19.470258 run osmo-stp_10.42.42.5(pid=27429): stdout: | (launched: 2022-12-12_21:07:17.755041) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:07:19.603373 run osmo-stp_10.42.42.5(pid=27429): stderr: | 20221212210717944 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210717944 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210717945 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210717945 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210717945 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210717946 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210717946 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:07:19.762151 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27429): Process ended prematurely: osmo-stp_10.42.42.5(pid=27429) [trial-2382↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27429)] [trial-2382↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 21:07:19.771910 tst mo_mt_call.py:8: Test FAILED (6.7 sec) 21:07:19.800299 run osmo-hlr_10.42.42.2(pid=27426): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27426)] 21:07:19.852025 run osmo-hlr_10.42.42.2(pid=27426): stdout: | (launched: 2022-12-12_21:07:16.422664) 21:07:19.905337 run osmo-hlr_10.42.42.2(pid=27426): stderr: | 20221212210716757 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212210716757 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212210716757 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212210716758 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212210716758 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212210716758 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212210716776 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212210716793 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212210716793 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212210716793 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:07:19.979800 run osmo-msc_10.42.42.6(pid=27432): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27432)] 21:07:20.031473 run osmo-msc_10.42.42.6(pid=27432): stdout: | (launched: 2022-12-12_21:07:18.807784) 21:07:20.084757 run osmo-msc_10.42.42.6(pid=27432): stderr: | 20221212210719128 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212210719128 DLGLOBAL DEBUG validating counter group 0x7fe4b241ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212210719128 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212210719128 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212210719129 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212210719129 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212210719130 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212210719131 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212210719131 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212210719131 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:07:20.137978 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27425): Terminating (SIGTERM) 21:07:20.180433 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27428): Terminating (SIGTERM) 21:07:20.223154 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27431): Terminating (SIGTERM) 21:07:20.266054 --- ParallelTerminationStrategy: PID 27425 died... 21:07:20.286365 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27425): Terminated: ok {rc=0} 21:07:20.334013 --- ParallelTerminationStrategy: PID 27428 died... 21:07:20.353780 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27428): Terminated: ok {rc=0} 21:07:20.401196 --- ParallelTerminationStrategy: PID 27431 died... 21:07:20.421084 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27431): Terminated: ok {rc=0} 21:07:20.510711 bus /sierra_3: Setting Powered False 21:07:21.614604 bus /sierra_3: Setting Powered False 21:07:22.731403 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2382 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 21:07:23.883291 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:07:23.895597 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 21:07:23.969054 tst mo_mt_call_osmux.py: using LAC 31509 21:07:24.099960 tst mo_mt_call_osmux.py: using RAC 144 21:07:24.228594 tst mo_mt_call_osmux.py: using CellId 31509 21:07:24.357540 tst mo_mt_call_osmux.py: using BVCI 31510 21:07:24.479490 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:07:24.491341 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:07:24.502952 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:07:24.514890 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:07:24.526900 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:07:24.538798 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:07:24.660681 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:07:24.779498 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:07:25.255582 run create_hlr_db(pid=27434): Launched 21:07:25.382000 bus /sierra_2: Setting Powered False 21:07:26.443421 run create_hlr_db(pid=27434): Terminated: ok {rc=0} 21:07:26.893964 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27436): Launched 21:07:27.225669 run osmo-hlr_10.42.42.2(pid=27437): Launched 21:07:27.352030 run osmo-stp_10.42.42.5: Starting osmo-stp 21:07:27.923317 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27439): Launched 21:07:28.253130 run osmo-stp_10.42.42.5(pid=27440): Launched 21:07:28.379914 run osmo-msc_10.42.42.6: Starting osmo-msc 21:07:28.975711 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27442): Launched 21:07:29.306535 run osmo-msc_10.42.42.6(pid=27443): Launched 21:07:29.490192 run osmo-stp_10.42.42.5(pid=27440): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27440)] 21:07:29.629874 run osmo-stp_10.42.42.5(pid=27440): stdout: | (launched: 2022-12-12_21:07:28.193473) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:07:29.769571 run osmo-stp_10.42.42.5(pid=27440): stderr: | 20221212210728381 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210728382 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210728382 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210728382 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210728383 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210728383 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210728383 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:07:29.908185 run osmo-stp_10.42.42.5(pid=27440): stdout: | (launched: 2022-12-12_21:07:28.193473) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:07:30.039919 run osmo-stp_10.42.42.5(pid=27440): stderr: | 20221212210728381 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210728382 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210728382 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210728382 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210728383 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210728383 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210728383 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:07:30.197715 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27440): Process ended prematurely: osmo-stp_10.42.42.5(pid=27440) [trial-2382↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27440)] [trial-2382↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 21:07:30.207340 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 21:07:30.235740 run osmo-hlr_10.42.42.2(pid=27437): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27437)] 21:07:30.287519 run osmo-hlr_10.42.42.2(pid=27437): stdout: | (launched: 2022-12-12_21:07:27.165324) 21:07:30.340515 run osmo-hlr_10.42.42.2(pid=27437): stderr: | 20221212210727360 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212210727360 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212210727360 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212210727360 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212210727360 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212210727360 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212210727372 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212210727381 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212210727381 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212210727382 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:07:30.414473 run osmo-msc_10.42.42.6(pid=27443): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27443)] 21:07:30.465609 run osmo-msc_10.42.42.6(pid=27443): stdout: | (launched: 2022-12-12_21:07:29.246131) 21:07:30.518305 run osmo-msc_10.42.42.6(pid=27443): stderr: | 20221212210729565 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212210729566 DLGLOBAL DEBUG validating counter group 0x7fd93188ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212210729566 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212210729566 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212210729566 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212210729566 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212210729568 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212210729568 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212210729568 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212210729568 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:07:30.571552 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27436): Terminating (SIGTERM) 21:07:30.614194 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27439): Terminating (SIGTERM) 21:07:30.656567 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27442): Terminating (SIGTERM) 21:07:30.699260 --- ParallelTerminationStrategy: PID 27436 died... 21:07:30.719461 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27436): Terminated: ok {rc=0} 21:07:30.767070 --- ParallelTerminationStrategy: PID 27439 died... 21:07:30.786874 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27439): Terminated: ok {rc=0} 21:07:30.838023 --- ParallelTerminationStrategy: PID 27442 died... 21:07:30.859586 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27442): Terminated: ok {rc=0} 21:07:30.955145 bus /sierra_3: Setting Powered False 21:07:32.062373 bus /sierra_3: Setting Powered False 21:07:33.179289 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 voice:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 21:07:34.436607 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:07:34.443063 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 21:07:34.476346 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 21:07:34.502956 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 21:07:34.554922 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 21:07:34.588472 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 21:07:34.614840 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 21:07:35.165142 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 21:07:35.214091 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:07:35.225149 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 21:07:35.295981 tst mo_mt_call.py: using LAC 31510 21:07:35.420028 tst mo_mt_call.py: using RAC 145 21:07:35.539340 tst mo_mt_call.py: using CellId 31510 21:07:35.662094 tst mo_mt_call.py: using BVCI 31511 21:07:35.775458 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:07:35.786607 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:07:35.797549 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:07:35.808449 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:07:35.820898 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:07:35.834838 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 21:07:35.951999 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 21:07:36.071252 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:07:36.583389 run create_hlr_db(pid=27449): Launched 21:07:36.710511 bus /sierra_2: Setting Powered False 21:07:37.776218 run create_hlr_db(pid=27449): Terminated: ok {rc=0} 21:07:38.235338 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27451): Launched 21:07:38.565748 run osmo-hlr_10.42.42.2(pid=27452): Launched 21:07:38.694357 run osmo-stp_10.42.42.5: Starting osmo-stp 21:07:39.262225 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27454): Launched 21:07:39.592744 run osmo-stp_10.42.42.5(pid=27455): Launched 21:07:39.719289 run osmo-msc_10.42.42.6: Starting osmo-msc 21:07:40.315920 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27457): Launched 21:07:40.647420 run osmo-msc_10.42.42.6(pid=27458): Launched 21:07:40.831437 run osmo-stp_10.42.42.5(pid=27455): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27455)] 21:07:40.970802 run osmo-stp_10.42.42.5(pid=27455): stdout: | (launched: 2022-12-12_21:07:39.532278) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:07:41.110706 run osmo-stp_10.42.42.5(pid=27455): stderr: | 20221212210739721 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210739721 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210739721 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210739722 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210739722 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210739722 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210739722 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:07:41.248334 run osmo-stp_10.42.42.5(pid=27455): stdout: | (launched: 2022-12-12_21:07:39.532278) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:07:41.380198 run osmo-stp_10.42.42.5(pid=27455): stderr: | 20221212210739721 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210739721 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210739721 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210739722 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210739722 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210739722 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210739722 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:07:41.537832 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27455): Process ended prematurely: osmo-stp_10.42.42.5(pid=27455) [trial-2382↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27455)] [trial-2382↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 21:07:41.547549 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 21:07:41.576241 run osmo-hlr_10.42.42.2(pid=27452): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27452)] 21:07:41.628025 run osmo-hlr_10.42.42.2(pid=27452): stdout: | (launched: 2022-12-12_21:07:38.506097) 21:07:41.681370 run osmo-hlr_10.42.42.2(pid=27452): stderr: | 20221212210738701 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212210738701 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212210738701 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212210738702 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212210738702 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212210738702 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212210738714 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212210738722 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212210738723 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212210738723 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:07:41.755590 run osmo-msc_10.42.42.6(pid=27458): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27458)] 21:07:41.806992 run osmo-msc_10.42.42.6(pid=27458): stdout: | (launched: 2022-12-12_21:07:40.587131) 21:07:41.860152 run osmo-msc_10.42.42.6(pid=27458): stderr: | 20221212210740906 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212210740906 DLGLOBAL DEBUG validating counter group 0x7facd6e60c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212210740906 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212210740906 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212210740906 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212210740906 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212210740908 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212210740908 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212210740909 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212210740909 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:07:41.914135 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27451): Terminating (SIGTERM) 21:07:41.956786 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27454): Terminating (SIGTERM) 21:07:41.999539 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27457): Terminating (SIGTERM) 21:07:42.042461 --- ParallelTerminationStrategy: PID 27451 died... 21:07:42.062808 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27451): Terminated: ok {rc=0} 21:07:42.110461 --- ParallelTerminationStrategy: PID 27454 died... 21:07:42.130235 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27454): Terminated: ok {rc=0} 21:07:42.177631 --- ParallelTerminationStrategy: PID 27457 died... 21:07:42.197471 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27457): Terminated: ok {rc=0} 21:07:42.287302 bus /sierra_3: Setting Powered False 21:07:43.388006 bus /sierra_3: Setting Powered False 21:07:44.506721 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2382 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 21:07:45.657851 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:07:45.670136 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 21:07:45.746692 tst mo_mt_call_osmux.py: using LAC 31511 21:07:45.877365 tst mo_mt_call_osmux.py: using RAC 146 21:07:46.011176 tst mo_mt_call_osmux.py: using CellId 31511 21:07:46.161063 tst mo_mt_call_osmux.py: using BVCI 31512 21:07:46.274711 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:07:46.286446 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:07:46.298058 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:07:46.309499 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:07:46.321589 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:07:46.334561 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 21:07:46.472270 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 21:07:46.626748 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:07:47.239257 run create_hlr_db(pid=27460): Launched 21:07:47.396524 bus /sierra_2: Setting Powered False 21:07:48.462162 run create_hlr_db(pid=27460): Terminated: ok {rc=0} 21:07:48.901596 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27462): Launched 21:07:49.209629 run osmo-hlr_10.42.42.2(pid=27463): Launched 21:07:49.326271 run osmo-stp_10.42.42.5: Starting osmo-stp 21:07:49.867500 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27465): Launched 21:07:50.175103 run osmo-stp_10.42.42.5(pid=27466): Launched 21:07:50.290643 run osmo-msc_10.42.42.6: Starting osmo-msc 21:07:50.845786 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27468): Launched 21:07:51.153237 run osmo-msc_10.42.42.6(pid=27469): Launched 21:07:51.323957 run osmo-stp_10.42.42.5(pid=27466): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27466)] 21:07:51.453188 run osmo-stp_10.42.42.5(pid=27466): stdout: | (launched: 2022-12-12_21:07:50.118670) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:07:51.583033 run osmo-stp_10.42.42.5(pid=27466): stderr: | 20221212210750286 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210750286 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210750287 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210750287 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210750288 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210750288 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210750288 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:07:51.711136 run osmo-stp_10.42.42.5(pid=27466): stdout: | (launched: 2022-12-12_21:07:50.118670) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:07:51.833483 run osmo-stp_10.42.42.5(pid=27466): stderr: | 20221212210750286 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210750286 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210750287 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210750287 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210750288 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210750288 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210750288 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:07:51.980473 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27466): Process ended prematurely: osmo-stp_10.42.42.5(pid=27466) [trial-2382↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27466)] [trial-2382↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 21:07:51.989645 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 21:07:52.016386 run osmo-hlr_10.42.42.2(pid=27463): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27463)] 21:07:52.064867 run osmo-hlr_10.42.42.2(pid=27463): stdout: | (launched: 2022-12-12_21:07:49.153566) 21:07:52.114997 run osmo-hlr_10.42.42.2(pid=27463): stderr: | 20221212210749327 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212210749327 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212210749327 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212210749327 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212210749327 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212210749327 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212210749338 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212210749347 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212210749347 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212210749347 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:07:52.184769 run osmo-msc_10.42.42.6(pid=27469): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27469)] 21:07:52.233595 run osmo-msc_10.42.42.6(pid=27469): stdout: | (launched: 2022-12-12_21:07:51.096839) 21:07:52.283807 run osmo-msc_10.42.42.6(pid=27469): stderr: | 20221212210751366 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212210751367 DLGLOBAL DEBUG validating counter group 0x7f6810515c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212210751367 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212210751367 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212210751367 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212210751367 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212210751369 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212210751369 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212210751370 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212210751370 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:07:52.334059 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27462): Terminating (SIGTERM) 21:07:52.374426 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27465): Terminating (SIGTERM) 21:07:52.414731 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27468): Terminating (SIGTERM) 21:07:52.455259 --- ParallelTerminationStrategy: PID 27462 died... 21:07:52.474566 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27462): Terminated: ok {rc=0} 21:07:52.519217 --- ParallelTerminationStrategy: PID 27465 died... 21:07:52.538075 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27465): Terminated: ok {rc=0} 21:07:52.582351 --- ParallelTerminationStrategy: PID 27468 died... 21:07:52.601309 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27468): Terminated: ok {rc=0} 21:07:52.688081 bus /sierra_3: Setting Powered False 21:07:53.789837 bus /sierra_3: Setting Powered False 21:07:54.904759 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 voice:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 emergency:trx-sysmocell5000 --------------------------------------------------------------------- 21:07:56.159266 tst emergency:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:07:56.164154 tst emergency:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 21:07:56.199386 tst emergency:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 21:07:56.226648 tst emergency:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 21:07:56.313230 tst emergency:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 21:07:56.348376 tst emergency:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 21:07:56.376241 tst emergency:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 21:07:56.961053 tst emergency:trx-sysmocell5000: RESERVED RESOURCES for emergency: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2382 emergency:trx-sysmocell5000 emergency_mo_mt_call.py ---------------------------------------------- 21:07:56.966432 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:07:56.977729 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 21:07:57.030315 tst emergency_mo_mt_call.py: using LAC 31512 21:07:57.157397 tst emergency_mo_mt_call.py: using RAC 147 21:07:57.284775 tst emergency_mo_mt_call.py: using CellId 31512 21:07:57.412056 tst emergency_mo_mt_call.py: using BVCI 31513 21:07:57.529737 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:07:57.541260 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:07:57.552305 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:07:57.564134 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:07:57.575536 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:07:57.587169 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 21:07:57.703014 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 21:07:57.824027 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:07:58.293069 run create_hlr_db(pid=27474): Launched 21:07:58.417205 bus /sierra_2: Setting Powered False 21:07:59.477198 run create_hlr_db(pid=27474): Terminated: ok {rc=0} 21:07:59.917685 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27476): Launched 21:08:00.241693 run osmo-hlr_10.42.42.2(pid=27477): Launched 21:08:00.367450 run osmo-stp_10.42.42.5: Starting osmo-stp 21:08:00.949718 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27479): Launched 21:08:01.285951 run osmo-stp_10.42.42.5(pid=27480): Launched 21:08:01.538152 tst emergency_mo_mt_call.py: using MSISDN 7971 21:08:01.776448 run osmo-msc_10.42.42.6: Starting osmo-msc 21:08:02.366850 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27482): Launched 21:08:02.692561 run osmo-msc_10.42.42.6(pid=27483): Launched 21:08:02.874308 run osmo-stp_10.42.42.5(pid=27480): ERR: Terminated: ERROR {rc=1} [trial-2382↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27480)] 21:08:03.010941 run osmo-stp_10.42.42.5(pid=27480): stdout: | (launched: 2022-12-12_21:08:01.227044) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:08:03.149058 run osmo-stp_10.42.42.5(pid=27480): stderr: | 20221212210801512 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210801512 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210801512 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210801513 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210801513 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210801513 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210801513 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:08:03.285294 run osmo-stp_10.42.42.5(pid=27480): stdout: | (launched: 2022-12-12_21:08:01.227044) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:08:03.414631 run osmo-stp_10.42.42.5(pid=27480): stderr: | 20221212210801512 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210801512 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210801512 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210801513 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210801513 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210801513 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210801513 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:08:03.569178 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=27480): Process ended prematurely: osmo-stp_10.42.42.5(pid=27480) [trial-2382↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27480)] [trial-2382↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19] 21:08:03.578269 tst emergency_mo_mt_call.py:19: Test FAILED (6.6 sec) 21:08:03.606190 run osmo-hlr_10.42.42.2(pid=27477): ERR: Terminated: ERROR {rc=237} [trial-2382↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27477)] 21:08:03.658396 run osmo-hlr_10.42.42.2(pid=27477): stdout: | (launched: 2022-12-12_21:08:00.182804) 21:08:03.711560 run osmo-hlr_10.42.42.2(pid=27477): stderr: | 20221212210800377 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212210800377 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212210800377 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212210800377 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212210800377 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212210800377 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212210800389 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/emergency:trx-sysmocell5000/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212210800398 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212210800398 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212210800399 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:08:03.785606 run osmo-msc_10.42.42.6(pid=27483): ERR: Terminated: ERROR {rc=2} [trial-2382↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27483)] 21:08:03.836693 run osmo-msc_10.42.42.6(pid=27483): stdout: | (launched: 2022-12-12_21:08:02.633585) 21:08:03.889711 run osmo-msc_10.42.42.6(pid=27483): stderr: | 20221212210802953 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212210802953 DLGLOBAL DEBUG validating counter group 0x7f91ad48fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212210802953 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212210802953 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212210802953 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212210802953 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212210802955 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212210802956 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212210802956 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212210802956 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:08:03.943036 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27476): Terminating (SIGTERM) 21:08:03.985837 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27479): Terminating (SIGTERM) 21:08:04.028512 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27482): Terminating (SIGTERM) 21:08:04.072202 --- ParallelTerminationStrategy: PID 27476 died... 21:08:04.092617 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27476): Terminated: ok {rc=0} 21:08:04.140164 --- ParallelTerminationStrategy: PID 27479 died... 21:08:04.159988 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27479): Terminated: ok {rc=0} 21:08:04.207491 --- ParallelTerminationStrategy: PID 27482 died... 21:08:04.227236 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27482): Terminated: ok {rc=0} 21:08:04.315772 bus /sierra_3: Setting Powered False 21:08:05.416753 bus /sierra_3: Setting Powered False 21:08:06.533785 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2382 emergency:trx-sysmocell5000 emergency_preemptive_call.py ---------------------------------------------- 21:08:07.622939 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:08:07.634915 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 21:08:07.688519 tst emergency_preemptive_call.py: using LAC 31513 21:08:07.814478 tst emergency_preemptive_call.py: using RAC 148 21:08:07.934462 tst emergency_preemptive_call.py: using CellId 31513 21:08:08.061372 tst emergency_preemptive_call.py: using BVCI 31514 21:08:08.179231 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:08:08.190802 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:08:08.202162 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:08:08.213593 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:08:08.225119 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:08:08.236520 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 21:08:08.353378 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 21:08:08.473905 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 21:08:08.589303 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 21:08:08.706159 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:08:09.174928 run create_hlr_db(pid=27485): Launched 21:08:09.298340 bus /sierra_2: Setting Powered False 21:08:10.358702 run create_hlr_db(pid=27485): Terminated: ok {rc=0} 21:08:10.780536 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27487): Launched 21:08:11.081285 run osmo-hlr_10.42.42.2(pid=27488): Launched 21:08:11.194753 run osmo-stp_10.42.42.5: Starting osmo-stp 21:08:11.722871 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27490): Launched 21:08:12.022519 run osmo-stp_10.42.42.5(pid=27491): Launched 21:08:12.146450 tst emergency_preemptive_call.py: using MSISDN 7972 21:08:12.299451 run osmo-msc_10.42.42.6: Starting osmo-msc 21:08:12.840476 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27493): Launched 21:08:13.141251 run osmo-msc_10.42.42.6(pid=27494): Launched 21:08:13.308467 run osmo-stp_10.42.42.5(pid=27491): ERR: Terminated: ERROR {rc=1} [trial-2382↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27491)] 21:08:13.435911 run osmo-stp_10.42.42.5(pid=27491): stdout: | (launched: 2022-12-12_21:08:11.967405) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:08:13.563765 run osmo-stp_10.42.42.5(pid=27491): stderr: | 20221212210812134 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210812134 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210812134 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210812134 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210812135 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210812135 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210812135 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:08:13.690000 run osmo-stp_10.42.42.5(pid=27491): stdout: | (launched: 2022-12-12_21:08:11.967405) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:08:13.809981 run osmo-stp_10.42.42.5(pid=27491): stderr: | 20221212210812134 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210812134 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210812134 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210812134 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210812135 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210812135 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210812135 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:08:13.953081 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=27491): Process ended prematurely: osmo-stp_10.42.42.5(pid=27491) [trial-2382↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27491)] [trial-2382↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32] 21:08:13.961465 tst emergency_preemptive_call.py:32: Test FAILED (6.3 sec) 21:08:13.987727 run osmo-hlr_10.42.42.2(pid=27488): ERR: Terminated: ERROR {rc=237} [trial-2382↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27488)] 21:08:14.036518 run osmo-hlr_10.42.42.2(pid=27488): stdout: | (launched: 2022-12-12_21:08:11.026295) 21:08:14.086679 run osmo-hlr_10.42.42.2(pid=27488): stderr: | 20221212210811199 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212210811199 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212210811199 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212210811199 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212210811199 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212210811199 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212210811211 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/emergency:trx-sysmocell5000/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212210811220 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212210811220 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212210811220 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:08:14.157502 run osmo-msc_10.42.42.6(pid=27494): ERR: Terminated: ERROR {rc=2} [trial-2382↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27494)] 21:08:14.205780 run osmo-msc_10.42.42.6(pid=27494): stdout: | (launched: 2022-12-12_21:08:13.086001) 21:08:14.255941 run osmo-msc_10.42.42.6(pid=27494): stderr: | 20221212210813353 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212210813354 DLGLOBAL DEBUG validating counter group 0x7f140cd18c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212210813354 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212210813354 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212210813354 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212210813354 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212210813356 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212210813356 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212210813357 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212210813357 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:08:14.306303 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27487): Terminating (SIGTERM) 21:08:14.346298 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27490): Terminating (SIGTERM) 21:08:14.386255 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27493): Terminating (SIGTERM) 21:08:14.426640 --- ParallelTerminationStrategy: PID 27487 died... 21:08:14.446018 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27487): Terminated: ok {rc=0} 21:08:14.491174 --- ParallelTerminationStrategy: PID 27490 died... 21:08:14.510236 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27490): Terminated: ok {rc=0} 21:08:14.554571 --- ParallelTerminationStrategy: PID 27493 died... 21:08:14.573433 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27493): Terminated: ok {rc=0} 21:08:14.659135 bus /sierra_9: Setting Powered False 21:08:15.759530 bus /sierra_9: Setting Powered False 21:08:16.881140 bus /sierra_8: Setting Powered False 21:08:17.978251 bus /sierra_8: Setting Powered False 21:08:19.094413 bus /sierra_3: Setting Powered False 21:08:20.195295 bus /sierra_3: Setting Powered False 21:08:21.312573 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 emergency:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 gprs:trx-sysmocell5000 --------------------------------------------------------------------- 21:08:22.596013 tst gprs:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:08:22.601129 tst gprs:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 21:08:22.635270 tst gprs:trx-sysmocell5000: Verifying 9 x ip_address (candidates: 9) 21:08:22.673051 tst gprs:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 21:08:22.757766 tst gprs:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 21:08:22.793346 tst gprs:trx-sysmocell5000: Reserving 9 x ip_address (candidates: 9) 21:08:22.833405 tst gprs:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 21:08:23.425824 tst gprs:trx-sysmocell5000: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2382 gprs:trx-sysmocell5000 cs_paging_gprs_active.py ---------------------------------------------- 21:08:23.481564 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 21:08:23.492768 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 21:08:23.543097 tst cs_paging_gprs_active.py: using LAC 31514 21:08:23.673883 tst cs_paging_gprs_active.py: using RAC 149 21:08:23.802158 tst cs_paging_gprs_active.py: using CellId 31514 21:08:23.930552 tst cs_paging_gprs_active.py: using BVCI 31515 21:08:24.051719 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 21:08:24.063005 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 21:08:24.074015 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 21:08:24.085894 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 21:08:24.097858 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 21:08:24.109718 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 21:08:24.121902 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 21:08:24.133832 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 21:08:24.146009 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 21:08:24.269705 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 21:08:24.391792 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 21:08:24.615748 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:08:24.947750 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27499): Launched 21:08:25.235284 run iperf3-srv_10.42.42.10(pid=27500): Launched 21:08:25.359585 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 21:08:25.584298 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:08:25.918312 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27501): Launched 21:08:26.206706 run iperf3-srv_10.42.42.10(pid=27502): Launched 21:08:26.330822 tst cs_paging_gprs_active.py:38: start network... 21:08:26.555059 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:08:27.069416 run create_hlr_db(pid=27503): Launched 21:08:27.196007 bus /sierra_2: Setting Powered False 21:08:28.261366 run create_hlr_db(pid=27503): Terminated: ok {rc=0} 21:08:28.701535 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27505): Launched 21:08:29.011529 run osmo-hlr_10.42.42.2(pid=27506): Launched 21:08:29.130215 run osmo-stp_10.42.42.5: Starting osmo-stp 21:08:29.661653 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27508): Launched 21:08:29.969455 run osmo-stp_10.42.42.5(pid=27509): Launched 21:08:30.087481 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:08:30.623684 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27511): Launched 21:08:30.741841 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:08:31.038256 run patchelf(pid=27512): Launched 21:08:31.226634 run osmo-stp_10.42.42.5(pid=27509): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27509)] 21:08:31.359834 run osmo-stp_10.42.42.5(pid=27509): stdout: | (launched: 2022-12-12_21:08:29.913320) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:08:31.494517 run osmo-stp_10.42.42.5(pid=27509): stderr: | 20221212210830080 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210830080 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210830080 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210830081 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210830081 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210830081 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210830081 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:08:31.629163 run osmo-stp_10.42.42.5(pid=27509): stdout: | (launched: 2022-12-12_21:08:29.913320) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:08:31.757727 run osmo-stp_10.42.42.5(pid=27509): stderr: | 20221212210830080 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210830080 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210830080 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210830081 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210830081 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210830081 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210830081 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:08:31.910419 run patchelf(pid=27512): Terminating (SIGINT) 21:08:32.087196 run patchelf(pid=27512): Terminated: ok {rc=0} 21:08:32.215637 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=27509): Process ended prematurely: osmo-stp_10.42.42.5(pid=27509) [trial-2382↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27509)] [trial-2382↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38] 21:08:32.226042 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 21:08:32.254362 run osmo-hlr_10.42.42.2(pid=27506): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27506)] 21:08:32.304089 run osmo-hlr_10.42.42.2(pid=27506): stdout: | (launched: 2022-12-12_21:08:28.954881) 21:08:32.354361 run osmo-hlr_10.42.42.2(pid=27506): stderr: | 20221212210829128 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212210829128 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212210829128 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212210829128 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212210829128 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212210829128 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212210829141 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-sysmocell5000/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212210829149 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212210829150 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212210829150 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:08:32.405173 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27499): Terminating (SIGTERM) 21:08:32.445631 run iperf3-srv_10.42.42.10(pid=27500): Terminating (SIGTERM) 21:08:32.485989 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27501): Terminating (SIGTERM) 21:08:32.526487 run iperf3-srv_10.42.42.10(pid=27502): Terminating (SIGTERM) 21:08:32.566877 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27505): Terminating (SIGTERM) 21:08:32.607343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27508): Terminating (SIGTERM) 21:08:32.647857 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27511): Terminating (SIGTERM) 21:08:32.688598 --- ParallelTerminationStrategy: PID 27499 died... 21:08:32.708110 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27499): Terminated: ok {rc=0} 21:08:32.753054 --- ParallelTerminationStrategy: PID 27500 died... 21:08:32.771952 run iperf3-srv_10.42.42.10(pid=27500): Terminated {rc=256} 21:08:32.816535 --- ParallelTerminationStrategy: PID 27501 died... 21:08:32.835679 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27501): Terminated: ok {rc=0} 21:08:32.880162 --- ParallelTerminationStrategy: PID 27502 died... 21:08:32.899013 run iperf3-srv_10.42.42.10(pid=27502): Terminated {rc=256} 21:08:32.943377 --- ParallelTerminationStrategy: PID 27505 died... 21:08:32.962325 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27505): Terminated: ok {rc=0} 21:08:33.006682 --- ParallelTerminationStrategy: PID 27508 died... 21:08:33.025643 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27508): Terminated: ok {rc=0} 21:08:33.070701 --- ParallelTerminationStrategy: PID 27511 died... 21:08:33.089597 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27511): Terminated: ok {rc=0} 21:08:33.176413 bus /gobi_0: Setting Powered False 21:08:34.276940 bus /gobi_0: Setting Powered False 21:08:35.393659 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:trx-sysmocell5000 iperf3.py ---------------------------------------------- 21:08:36.547765 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 21:08:36.559521 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 21:08:36.617206 tst iperf3.py: using LAC 31515 21:08:36.750087 tst iperf3.py: using RAC 150 21:08:36.877790 tst iperf3.py: using CellId 31515 21:08:37.005156 tst iperf3.py: using BVCI 31516 21:08:37.125728 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 21:08:37.137222 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 21:08:37.148188 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 21:08:37.159664 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 21:08:37.171164 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 21:08:37.182601 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 21:08:37.194192 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 21:08:37.205591 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 21:08:37.217112 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 21:08:37.338153 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 21:08:37.545685 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:08:37.854272 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27513): Launched 21:08:38.121744 run iperf3-srv_10.42.42.10(pid=27514): Launched 21:08:38.237452 tst iperf3.py:8: start network... 21:08:38.445749 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:08:38.926040 run create_hlr_db(pid=27515): Launched 21:08:39.052185 bus /gobi_6: Setting Powered False 21:08:40.113437 run create_hlr_db(pid=27515): Terminated: ok {rc=0} 21:08:40.542252 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27517): Launched 21:08:40.850653 run osmo-hlr_10.42.42.2(pid=27518): Launched 21:08:40.966463 run osmo-stp_10.42.42.5: Starting osmo-stp 21:08:41.496927 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27520): Launched 21:08:41.806432 run osmo-stp_10.42.42.5(pid=27521): Launched 21:08:41.924243 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:08:42.458507 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27523): Launched 21:08:42.576083 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:08:42.837300 run patchelf(pid=27524): Launched 21:08:43.008640 run osmo-stp_10.42.42.5(pid=27521): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27521)] 21:08:43.139310 run osmo-stp_10.42.42.5(pid=27521): stdout: | (launched: 2022-12-12_21:08:41.749551) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:08:43.271202 run osmo-stp_10.42.42.5(pid=27521): stderr: | 20221212210841916 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210841916 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210841916 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210841917 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210841917 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210841917 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210841917 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:08:43.403187 run osmo-stp_10.42.42.5(pid=27521): stdout: | (launched: 2022-12-12_21:08:41.749551) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:08:43.529873 run osmo-stp_10.42.42.5(pid=27521): stderr: | 20221212210841916 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210841916 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210841916 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210841917 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210841917 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210841917 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210841917 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:08:43.679597 run patchelf(pid=27524): Terminating (SIGINT) 21:08:43.853745 run patchelf(pid=27524): Terminated: ok {rc=0} 21:08:43.979142 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27521): Process ended prematurely: osmo-stp_10.42.42.5(pid=27521) [trial-2382↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27521)] [trial-2382↪gprs:trx-sysmocell5000↪iperf3.py:8] 21:08:43.988655 tst iperf3.py:8: Test FAILED (7.5 sec) 21:08:44.016121 run osmo-hlr_10.42.42.2(pid=27518): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-sysmocell5000↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27518)] 21:08:44.064386 run osmo-hlr_10.42.42.2(pid=27518): stdout: | (launched: 2022-12-12_21:08:40.793986) 21:08:44.114908 run osmo-hlr_10.42.42.2(pid=27518): stderr: | 20221212210840968 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212210840969 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212210840969 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212210840969 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212210840969 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212210840969 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212210840996 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-sysmocell5000/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212210841007 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212210841007 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212210841007 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:08:44.165717 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27513): Terminating (SIGTERM) 21:08:44.206280 run iperf3-srv_10.42.42.10(pid=27514): Terminating (SIGTERM) 21:08:44.246649 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27517): Terminating (SIGTERM) 21:08:44.287163 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27520): Terminating (SIGTERM) 21:08:44.327572 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27523): Terminating (SIGTERM) 21:08:44.368785 --- ParallelTerminationStrategy: PID 27513 died... 21:08:44.388533 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27513): Terminated: ok {rc=0} 21:08:44.433586 --- ParallelTerminationStrategy: PID 27514 died... 21:08:44.452432 run iperf3-srv_10.42.42.10(pid=27514): Terminated {rc=256} 21:08:44.496889 --- ParallelTerminationStrategy: PID 27517 died... 21:08:44.516235 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27517): Terminated: ok {rc=0} 21:08:44.560750 --- ParallelTerminationStrategy: PID 27520 died... 21:08:44.579686 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27520): Terminated: ok {rc=0} 21:08:44.624271 --- ParallelTerminationStrategy: PID 27523 died... 21:08:44.643219 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27523): Terminated: ok {rc=0} 21:08:44.730549 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:trx-sysmocell5000 iperf3m4.py ---------------------------------------------- 21:08:45.910165 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 21:08:45.923461 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 21:08:45.981063 tst iperf3m4.py: using LAC 31516 21:08:46.116880 tst iperf3m4.py: using RAC 151 21:08:46.239581 tst iperf3m4.py: using CellId 31516 21:08:46.434133 tst iperf3m4.py: using BVCI 31517 21:08:46.594128 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 21:08:46.610194 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 21:08:46.627908 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 21:08:46.643685 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 21:08:46.658922 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 21:08:46.674499 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 21:08:46.688805 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 21:08:46.705360 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 21:08:46.719574 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 21:08:46.888051 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 21:08:47.031396 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 21:08:47.173133 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 21:08:47.325764 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 21:08:47.602878 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:08:48.039293 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27599): Launched 21:08:48.445747 run iperf3-srv_10.42.42.10(pid=27622): Launched 21:08:48.613259 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 21:08:48.867293 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:08:49.258365 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27718): Launched 21:08:49.639272 run iperf3-srv_10.42.42.10(pid=27768): Launched 21:08:49.819758 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 21:08:50.073817 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:08:50.413976 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27798): Launched 21:08:50.704247 run iperf3-srv_10.42.42.10(pid=27799): Launched 21:08:50.843813 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 21:08:51.071332 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:08:51.408304 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27800): Launched 21:08:51.717741 run iperf3-srv_10.42.42.10(pid=27802): Launched 21:08:51.843717 tst iperf3m4.py:8: start network... 21:08:52.053564 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:08:52.542645 run create_hlr_db(pid=27804): Launched 21:08:52.709148 bus /gobi_6: Setting Powered False 21:08:53.777147 run create_hlr_db(pid=27804): Terminated: ok {rc=0} 21:08:54.247448 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27806): Launched 21:08:54.601921 run osmo-hlr_10.42.42.2(pid=27807): Launched 21:08:54.857545 run osmo-stp_10.42.42.5: Starting osmo-stp 21:08:55.552048 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27809): Launched 21:08:55.909164 run osmo-stp_10.42.42.5(pid=27810): Launched 21:08:56.163688 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:08:56.835123 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27812): Launched 21:08:56.977036 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:08:57.270602 run patchelf(pid=27813): Launched 21:08:57.477777 run osmo-stp_10.42.42.5(pid=27810): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27810)] 21:08:57.627484 run osmo-stp_10.42.42.5(pid=27810): stdout: | (launched: 2022-12-12_21:08:55.847217) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:08:57.780496 run osmo-stp_10.42.42.5(pid=27810): stderr: | 20221212210856143 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210856144 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210856144 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210856144 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210856149 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210856149 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210856149 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:08:57.930434 run osmo-stp_10.42.42.5(pid=27810): stdout: | (launched: 2022-12-12_21:08:55.847217) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:08:58.072548 run osmo-stp_10.42.42.5(pid=27810): stderr: | 20221212210856143 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210856144 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210856144 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210856144 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210856149 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210856149 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210856149 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:08:58.243350 run patchelf(pid=27813): Terminating (SIGINT) 21:08:58.439291 run patchelf(pid=27813): Terminated: ok {rc=0} 21:08:58.582262 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27810): Process ended prematurely: osmo-stp_10.42.42.5(pid=27810) [trial-2382↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27810)] [trial-2382↪gprs:trx-sysmocell5000↪iperf3m4.py:8] 21:08:58.594080 tst iperf3m4.py:8: Test FAILED (12.7 sec) 21:08:58.628094 run osmo-hlr_10.42.42.2(pid=27807): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-sysmocell5000↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27807)] 21:08:58.684863 run osmo-hlr_10.42.42.2(pid=27807): stdout: | (launched: 2022-12-12_21:08:54.539459) 21:08:58.742976 run osmo-hlr_10.42.42.2(pid=27807): stderr: | 20221212210854847 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212210854847 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212210854847 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212210854847 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212210854847 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212210854847 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212210854863 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-sysmocell5000/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212210854876 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212210854877 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212210854877 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:08:58.800254 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27599): Terminating (SIGTERM) 21:08:58.846479 run iperf3-srv_10.42.42.10(pid=27622): Terminating (SIGTERM) 21:08:58.895383 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27718): Terminating (SIGTERM) 21:08:58.942508 run iperf3-srv_10.42.42.10(pid=27768): Terminating (SIGTERM) 21:08:58.989688 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27798): Terminating (SIGTERM) 21:08:59.035837 run iperf3-srv_10.42.42.10(pid=27799): Terminating (SIGTERM) 21:08:59.084516 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27800): Terminating (SIGTERM) 21:08:59.132285 run iperf3-srv_10.42.42.10(pid=27802): Terminating (SIGTERM) 21:08:59.181833 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27806): Terminating (SIGTERM) 21:08:59.228290 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27809): Terminating (SIGTERM) 21:08:59.276043 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27812): Terminating (SIGTERM) 21:08:59.324274 --- ParallelTerminationStrategy: PID 27599 died... 21:08:59.347617 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27599): Terminated: ok {rc=0} 21:08:59.402795 --- ParallelTerminationStrategy: PID 27622 died... 21:08:59.423999 run iperf3-srv_10.42.42.10(pid=27622): Terminated {rc=256} 21:08:59.475410 --- ParallelTerminationStrategy: PID 27718 died... 21:08:59.496812 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27718): Terminated: ok {rc=0} 21:08:59.549550 --- ParallelTerminationStrategy: PID 27768 died... 21:08:59.571199 run iperf3-srv_10.42.42.10(pid=27768): Terminated {rc=256} 21:08:59.622701 --- ParallelTerminationStrategy: PID 27798 died... 21:08:59.644178 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27798): Terminated: ok {rc=0} 21:08:59.697915 --- ParallelTerminationStrategy: PID 27799 died... 21:08:59.719380 run iperf3-srv_10.42.42.10(pid=27799): Terminated {rc=256} 21:08:59.772429 --- ParallelTerminationStrategy: PID 27800 died... 21:08:59.794104 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27800): Terminated: ok {rc=0} 21:08:59.845269 --- ParallelTerminationStrategy: PID 27802 died... 21:08:59.869280 run iperf3-srv_10.42.42.10(pid=27802): Terminated {rc=256} 21:08:59.920380 --- ParallelTerminationStrategy: PID 27806 died... 21:08:59.942808 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27806): Terminated: ok {rc=0} 21:08:59.994309 --- ParallelTerminationStrategy: PID 27809 died... 21:09:00.015907 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27809): Terminated: ok {rc=0} 21:09:00.067000 --- ParallelTerminationStrategy: PID 27812 died... 21:09:00.089853 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27812): Terminated: ok {rc=0} 21:09:00.185595 bus /gobi_4: Setting Powered False 21:09:01.316371 bus /gobi_4: Setting Powered False 21:09:02.480626 bus /gobi_1: Setting Powered False 21:09:03.590224 bus /gobi_1: Setting Powered False 21:09:04.717413 bus /gobi_0: Setting Powered False 21:09:05.827229 bus /gobi_0: Setting Powered False 21:09:06.953870 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:trx-sysmocell5000 ping.py ---------------------------------------------- 21:09:08.066176 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 21:09:08.079541 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 21:09:08.135418 tst ping.py: using LAC 31517 21:09:08.268473 tst ping.py: using RAC 152 21:09:08.405888 tst ping.py: using CellId 31517 21:09:08.555175 tst ping.py: using BVCI 31518 21:09:08.685319 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 21:09:08.698018 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 21:09:08.710921 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 21:09:08.725069 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 21:09:08.739832 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 21:09:08.753078 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 21:09:08.765863 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 21:09:08.779388 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 21:09:08.907151 tst ping.py:19: start network... 21:09:09.140494 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:09:09.671301 run create_hlr_db(pid=27814): Launched 21:09:09.839764 bus /gobi_6: Setting Powered False 21:09:10.904752 run create_hlr_db(pid=27814): Terminated: ok {rc=0} 21:09:11.348463 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27817): Launched 21:09:11.657082 run osmo-hlr_10.42.42.2(pid=27818): Launched 21:09:11.774116 run osmo-stp_10.42.42.5: Starting osmo-stp 21:09:12.305712 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27820): Launched 21:09:12.614700 run osmo-stp_10.42.42.5(pid=27821): Launched 21:09:12.733442 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:09:13.264225 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27823): Launched 21:09:13.381278 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:09:13.641670 run patchelf(pid=27824): Launched 21:09:13.813634 run osmo-stp_10.42.42.5(pid=27821): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27821)] 21:09:13.944535 run osmo-stp_10.42.42.5(pid=27821): stdout: | (launched: 2022-12-12_21:09:12.556585) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:09:14.077260 run osmo-stp_10.42.42.5(pid=27821): stderr: | 20221212210912731 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210912731 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210912731 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210912732 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210912732 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210912732 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210912733 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:09:14.209958 run osmo-stp_10.42.42.5(pid=27821): stdout: | (launched: 2022-12-12_21:09:12.556585) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:09:14.336418 run osmo-stp_10.42.42.5(pid=27821): stderr: | 20221212210912731 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210912731 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210912731 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210912732 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210912732 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210912732 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210912733 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:09:14.486700 run patchelf(pid=27824): Terminating (SIGINT) 21:09:14.661647 run patchelf(pid=27824): Terminated: ok {rc=0} 21:09:14.787387 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=27821): Process ended prematurely: osmo-stp_10.42.42.5(pid=27821) [trial-2382↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27821)] [trial-2382↪gprs:trx-sysmocell5000↪ping.py:22] 21:09:14.796246 tst ping.py:22: Test FAILED (6.7 sec) 21:09:14.823574 run osmo-hlr_10.42.42.2(pid=27818): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-sysmocell5000↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27818)] 21:09:14.872607 run osmo-hlr_10.42.42.2(pid=27818): stdout: | (launched: 2022-12-12_21:09:11.599803) 21:09:14.923209 run osmo-hlr_10.42.42.2(pid=27818): stderr: | 20221212210911780 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212210911780 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212210911780 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212210911781 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212210911781 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212210911781 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212210911794 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-sysmocell5000/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212210911803 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212210911803 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212210911803 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:09:14.974384 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27817): Terminating (SIGTERM) 21:09:15.015125 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27820): Terminating (SIGTERM) 21:09:15.055822 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27823): Terminating (SIGTERM) 21:09:15.096704 --- ParallelTerminationStrategy: PID 27817 died... 21:09:15.116544 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27817): Terminated: ok {rc=0} 21:09:15.161987 --- ParallelTerminationStrategy: PID 27820 died... 21:09:15.181243 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27820): Terminated: ok {rc=0} 21:09:15.227074 --- ParallelTerminationStrategy: PID 27823 died... 21:09:15.246176 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27823): Terminated: ok {rc=0} 21:09:15.333732 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:trx-sysmocell5000 ping_idle_ping.py ---------------------------------------------- 21:09:16.424113 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 21:09:16.436716 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 21:09:16.489828 tst ping_idle_ping.py: using LAC 31518 21:09:16.624501 tst ping_idle_ping.py: using RAC 153 21:09:16.761671 tst ping_idle_ping.py: using CellId 31518 21:09:16.898266 tst ping_idle_ping.py: using BVCI 31519 21:09:17.023683 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 21:09:17.035940 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 21:09:17.048478 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 21:09:17.061803 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 21:09:17.073717 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 21:09:17.086621 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 21:09:17.099631 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 21:09:17.112483 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 21:09:17.238259 tst ping_idle_ping.py:24: start network... 21:09:17.463183 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:09:17.982172 run create_hlr_db(pid=27825): Launched 21:09:18.110730 bus /gobi_6: Setting Powered False 21:09:19.176844 run create_hlr_db(pid=27825): Terminated: ok {rc=0} 21:09:19.641924 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27827): Launched 21:09:19.977865 run osmo-hlr_10.42.42.2(pid=27828): Launched 21:09:20.106024 run osmo-stp_10.42.42.5: Starting osmo-stp 21:09:20.683465 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27830): Launched 21:09:21.018886 run osmo-stp_10.42.42.5(pid=27831): Launched 21:09:21.147182 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:09:21.722140 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27833): Launched 21:09:21.848940 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:09:22.130309 run patchelf(pid=27834): Launched 21:09:22.315331 run osmo-stp_10.42.42.5(pid=27831): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27831)] 21:09:22.456151 run osmo-stp_10.42.42.5(pid=27831): stdout: | (launched: 2022-12-12_21:09:20.957655) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:09:22.598617 run osmo-stp_10.42.42.5(pid=27831): stderr: | 20221212210921151 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210921151 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210921151 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210921152 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210921152 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210921152 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210921153 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:09:22.742269 run osmo-stp_10.42.42.5(pid=27831): stdout: | (launched: 2022-12-12_21:09:20.957655) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:09:22.878132 run osmo-stp_10.42.42.5(pid=27831): stderr: | 20221212210921151 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210921151 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210921151 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210921152 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210921152 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210921152 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210921153 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:09:23.039037 run patchelf(pid=27834): Terminating (SIGINT) 21:09:23.225471 run patchelf(pid=27834): Terminated: ok {rc=0} 21:09:23.359612 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=27831): Process ended prematurely: osmo-stp_10.42.42.5(pid=27831) [trial-2382↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27831)] [trial-2382↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27] 21:09:23.369356 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 21:09:23.398229 run osmo-hlr_10.42.42.2(pid=27828): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-sysmocell5000↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27828)] 21:09:23.450607 run osmo-hlr_10.42.42.2(pid=27828): stdout: | (launched: 2022-12-12_21:09:19.916376) 21:09:23.504509 run osmo-hlr_10.42.42.2(pid=27828): stderr: | 20221212210920115 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212210920115 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212210920115 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212210920115 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212210920115 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212210920115 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212210920127 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-sysmocell5000/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212210920137 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212210920137 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212210920137 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:09:23.558551 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27827): Terminating (SIGTERM) 21:09:23.601631 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27830): Terminating (SIGTERM) 21:09:23.644870 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27833): Terminating (SIGTERM) 21:09:23.688880 --- ParallelTerminationStrategy: PID 27827 died... 21:09:23.709683 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27827): Terminated: ok {rc=0} 21:09:23.757805 --- ParallelTerminationStrategy: PID 27830 died... 21:09:23.777836 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27830): Terminated: ok {rc=0} 21:09:23.825860 --- ParallelTerminationStrategy: PID 27833 died... 21:09:23.846136 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27833): Terminated: ok {rc=0} 21:09:23.937896 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2382 gprs:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 gprs:trx-sysmocell5000+mod-bts0-egprs --------------------------------------------------------------------- 21:09:25.259147 tst gprs:trx-sysmocell5000+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:09:25.265547 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 21:09:25.301949 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 21:09:25.341744 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 21:09:25.431598 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 21:09:25.466863 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 21:09:25.505334 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 21:09:26.098668 tst gprs:trx-sysmocell5000+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2382 gprs:trx-sysmocell5000+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 21:09:26.148918 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:26.160013 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:09:26.211259 tst cs_paging_gprs_active.py: using LAC 31519 21:09:26.334629 tst cs_paging_gprs_active.py: using RAC 154 21:09:26.461606 tst cs_paging_gprs_active.py: using CellId 31519 21:09:26.587043 tst cs_paging_gprs_active.py: using BVCI 31520 21:09:26.703236 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:26.714578 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:26.725565 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:26.736414 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:26.747276 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:26.758136 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:26.769023 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:26.779833 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:26.790774 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:09:26.912239 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:09:27.033954 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 21:09:27.246676 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:09:27.563765 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27838): Launched 21:09:27.837472 run iperf3-srv_10.42.42.10(pid=27839): Launched 21:09:27.956426 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 21:09:28.169807 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:09:28.489456 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27840): Launched 21:09:28.764885 run iperf3-srv_10.42.42.10(pid=27841): Launched 21:09:28.882703 tst cs_paging_gprs_active.py:38: start network... 21:09:29.094227 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:09:29.584893 run create_hlr_db(pid=27842): Launched 21:09:29.713450 bus /gobi_6: Setting Powered False 21:09:30.777361 run create_hlr_db(pid=27842): Terminated: ok {rc=0} 21:09:31.290903 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27844): Launched 21:09:31.649839 run osmo-hlr_10.42.42.2(pid=27845): Launched 21:09:31.836212 run osmo-stp_10.42.42.5: Starting osmo-stp 21:09:32.488489 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27847): Launched 21:09:32.829603 run osmo-stp_10.42.42.5(pid=27848): Launched 21:09:32.960345 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:09:33.547623 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27850): Launched 21:09:33.678004 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:09:33.965942 run patchelf(pid=27851): Launched 21:09:34.154070 run osmo-stp_10.42.42.5(pid=27848): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27848)] 21:09:34.297179 run osmo-stp_10.42.42.5(pid=27848): stdout: | (launched: 2022-12-12_21:09:32.767388) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:09:34.444177 run osmo-stp_10.42.42.5(pid=27848): stderr: | 20221212210932964 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210932964 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210932964 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210932965 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210932965 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210932965 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210932965 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:09:34.588935 run osmo-stp_10.42.42.5(pid=27848): stdout: | (launched: 2022-12-12_21:09:32.767388) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:09:34.728317 run osmo-stp_10.42.42.5(pid=27848): stderr: | 20221212210932964 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210932964 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210932964 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210932965 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210932965 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210932965 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210932965 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:09:34.893204 run patchelf(pid=27851): Terminating (SIGINT) 21:09:35.083138 run patchelf(pid=27851): Terminated: ok {rc=0} 21:09:35.220465 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=27848): Process ended prematurely: osmo-stp_10.42.42.5(pid=27848) [trial-2382↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27848)] [trial-2382↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 21:09:35.230935 tst cs_paging_gprs_active.py:38: Test FAILED (9.1 sec) 21:09:35.260813 run osmo-hlr_10.42.42.2(pid=27845): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27845)] 21:09:35.312826 run osmo-hlr_10.42.42.2(pid=27845): stdout: | (launched: 2022-12-12_21:09:31.587058) 21:09:35.366639 run osmo-hlr_10.42.42.2(pid=27845): stderr: | 20221212210931899 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212210931899 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212210931899 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212210931899 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212210931900 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212210931900 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212210931921 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-sysmocell5000+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212210931946 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212210931947 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212210931947 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:09:35.420774 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27838): Terminating (SIGTERM) 21:09:35.464527 run iperf3-srv_10.42.42.10(pid=27839): Terminating (SIGTERM) 21:09:35.508290 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27840): Terminating (SIGTERM) 21:09:35.551893 run iperf3-srv_10.42.42.10(pid=27841): Terminating (SIGTERM) 21:09:35.595079 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27844): Terminating (SIGTERM) 21:09:35.638328 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27847): Terminating (SIGTERM) 21:09:35.682204 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27850): Terminating (SIGTERM) 21:09:35.725658 --- ParallelTerminationStrategy: PID 27838 died... 21:09:35.746176 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27838): Terminated: ok {rc=0} 21:09:35.794400 --- ParallelTerminationStrategy: PID 27839 died... 21:09:35.814371 run iperf3-srv_10.42.42.10(pid=27839): Terminated {rc=256} 21:09:35.862411 --- ParallelTerminationStrategy: PID 27840 died... 21:09:35.882493 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27840): Terminated: ok {rc=0} 21:09:35.930469 --- ParallelTerminationStrategy: PID 27841 died... 21:09:35.951002 run iperf3-srv_10.42.42.10(pid=27841): Terminated {rc=256} 21:09:35.998946 --- ParallelTerminationStrategy: PID 27844 died... 21:09:36.019127 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27844): Terminated: ok {rc=0} 21:09:36.067088 --- ParallelTerminationStrategy: PID 27847 died... 21:09:36.087197 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27847): Terminated: ok {rc=0} 21:09:36.135173 --- ParallelTerminationStrategy: PID 27850 died... 21:09:36.155225 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27850): Terminated: ok {rc=0} 21:09:36.246621 bus /gobi_0: Setting Powered False 21:09:37.348803 bus /gobi_0: Setting Powered False 21:09:38.468185 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3.py ---------------------------------------------- 21:09:39.619621 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:39.631297 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:09:39.686356 tst iperf3.py: using LAC 31520 21:09:39.812737 tst iperf3.py: using RAC 155 21:09:39.936640 tst iperf3.py: using CellId 31520 21:09:40.061714 tst iperf3.py: using BVCI 31521 21:09:40.176920 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:40.188044 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:40.198916 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:40.209728 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:40.220465 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:40.231325 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:40.242267 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:40.252930 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:40.263908 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:09:40.384545 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 21:09:40.612058 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:09:40.950707 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27857): Launched 21:09:41.243172 run iperf3-srv_10.42.42.10(pid=27858): Launched 21:09:41.369487 tst iperf3.py:8: start network... 21:09:41.596634 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:09:42.119868 run create_hlr_db(pid=27859): Launched 21:09:42.248539 bus /gobi_6: Setting Powered False 21:09:43.314847 run create_hlr_db(pid=27859): Terminated: ok {rc=0} 21:09:43.762259 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27861): Launched 21:09:44.077329 run osmo-hlr_10.42.42.2(pid=27862): Launched 21:09:44.197068 run osmo-stp_10.42.42.5: Starting osmo-stp 21:09:44.739231 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27864): Launched 21:09:45.055404 run osmo-stp_10.42.42.5(pid=27865): Launched 21:09:45.174718 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:09:45.716610 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27867): Launched 21:09:45.852101 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:09:46.181413 run patchelf(pid=27868): Launched 21:09:46.388668 run osmo-stp_10.42.42.5(pid=27865): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27865)] 21:09:46.536481 run osmo-stp_10.42.42.5(pid=27865): stdout: | (launched: 2022-12-12_21:09:44.996770) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:09:46.686407 run osmo-stp_10.42.42.5(pid=27865): stderr: | 20221212210945170 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210945170 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210945171 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210945171 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210945172 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210945172 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210945172 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:09:46.837426 run osmo-stp_10.42.42.5(pid=27865): stdout: | (launched: 2022-12-12_21:09:44.996770) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:09:46.981346 run osmo-stp_10.42.42.5(pid=27865): stderr: | 20221212210945170 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210945170 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210945171 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210945171 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210945172 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210945172 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210945172 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:09:47.150404 run patchelf(pid=27868): Terminating (SIGINT) 21:09:47.341999 run patchelf(pid=27868): Terminated: ok {rc=0} 21:09:47.478859 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27865): Process ended prematurely: osmo-stp_10.42.42.5(pid=27865) [trial-2382↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27865)] [trial-2382↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8] 21:09:47.490670 tst iperf3.py:8: Test FAILED (7.9 sec) 21:09:47.521942 run osmo-hlr_10.42.42.2(pid=27862): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27862)] 21:09:47.574503 run osmo-hlr_10.42.42.2(pid=27862): stdout: | (launched: 2022-12-12_21:09:44.019379) 21:09:47.628898 run osmo-hlr_10.42.42.2(pid=27862): stderr: | 20221212210944198 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212210944198 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212210944198 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212210944198 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212210944198 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212210944198 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212210944210 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212210944218 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212210944219 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212210944219 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:09:47.684126 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27857): Terminating (SIGTERM) 21:09:47.728392 run iperf3-srv_10.42.42.10(pid=27858): Terminating (SIGTERM) 21:09:47.773022 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27861): Terminating (SIGTERM) 21:09:47.817206 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27864): Terminating (SIGTERM) 21:09:47.861327 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27867): Terminating (SIGTERM) 21:09:47.905672 --- ParallelTerminationStrategy: PID 27857 died... 21:09:47.926411 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27857): Terminated: ok {rc=0} 21:09:47.975495 --- ParallelTerminationStrategy: PID 27858 died... 21:09:47.995645 run iperf3-srv_10.42.42.10(pid=27858): Terminated {rc=256} 21:09:48.044489 --- ParallelTerminationStrategy: PID 27861 died... 21:09:48.064782 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27861): Terminated: ok {rc=0} 21:09:48.113919 --- ParallelTerminationStrategy: PID 27864 died... 21:09:48.134345 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27864): Terminated: ok {rc=0} 21:09:48.183520 --- ParallelTerminationStrategy: PID 27867 died... 21:09:48.203843 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27867): Terminated: ok {rc=0} 21:09:48.295737 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 21:09:49.449987 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:49.462522 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:09:49.516377 tst iperf3m4.py: using LAC 31521 21:09:49.650318 tst iperf3m4.py: using RAC 156 21:09:49.782791 tst iperf3m4.py: using CellId 31521 21:09:49.914207 tst iperf3m4.py: using BVCI 31522 21:09:50.038695 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:50.050638 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:50.062228 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:50.074254 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:50.086149 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:50.098048 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:50.110065 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:50.121908 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:50.133892 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:09:50.254496 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:09:50.380471 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:09:50.503723 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:09:50.623228 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 21:09:50.835880 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:09:51.153500 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27869): Launched 21:09:51.429139 run iperf3-srv_10.42.42.10(pid=27870): Launched 21:09:51.547204 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 21:09:51.758643 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:09:52.075577 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27871): Launched 21:09:52.351071 run iperf3-srv_10.42.42.10(pid=27872): Launched 21:09:52.470822 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 21:09:52.682582 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:09:53.000337 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27873): Launched 21:09:53.274517 run iperf3-srv_10.42.42.10(pid=27874): Launched 21:09:53.392680 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 21:09:53.604322 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:09:53.920388 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27875): Launched 21:09:54.194750 run iperf3-srv_10.42.42.10(pid=27876): Launched 21:09:54.312784 tst iperf3m4.py:8: start network... 21:09:54.524803 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:09:55.014341 run create_hlr_db(pid=27877): Launched 21:09:55.144156 bus /gobi_6: Setting Powered False 21:09:56.207233 run create_hlr_db(pid=27877): Terminated: ok {rc=0} 21:09:56.666565 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27879): Launched 21:09:57.005453 run osmo-hlr_10.42.42.2(pid=27880): Launched 21:09:57.135602 run osmo-stp_10.42.42.5: Starting osmo-stp 21:09:57.722741 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27882): Launched 21:09:58.061044 run osmo-stp_10.42.42.5(pid=27883): Launched 21:09:58.192043 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:09:58.775491 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27885): Launched 21:09:58.903601 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:09:59.189641 run patchelf(pid=27886): Launched 21:09:59.378757 run osmo-stp_10.42.42.5(pid=27883): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27883)] 21:09:59.521466 run osmo-stp_10.42.42.5(pid=27883): stdout: | (launched: 2022-12-12_21:09:57.998889) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:09:59.665711 run osmo-stp_10.42.42.5(pid=27883): stderr: | 20221212210958194 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210958194 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210958195 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210958195 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210958196 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210958196 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210958196 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:09:59.810282 run osmo-stp_10.42.42.5(pid=27883): stdout: | (launched: 2022-12-12_21:09:57.998889) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:09:59.948847 run osmo-stp_10.42.42.5(pid=27883): stderr: | 20221212210958194 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212210958194 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212210958195 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212210958195 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212210958196 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212210958196 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212210958196 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:10:00.113472 run patchelf(pid=27886): Terminating (SIGINT) 21:10:00.304332 run patchelf(pid=27886): Terminated: ok {rc=0} 21:10:00.441959 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27883): Process ended prematurely: osmo-stp_10.42.42.5(pid=27883) [trial-2382↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27883)] [trial-2382↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8] 21:10:00.452266 tst iperf3m4.py:8: Test FAILED (11.0 sec) 21:10:00.482616 run osmo-hlr_10.42.42.2(pid=27880): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27880)] 21:10:00.534706 run osmo-hlr_10.42.42.2(pid=27880): stdout: | (launched: 2022-12-12_21:09:56.943287) 21:10:00.588763 run osmo-hlr_10.42.42.2(pid=27880): stderr: | 20221212210957145 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212210957145 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212210957145 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212210957145 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212210957145 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212210957145 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212210957161 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212210957170 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212210957171 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212210957171 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:10:00.643404 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27869): Terminating (SIGTERM) 21:10:00.687217 run iperf3-srv_10.42.42.10(pid=27870): Terminating (SIGTERM) 21:10:00.731700 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27871): Terminating (SIGTERM) 21:10:00.776132 run iperf3-srv_10.42.42.10(pid=27872): Terminating (SIGTERM) 21:10:00.817383 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27873): Terminating (SIGTERM) 21:10:00.879202 run iperf3-srv_10.42.42.10(pid=27874): Terminating (SIGTERM) 21:10:00.945250 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27875): Terminating (SIGTERM) 21:10:00.991555 run iperf3-srv_10.42.42.10(pid=27876): Terminating (SIGTERM) 21:10:01.039910 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27879): Terminating (SIGTERM) 21:10:01.085634 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27882): Terminating (SIGTERM) 21:10:01.131176 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27885): Terminating (SIGTERM) 21:10:01.177052 --- ParallelTerminationStrategy: PID 27869 died... 21:10:01.198185 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27869): Terminated: ok {rc=0} 21:10:01.249445 --- ParallelTerminationStrategy: PID 27870 died... 21:10:01.270614 run iperf3-srv_10.42.42.10(pid=27870): Terminated {rc=256} 21:10:01.321217 --- ParallelTerminationStrategy: PID 27871 died... 21:10:01.342389 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27871): Terminated: ok {rc=0} 21:10:01.393829 --- ParallelTerminationStrategy: PID 27872 died... 21:10:01.414913 run iperf3-srv_10.42.42.10(pid=27872): Terminated {rc=256} 21:10:01.473395 --- ParallelTerminationStrategy: PID 27873 died... 21:10:01.498001 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27873): Terminated: ok {rc=0} 21:10:01.549188 --- ParallelTerminationStrategy: PID 27874 died... 21:10:01.570373 run iperf3-srv_10.42.42.10(pid=27874): Terminated {rc=256} 21:10:01.621629 --- ParallelTerminationStrategy: PID 27875 died... 21:10:01.642805 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27875): Terminated: ok {rc=0} 21:10:01.694893 --- ParallelTerminationStrategy: PID 27876 died... 21:10:01.717355 run iperf3-srv_10.42.42.10(pid=27876): Terminated {rc=256} 21:10:01.773163 --- ParallelTerminationStrategy: PID 27879 died... 21:10:01.798730 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27879): Terminated: ok {rc=0} 21:10:01.861394 --- ParallelTerminationStrategy: PID 27882 died... 21:10:01.891085 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27882): Terminated: ok {rc=0} 21:10:01.943611 --- ParallelTerminationStrategy: PID 27885 died... 21:10:01.966766 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27885): Terminated: ok {rc=0} 21:10:02.074976 bus /gobi_4: Setting Powered False 21:10:03.190535 bus /gobi_4: Setting Powered False 21:10:04.308594 bus /gobi_1: Setting Powered False 21:10:05.409963 bus /gobi_1: Setting Powered False 21:10:06.526471 bus /gobi_0: Setting Powered False 21:10:07.629108 bus /gobi_0: Setting Powered False 21:10:08.747069 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:trx-sysmocell5000+mod-bts0-egprs ping.py ---------------------------------------------- 21:10:09.850980 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:10:09.863473 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:10:09.917392 tst ping.py: using LAC 31522 21:10:10.039849 tst ping.py: using RAC 157 21:10:10.162536 tst ping.py: using CellId 31522 21:10:10.285269 tst ping.py: using BVCI 31523 21:10:10.396910 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:10:10.408524 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:10:10.419606 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:10:10.430655 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:10:10.441670 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:10:10.452566 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:10:10.463750 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:10:10.474850 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:10:10.590764 tst ping.py:19: start network... 21:10:10.796572 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:10:11.274082 run create_hlr_db(pid=27897): Launched 21:10:11.401582 bus /gobi_6: Setting Powered False 21:10:12.462934 run create_hlr_db(pid=27897): Terminated: ok {rc=0} 21:10:12.907397 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27939): Launched 21:10:13.257799 run osmo-hlr_10.42.42.2(pid=28000): Launched 21:10:13.396426 run osmo-stp_10.42.42.5: Starting osmo-stp 21:10:14.032308 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28107): Launched 21:10:14.353645 run osmo-stp_10.42.42.5(pid=28177): Launched 21:10:14.548749 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:10:15.215454 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28256): Launched 21:10:15.343618 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:10:15.624390 run patchelf(pid=28257): Launched 21:10:15.809868 run osmo-stp_10.42.42.5(pid=28177): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28177)] 21:10:15.972107 run osmo-stp_10.42.42.5(pid=28177): stdout: | (launched: 2022-12-12_21:10:14.294845) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:10:16.117313 run osmo-stp_10.42.42.5(pid=28177): stderr: | 20221212211014582 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211014583 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211014583 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211014583 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211014584 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211014584 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211014584 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:10:16.263067 run osmo-stp_10.42.42.5(pid=28177): stdout: | (launched: 2022-12-12_21:10:14.294845) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:10:16.403079 run osmo-stp_10.42.42.5(pid=28177): stderr: | 20221212211014582 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211014583 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211014583 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211014583 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211014584 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211014584 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211014584 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:10:16.568186 run patchelf(pid=28257): Terminating (SIGINT) 21:10:16.759599 run patchelf(pid=28257): Terminated: ok {rc=0} 21:10:16.926049 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=28177): Process ended prematurely: osmo-stp_10.42.42.5(pid=28177) [trial-2382↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28177)] [trial-2382↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22] 21:10:16.940807 tst ping.py:22: Test FAILED (7.1 sec) 21:10:16.976365 run osmo-hlr_10.42.42.2(pid=28000): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28000)] 21:10:17.039313 run osmo-hlr_10.42.42.2(pid=28000): stdout: | (launched: 2022-12-12_21:10:13.193675) 21:10:17.103043 run osmo-hlr_10.42.42.2(pid=28000): stderr: | 20221212211013506 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212211013506 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212211013506 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212211013506 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212211013506 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212211013506 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212211013523 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-sysmocell5000+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212211013538 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212211013538 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212211013538 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:10:17.157655 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27939): Terminating (SIGTERM) 21:10:17.200298 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28107): Terminating (SIGTERM) 21:10:17.242948 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28256): Terminating (SIGTERM) 21:10:17.284533 --- ParallelTerminationStrategy: PID 27939 died... 21:10:17.304306 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27939): Terminated: ok {rc=0} 21:10:17.349901 --- ParallelTerminationStrategy: PID 28107 died... 21:10:17.369255 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28107): Terminated: ok {rc=0} 21:10:17.414574 --- ParallelTerminationStrategy: PID 28256 died... 21:10:17.433823 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28256): Terminated: ok {rc=0} 21:10:17.521700 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:trx-sysmocell5000+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 21:10:18.613474 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:10:18.625913 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:10:18.677837 tst ping_idle_ping.py: using LAC 31523 21:10:18.801502 tst ping_idle_ping.py: using RAC 158 21:10:18.921665 tst ping_idle_ping.py: using CellId 31523 21:10:19.042434 tst ping_idle_ping.py: using BVCI 31524 21:10:19.156468 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:10:19.167758 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:10:19.178821 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:10:19.189755 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:10:19.200401 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:10:19.211198 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:10:19.222302 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:10:19.233179 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:10:19.350159 tst ping_idle_ping.py:24: start network... 21:10:19.556903 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:10:20.041494 run create_hlr_db(pid=28258): Launched 21:10:20.169250 bus /gobi_6: Setting Powered False 21:10:21.231528 run create_hlr_db(pid=28258): Terminated: ok {rc=0} 21:10:21.685430 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28260): Launched 21:10:21.995402 run osmo-hlr_10.42.42.2(pid=28261): Launched 21:10:22.116798 run osmo-stp_10.42.42.5: Starting osmo-stp 21:10:22.647951 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28263): Launched 21:10:22.957690 run osmo-stp_10.42.42.5(pid=28268): Launched 21:10:23.135158 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:10:23.791120 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28374): Launched 21:10:23.926584 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:10:24.205651 run patchelf(pid=28443): Launched 21:10:24.401576 run osmo-stp_10.42.42.5(pid=28268): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28268)] 21:10:24.546022 run osmo-stp_10.42.42.5(pid=28268): stdout: | (launched: 2022-12-12_21:10:22.900027) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:10:24.692328 run osmo-stp_10.42.42.5(pid=28268): stderr: | 20221212211023189 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211023189 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211023190 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211023190 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211023191 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211023191 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211023191 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:10:24.840707 run osmo-stp_10.42.42.5(pid=28268): stdout: | (launched: 2022-12-12_21:10:22.900027) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:10:24.980128 run osmo-stp_10.42.42.5(pid=28268): stderr: | 20221212211023189 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211023189 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211023190 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211023190 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211023191 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211023191 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211023191 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:10:25.145130 run patchelf(pid=28443): Terminating (SIGINT) 21:10:25.334852 run patchelf(pid=28443): Terminated: ok {rc=0} 21:10:25.473040 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=28268): Process ended prematurely: osmo-stp_10.42.42.5(pid=28268) [trial-2382↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28268)] [trial-2382↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27] 21:10:25.483822 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 21:10:25.516137 run osmo-hlr_10.42.42.2(pid=28261): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28261)] 21:10:25.571646 run osmo-hlr_10.42.42.2(pid=28261): stdout: | (launched: 2022-12-12_21:10:21.938223) 21:10:25.627970 run osmo-hlr_10.42.42.2(pid=28261): stderr: | 20221212211022117 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212211022117 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212211022117 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212211022117 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212211022117 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212211022117 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212211022130 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-sysmocell5000+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212211022139 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212211022139 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212211022139 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:10:25.684733 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28260): Terminating (SIGTERM) 21:10:25.733039 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28263): Terminating (SIGTERM) 21:10:25.782529 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28374): Terminating (SIGTERM) 21:10:25.829914 --- ParallelTerminationStrategy: PID 28260 died... 21:10:25.851466 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28260): Terminated: ok {rc=0} 21:10:25.904003 --- ParallelTerminationStrategy: PID 28263 died... 21:10:25.925584 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28263): Terminated: ok {rc=0} 21:10:25.977106 --- ParallelTerminationStrategy: PID 28374 died... 21:10:25.998194 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28374): Terminated: ok {rc=0} 21:10:26.092136 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2382 gprs:trx-sysmocell5000+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa --------------------------------------------------------------------- 21:10:27.418270 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:10:27.426320 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 21:10:27.466430 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 21:10:27.510068 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 21:10:27.601553 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 21:10:27.638499 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 21:10:27.681218 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 21:10:28.278935 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2382 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 21:10:28.339845 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:28.352697 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 21:10:28.431990 tst cs_paging_gprs_active.py: using LAC 31524 21:10:28.574262 tst cs_paging_gprs_active.py: using RAC 159 21:10:28.712660 tst cs_paging_gprs_active.py: using CellId 31524 21:10:28.850718 tst cs_paging_gprs_active.py: using BVCI 31525 21:10:28.983498 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:28.996412 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:29.008878 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:29.022080 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:29.036681 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:29.050482 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:29.064246 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:29.076567 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:29.090440 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:10:29.213456 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:10:29.333071 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 21:10:29.544710 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:10:29.859614 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28448): Launched 21:10:30.133431 run iperf3-srv_10.42.42.10(pid=28449): Launched 21:10:30.251404 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 21:10:30.464180 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:10:30.782708 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28450): Launched 21:10:31.097514 run iperf3-srv_10.42.42.10(pid=28451): Launched 21:10:31.232245 tst cs_paging_gprs_active.py:38: start network... 21:10:31.449896 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:10:31.947703 run create_hlr_db(pid=28452): Launched 21:10:32.121431 bus /gobi_6: Setting Powered False 21:10:33.188002 run create_hlr_db(pid=28452): Terminated: ok {rc=0} 21:10:33.658370 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28454): Launched 21:10:33.997633 run osmo-hlr_10.42.42.2(pid=28455): Launched 21:10:34.127348 run osmo-stp_10.42.42.5: Starting osmo-stp 21:10:34.713670 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28457): Launched 21:10:35.051745 run osmo-stp_10.42.42.5(pid=28458): Launched 21:10:35.182978 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:10:35.768057 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28460): Launched 21:10:35.898021 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:10:36.184485 run patchelf(pid=28461): Launched 21:10:36.372602 run osmo-stp_10.42.42.5(pid=28458): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28458)] 21:10:36.515885 run osmo-stp_10.42.42.5(pid=28458): stdout: | (launched: 2022-12-12_21:10:34.990174) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:10:36.660757 run osmo-stp_10.42.42.5(pid=28458): stderr: | 20221212211035184 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211035184 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211035185 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211035185 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211035187 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211035188 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211035188 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:10:36.805885 run osmo-stp_10.42.42.5(pid=28458): stdout: | (launched: 2022-12-12_21:10:34.990174) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:10:36.944266 run osmo-stp_10.42.42.5(pid=28458): stderr: | 20221212211035184 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211035184 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211035185 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211035185 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211035187 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211035188 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211035188 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:10:37.108733 run patchelf(pid=28461): Terminating (SIGINT) 21:10:37.298510 run patchelf(pid=28461): Terminated: ok {rc=0} 21:10:37.435293 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=28458): Process ended prematurely: osmo-stp_10.42.42.5(pid=28458) [trial-2382↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28458)] [trial-2382↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 21:10:37.445788 tst cs_paging_gprs_active.py:38: Test FAILED (9.2 sec) 21:10:37.475827 run osmo-hlr_10.42.42.2(pid=28455): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28455)] 21:10:37.528190 run osmo-hlr_10.42.42.2(pid=28455): stdout: | (launched: 2022-12-12_21:10:33.935733) 21:10:37.581938 run osmo-hlr_10.42.42.2(pid=28455): stderr: | 20221212211034136 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212211034136 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212211034136 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212211034136 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212211034136 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212211034136 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212211034148 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212211034157 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212211034157 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212211034157 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:10:37.636145 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28448): Terminating (SIGTERM) 21:10:37.679583 run iperf3-srv_10.42.42.10(pid=28449): Terminating (SIGTERM) 21:10:37.723133 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28450): Terminating (SIGTERM) 21:10:37.767057 run iperf3-srv_10.42.42.10(pid=28451): Terminating (SIGTERM) 21:10:37.810535 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28454): Terminating (SIGTERM) 21:10:37.853788 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28457): Terminating (SIGTERM) 21:10:37.897153 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28460): Terminating (SIGTERM) 21:10:37.940333 --- ParallelTerminationStrategy: PID 28448 died... 21:10:37.960912 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28448): Terminated: ok {rc=0} 21:10:38.008861 --- ParallelTerminationStrategy: PID 28449 died... 21:10:38.029318 run iperf3-srv_10.42.42.10(pid=28449): Terminated {rc=256} 21:10:38.077349 --- ParallelTerminationStrategy: PID 28450 died... 21:10:38.097373 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28450): Terminated: ok {rc=0} 21:10:38.145284 --- ParallelTerminationStrategy: PID 28451 died... 21:10:38.165416 run iperf3-srv_10.42.42.10(pid=28451): Terminated {rc=256} 21:10:38.213405 --- ParallelTerminationStrategy: PID 28454 died... 21:10:38.233513 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28454): Terminated: ok {rc=0} 21:10:38.281486 --- ParallelTerminationStrategy: PID 28457 died... 21:10:38.301702 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28457): Terminated: ok {rc=0} 21:10:38.349449 --- ParallelTerminationStrategy: PID 28460 died... 21:10:38.369588 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28460): Terminated: ok {rc=0} 21:10:38.460321 bus /gobi_0: Setting Powered False 21:10:39.562915 bus /gobi_0: Setting Powered False 21:10:40.682361 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 21:10:41.839474 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:41.852176 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 21:10:41.950156 tst iperf3.py: using LAC 31525 21:10:42.082001 tst iperf3.py: using RAC 160 21:10:42.214778 tst iperf3.py: using CellId 31525 21:10:42.348294 tst iperf3.py: using BVCI 31526 21:10:42.471386 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:42.483168 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:42.494764 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:42.506568 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:42.518451 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:42.530932 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:42.543138 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:42.554963 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:42.567074 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:10:42.691087 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 21:10:42.919450 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:10:43.257652 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28462): Launched 21:10:43.553949 run iperf3-srv_10.42.42.10(pid=28463): Launched 21:10:43.682721 tst iperf3.py:8: start network... 21:10:43.911616 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:10:44.437645 run create_hlr_db(pid=28464): Launched 21:10:44.566815 bus /gobi_6: Setting Powered False 21:10:45.633237 run create_hlr_db(pid=28464): Terminated: ok {rc=0} 21:10:46.097705 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28466): Launched 21:10:46.449512 run osmo-hlr_10.42.42.2(pid=28467): Launched 21:10:46.707344 run osmo-stp_10.42.42.5: Starting osmo-stp 21:10:47.378388 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28469): Launched 21:10:47.717308 run osmo-stp_10.42.42.5(pid=28470): Launched 21:10:47.846266 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:10:48.427672 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28472): Launched 21:10:48.558395 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:10:48.845870 run patchelf(pid=28473): Launched 21:10:49.032394 run osmo-stp_10.42.42.5(pid=28470): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28470)] 21:10:49.174969 run osmo-stp_10.42.42.5(pid=28470): stdout: | (launched: 2022-12-12_21:10:47.654962) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:10:49.318828 run osmo-stp_10.42.42.5(pid=28470): stderr: | 20221212211047852 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211047852 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211047852 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211047853 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211047853 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211047853 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211047853 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:10:49.463200 run osmo-stp_10.42.42.5(pid=28470): stdout: | (launched: 2022-12-12_21:10:47.654962) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:10:49.601472 run osmo-stp_10.42.42.5(pid=28470): stderr: | 20221212211047852 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211047852 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211047852 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211047853 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211047853 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211047853 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211047853 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:10:49.765982 run patchelf(pid=28473): Terminating (SIGINT) 21:10:49.955185 run patchelf(pid=28473): Terminated: ok {rc=0} 21:10:50.091984 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28470): Process ended prematurely: osmo-stp_10.42.42.5(pid=28470) [trial-2382↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28470)] [trial-2382↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8] 21:10:50.102510 tst iperf3.py:8: Test FAILED (8.3 sec) 21:10:50.132340 run osmo-hlr_10.42.42.2(pid=28467): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28467)] 21:10:50.184189 run osmo-hlr_10.42.42.2(pid=28467): stdout: | (launched: 2022-12-12_21:10:46.387249) 21:10:50.237677 run osmo-hlr_10.42.42.2(pid=28467): stderr: | 20221212211046696 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212211046696 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212211046696 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212211046697 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212211046697 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212211046697 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212211046715 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212211046727 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212211046727 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212211046728 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:10:50.292082 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28462): Terminating (SIGTERM) 21:10:50.335403 run iperf3-srv_10.42.42.10(pid=28463): Terminating (SIGTERM) 21:10:50.378479 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28466): Terminating (SIGTERM) 21:10:50.421677 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28469): Terminating (SIGTERM) 21:10:50.464682 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28472): Terminating (SIGTERM) 21:10:50.508064 --- ParallelTerminationStrategy: PID 28462 died... 21:10:50.528471 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28462): Terminated: ok {rc=0} 21:10:50.576783 --- ParallelTerminationStrategy: PID 28463 died... 21:10:50.596699 run iperf3-srv_10.42.42.10(pid=28463): Terminated {rc=256} 21:10:50.644371 --- ParallelTerminationStrategy: PID 28466 died... 21:10:50.664393 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28466): Terminated: ok {rc=0} 21:10:50.712712 --- ParallelTerminationStrategy: PID 28469 died... 21:10:50.732852 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28469): Terminated: ok {rc=0} 21:10:50.780681 --- ParallelTerminationStrategy: PID 28472 died... 21:10:50.800770 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28472): Terminated: ok {rc=0} 21:10:50.890400 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 21:10:52.044151 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:52.056782 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 21:10:52.134195 tst iperf3m4.py: using LAC 31526 21:10:52.265330 tst iperf3m4.py: using RAC 161 21:10:52.395231 tst iperf3m4.py: using CellId 31526 21:10:52.525054 tst iperf3m4.py: using BVCI 31527 21:10:52.640623 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:52.652196 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:52.663492 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:52.675333 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:52.687026 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:52.698834 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:52.710850 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:52.724398 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:52.736352 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:10:52.859330 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:10:52.979927 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:10:53.102777 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:10:53.227311 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 21:10:53.455456 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:10:53.794502 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28474): Launched 21:10:54.088257 run iperf3-srv_10.42.42.10(pid=28475): Launched 21:10:54.216419 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 21:10:54.444882 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:10:54.785213 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28476): Launched 21:10:55.079743 run iperf3-srv_10.42.42.10(pid=28477): Launched 21:10:55.208105 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 21:10:55.437063 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:10:55.777726 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28478): Launched 21:10:56.073413 run iperf3-srv_10.42.42.10(pid=28479): Launched 21:10:56.202257 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 21:10:56.431811 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:10:56.773840 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28480): Launched 21:10:57.070164 run iperf3-srv_10.42.42.10(pid=28481): Launched 21:10:57.196535 tst iperf3m4.py:8: start network... 21:10:57.425294 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:10:57.950464 run create_hlr_db(pid=28482): Launched 21:10:58.080158 bus /gobi_6: Setting Powered False 21:10:59.147194 run create_hlr_db(pid=28482): Terminated: ok {rc=0} 21:10:59.616859 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28484): Launched 21:10:59.955856 run osmo-hlr_10.42.42.2(pid=28485): Launched 21:11:00.085243 run osmo-stp_10.42.42.5: Starting osmo-stp 21:11:00.670194 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28487): Launched 21:11:01.013305 run osmo-stp_10.42.42.5(pid=28488): Launched 21:11:01.309550 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:11:01.915382 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28490): Launched 21:11:02.074103 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:11:02.387614 run patchelf(pid=28491): Launched 21:11:02.564759 run osmo-stp_10.42.42.5(pid=28488): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28488)] 21:11:02.697295 run osmo-stp_10.42.42.5(pid=28488): stdout: | (launched: 2022-12-12_21:11:00.950494) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:11:02.831814 run osmo-stp_10.42.42.5(pid=28488): stderr: | 20221212211101167 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211101167 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211101168 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211101168 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211101169 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211101169 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211101169 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:11:02.967971 run osmo-stp_10.42.42.5(pid=28488): stdout: | (launched: 2022-12-12_21:11:00.950494) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:11:03.124383 run osmo-stp_10.42.42.5(pid=28488): stderr: | 20221212211101167 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211101167 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211101168 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211101168 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211101169 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211101169 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211101169 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:11:03.277279 run patchelf(pid=28491): Terminating (SIGINT) 21:11:03.454100 run patchelf(pid=28491): Terminated: ok {rc=0} 21:11:03.581767 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28488): Process ended prematurely: osmo-stp_10.42.42.5(pid=28488) [trial-2382↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28488)] [trial-2382↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8] 21:11:03.591259 tst iperf3m4.py:8: Test FAILED (11.6 sec) 21:11:03.619205 run osmo-hlr_10.42.42.2(pid=28485): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28485)] 21:11:03.667736 run osmo-hlr_10.42.42.2(pid=28485): stdout: | (launched: 2022-12-12_21:10:59.893918) 21:11:03.718225 run osmo-hlr_10.42.42.2(pid=28485): stderr: | 20221212211100094 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212211100094 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212211100094 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212211100094 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212211100094 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212211100094 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212211100107 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212211100115 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212211100115 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212211100116 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:11:03.769512 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28474): Terminating (SIGTERM) 21:11:03.810087 run iperf3-srv_10.42.42.10(pid=28475): Terminating (SIGTERM) 21:11:03.850604 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28476): Terminating (SIGTERM) 21:11:03.891257 run iperf3-srv_10.42.42.10(pid=28477): Terminating (SIGTERM) 21:11:03.931653 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28478): Terminating (SIGTERM) 21:11:03.972425 run iperf3-srv_10.42.42.10(pid=28479): Terminating (SIGTERM) 21:11:04.013005 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28480): Terminating (SIGTERM) 21:11:04.053690 run iperf3-srv_10.42.42.10(pid=28481): Terminating (SIGTERM) 21:11:04.094440 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28484): Terminating (SIGTERM) 21:11:04.135184 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28487): Terminating (SIGTERM) 21:11:04.175888 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28490): Terminating (SIGTERM) 21:11:04.216703 --- ParallelTerminationStrategy: PID 28474 died... 21:11:04.236231 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28474): Terminated: ok {rc=0} 21:11:04.281281 --- ParallelTerminationStrategy: PID 28475 died... 21:11:04.300194 run iperf3-srv_10.42.42.10(pid=28475): Terminated {rc=256} 21:11:04.345733 --- ParallelTerminationStrategy: PID 28476 died... 21:11:04.364724 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28476): Terminated: ok {rc=0} 21:11:04.409838 --- ParallelTerminationStrategy: PID 28477 died... 21:11:04.428917 run iperf3-srv_10.42.42.10(pid=28477): Terminated {rc=256} 21:11:04.473806 --- ParallelTerminationStrategy: PID 28478 died... 21:11:04.492831 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28478): Terminated: ok {rc=0} 21:11:04.537894 --- ParallelTerminationStrategy: PID 28479 died... 21:11:04.556891 run iperf3-srv_10.42.42.10(pid=28479): Terminated {rc=256} 21:11:04.601679 --- ParallelTerminationStrategy: PID 28480 died... 21:11:04.620718 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28480): Terminated: ok {rc=0} 21:11:04.666125 --- ParallelTerminationStrategy: PID 28481 died... 21:11:04.685270 run iperf3-srv_10.42.42.10(pid=28481): Terminated {rc=256} 21:11:04.730339 --- ParallelTerminationStrategy: PID 28484 died... 21:11:04.749855 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28484): Terminated: ok {rc=0} 21:11:04.795395 --- ParallelTerminationStrategy: PID 28487 died... 21:11:04.814605 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28487): Terminated: ok {rc=0} 21:11:04.859671 --- ParallelTerminationStrategy: PID 28490 died... 21:11:04.878827 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28490): Terminated: ok {rc=0} 21:11:04.966901 bus /gobi_4: Setting Powered False 21:11:06.068819 bus /gobi_4: Setting Powered False 21:11:07.187760 bus /gobi_1: Setting Powered False 21:11:08.289371 bus /gobi_1: Setting Powered False 21:11:09.404677 bus /gobi_0: Setting Powered False 21:11:10.504198 bus /gobi_0: Setting Powered False 21:11:11.623544 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 21:11:12.728628 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:11:12.741146 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 21:11:12.816067 tst ping.py: using LAC 31527 21:11:12.937338 tst ping.py: using RAC 162 21:11:13.058716 tst ping.py: using CellId 31527 21:11:13.182255 tst ping.py: using BVCI 31528 21:11:13.297382 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:11:13.308625 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:11:13.319848 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:11:13.331089 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:11:13.342136 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:11:13.353352 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:11:13.364425 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:11:13.375521 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:11:13.496146 tst ping.py:19: start network... 21:11:13.720105 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:11:14.234148 run create_hlr_db(pid=28492): Launched 21:11:14.361196 bus /gobi_6: Setting Powered False 21:11:15.426435 run create_hlr_db(pid=28492): Terminated: ok {rc=0} 21:11:15.876363 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28494): Launched 21:11:16.240859 run osmo-hlr_10.42.42.2(pid=28495): Launched 21:11:16.495920 run osmo-stp_10.42.42.5: Starting osmo-stp 21:11:17.144116 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28497): Launched 21:11:17.489655 run osmo-stp_10.42.42.5(pid=28498): Launched 21:11:17.617589 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:11:18.196490 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28500): Launched 21:11:18.324020 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:11:18.604693 run patchelf(pid=28501): Launched 21:11:18.790397 run osmo-stp_10.42.42.5(pid=28498): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28498)] 21:11:18.929997 run osmo-stp_10.42.42.5(pid=28498): stdout: | (launched: 2022-12-12_21:11:17.428302) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:11:19.071763 run osmo-stp_10.42.42.5(pid=28498): stderr: | 20221212211117623 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211117623 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211117623 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211117623 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211117626 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211117626 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211117626 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:11:19.213607 run osmo-stp_10.42.42.5(pid=28498): stdout: | (launched: 2022-12-12_21:11:17.428302) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:11:19.349688 run osmo-stp_10.42.42.5(pid=28498): stderr: | 20221212211117623 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211117623 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211117623 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211117623 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211117626 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211117626 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211117626 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:11:19.510703 run patchelf(pid=28501): Terminating (SIGINT) 21:11:19.696584 run patchelf(pid=28501): Terminated: ok {rc=0} 21:11:19.830874 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=28498): Process ended prematurely: osmo-stp_10.42.42.5(pid=28498) [trial-2382↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28498)] [trial-2382↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22] 21:11:19.840546 tst ping.py:22: Test FAILED (7.1 sec) 21:11:19.869913 run osmo-hlr_10.42.42.2(pid=28495): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28495)] 21:11:19.921816 run osmo-hlr_10.42.42.2(pid=28495): stdout: | (launched: 2022-12-12_21:11:16.178247) 21:11:19.975232 run osmo-hlr_10.42.42.2(pid=28495): stderr: | 20221212211116418 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212211116418 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212211116418 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212211116418 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212211116418 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212211116418 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212211116438 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212211116455 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212211116455 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212211116455 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:11:20.029489 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28494): Terminating (SIGTERM) 21:11:20.072694 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28497): Terminating (SIGTERM) 21:11:20.116348 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28500): Terminating (SIGTERM) 21:11:20.159855 --- ParallelTerminationStrategy: PID 28494 died... 21:11:20.180470 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28494): Terminated: ok {rc=0} 21:11:20.228524 --- ParallelTerminationStrategy: PID 28497 died... 21:11:20.248564 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28497): Terminated: ok {rc=0} 21:11:20.296572 --- ParallelTerminationStrategy: PID 28500 died... 21:11:20.316733 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28500): Terminated: ok {rc=0} 21:11:20.407321 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 21:11:21.497304 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:11:21.510460 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 21:11:21.588578 tst ping_idle_ping.py: using LAC 31528 21:11:21.718002 tst ping_idle_ping.py: using RAC 163 21:11:21.850690 tst ping_idle_ping.py: using CellId 31528 21:11:21.978535 tst ping_idle_ping.py: using BVCI 31529 21:11:22.099502 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:11:22.111303 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:11:22.122868 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:11:22.135057 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:11:22.146907 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:11:22.158928 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:11:22.170951 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:11:22.182832 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:11:22.300883 tst ping_idle_ping.py:24: start network... 21:11:22.508022 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:11:22.994909 run create_hlr_db(pid=28502): Launched 21:11:23.128575 bus /gobi_6: Setting Powered False 21:11:24.194418 run create_hlr_db(pid=28502): Terminated: ok {rc=0} 21:11:24.655846 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28504): Launched 21:11:24.989669 run osmo-hlr_10.42.42.2(pid=28505): Launched 21:11:25.116381 run osmo-stp_10.42.42.5: Starting osmo-stp 21:11:25.691166 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28507): Launched 21:11:26.023429 run osmo-stp_10.42.42.5(pid=28508): Launched 21:11:26.151297 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:11:26.723916 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28510): Launched 21:11:26.862608 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:11:27.143467 run patchelf(pid=28511): Launched 21:11:27.328687 run osmo-stp_10.42.42.5(pid=28508): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28508)] 21:11:27.469280 run osmo-stp_10.42.42.5(pid=28508): stdout: | (launched: 2022-12-12_21:11:25.962482) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:11:27.611607 run osmo-stp_10.42.42.5(pid=28508): stderr: | 20221212211126156 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211126156 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211126156 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211126157 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211126157 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211126157 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211126157 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:11:27.754720 run osmo-stp_10.42.42.5(pid=28508): stdout: | (launched: 2022-12-12_21:11:25.962482) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:11:27.891047 run osmo-stp_10.42.42.5(pid=28508): stderr: | 20221212211126156 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211126156 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211126156 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211126157 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211126157 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211126157 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211126157 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:11:28.052605 run patchelf(pid=28511): Terminating (SIGINT) 21:11:28.238297 run patchelf(pid=28511): Terminated: ok {rc=0} 21:11:28.372395 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=28508): Process ended prematurely: osmo-stp_10.42.42.5(pid=28508) [trial-2382↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28508)] [trial-2382↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 21:11:28.382209 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 21:11:28.411212 run osmo-hlr_10.42.42.2(pid=28505): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28505)] 21:11:28.463681 run osmo-hlr_10.42.42.2(pid=28505): stdout: | (launched: 2022-12-12_21:11:24.928485) 21:11:28.517400 run osmo-hlr_10.42.42.2(pid=28505): stderr: | 20221212211125127 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212211125127 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212211125127 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212211125127 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212211125127 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212211125127 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212211125141 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212211125150 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212211125150 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212211125150 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:11:28.571488 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28504): Terminating (SIGTERM) 21:11:28.614939 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28507): Terminating (SIGTERM) 21:11:28.658613 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28510): Terminating (SIGTERM) 21:11:28.702197 --- ParallelTerminationStrategy: PID 28504 died... 21:11:28.723011 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28504): Terminated: ok {rc=0} 21:11:28.771585 --- ParallelTerminationStrategy: PID 28507 died... 21:11:28.791649 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28507): Terminated: ok {rc=0} 21:11:28.839424 --- ParallelTerminationStrategy: PID 28510 died... 21:11:28.859512 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28510): Terminated: ok {rc=0} 21:11:28.950499 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2382 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 21:11:30.268146 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:11:30.275762 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 21:11:30.310022 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 21:11:30.348924 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 21:11:30.437450 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 21:11:30.471547 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 21:11:30.509809 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 21:11:31.164088 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2382 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 21:11:31.223773 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:11:31.236553 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 21:11:31.313325 tst cs_paging_gprs_active.py: using LAC 31529 21:11:31.451262 tst cs_paging_gprs_active.py: using RAC 164 21:11:31.617926 tst cs_paging_gprs_active.py: using CellId 31529 21:11:31.752311 tst cs_paging_gprs_active.py: using BVCI 31530 21:11:31.880726 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:11:31.893666 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:11:31.907565 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:11:31.920292 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:11:31.934154 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:11:31.947965 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:11:31.960674 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:11:31.974937 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:11:31.989699 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 21:11:32.118317 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 21:11:32.249193 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 21:11:32.479145 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:11:32.819113 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28515): Launched 21:11:33.113117 run iperf3-srv_10.42.42.10(pid=28516): Launched 21:11:33.241271 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 21:11:33.470438 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:11:33.812887 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28517): Launched 21:11:34.107274 run iperf3-srv_10.42.42.10(pid=28518): Launched 21:11:34.235938 tst cs_paging_gprs_active.py:38: start network... 21:11:34.465146 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:11:34.990569 run create_hlr_db(pid=28519): Launched 21:11:35.121530 bus /gobi_6: Setting Powered False 21:11:36.187677 run create_hlr_db(pid=28519): Terminated: ok {rc=0} 21:11:36.655425 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28521): Launched 21:11:36.995378 run osmo-hlr_10.42.42.2(pid=28522): Launched 21:11:37.126584 run osmo-stp_10.42.42.5: Starting osmo-stp 21:11:37.705446 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28524): Launched 21:11:38.044406 run osmo-stp_10.42.42.5(pid=28525): Launched 21:11:38.175009 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:11:38.757575 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28527): Launched 21:11:38.888789 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:11:39.176329 run patchelf(pid=28528): Launched 21:11:39.363293 run osmo-stp_10.42.42.5(pid=28525): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28525)] 21:11:39.505437 run osmo-stp_10.42.42.5(pid=28525): stdout: | (launched: 2022-12-12_21:11:37.982740) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:11:39.649427 run osmo-stp_10.42.42.5(pid=28525): stderr: | 20221212211138176 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211138177 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211138177 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211138177 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211138178 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211138178 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211138178 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:11:39.794314 run osmo-stp_10.42.42.5(pid=28525): stdout: | (launched: 2022-12-12_21:11:37.982740) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:11:39.932189 run osmo-stp_10.42.42.5(pid=28525): stderr: | 20221212211138176 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211138177 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211138177 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211138177 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211138178 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211138178 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211138178 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:11:40.096140 run patchelf(pid=28528): Terminating (SIGINT) 21:11:40.284829 run patchelf(pid=28528): Terminated: ok {rc=0} 21:11:40.421273 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=28525): Process ended prematurely: osmo-stp_10.42.42.5(pid=28525) [trial-2382↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28525)] [trial-2382↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 21:11:40.431708 tst cs_paging_gprs_active.py:38: Test FAILED (9.3 sec) 21:11:40.461533 run osmo-hlr_10.42.42.2(pid=28522): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28522)] 21:11:40.513450 run osmo-hlr_10.42.42.2(pid=28522): stdout: | (launched: 2022-12-12_21:11:36.933680) 21:11:40.567276 run osmo-hlr_10.42.42.2(pid=28522): stderr: | 20221212211137133 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212211137133 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212211137133 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212211137133 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212211137133 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212211137133 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212211137167 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212211137177 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212211137177 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212211137177 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:11:40.621597 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28515): Terminating (SIGTERM) 21:11:40.665146 run iperf3-srv_10.42.42.10(pid=28516): Terminating (SIGTERM) 21:11:40.708286 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28517): Terminating (SIGTERM) 21:11:40.752109 run iperf3-srv_10.42.42.10(pid=28518): Terminating (SIGTERM) 21:11:40.795192 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28521): Terminating (SIGTERM) 21:11:40.838443 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28524): Terminating (SIGTERM) 21:11:40.881839 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28527): Terminating (SIGTERM) 21:11:40.925409 --- ParallelTerminationStrategy: PID 28515 died... 21:11:40.945932 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28515): Terminated: ok {rc=0} 21:11:40.994115 --- ParallelTerminationStrategy: PID 28516 died... 21:11:41.014263 run iperf3-srv_10.42.42.10(pid=28516): Terminated {rc=256} 21:11:41.062072 --- ParallelTerminationStrategy: PID 28517 died... 21:11:41.082242 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28517): Terminated: ok {rc=0} 21:11:41.130047 --- ParallelTerminationStrategy: PID 28518 died... 21:11:41.150154 run iperf3-srv_10.42.42.10(pid=28518): Terminated {rc=256} 21:11:41.197980 --- ParallelTerminationStrategy: PID 28521 died... 21:11:41.218168 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28521): Terminated: ok {rc=0} 21:11:41.266050 --- ParallelTerminationStrategy: PID 28524 died... 21:11:41.286226 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28524): Terminated: ok {rc=0} 21:11:41.334155 --- ParallelTerminationStrategy: PID 28527 died... 21:11:41.354393 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28527): Terminated: ok {rc=0} 21:11:41.445199 bus /gobi_0: Setting Powered False 21:11:42.547233 bus /gobi_0: Setting Powered False 21:11:43.666873 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 21:11:44.818327 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:11:44.830427 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 21:11:44.906578 tst iperf3.py: using LAC 31530 21:11:45.031965 tst iperf3.py: using RAC 165 21:11:45.157364 tst iperf3.py: using CellId 31530 21:11:45.283865 tst iperf3.py: using BVCI 31531 21:11:45.399307 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:11:45.410602 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:11:45.421606 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:11:45.432700 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:11:45.443844 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:11:45.454955 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:11:45.466141 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:11:45.477228 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:11:45.488385 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 21:11:45.606006 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 21:11:45.818091 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:11:46.169448 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28529): Launched 21:11:46.483959 run iperf3-srv_10.42.42.10(pid=28530): Launched 21:11:46.608464 tst iperf3.py:8: start network... 21:11:46.823770 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:11:47.318324 run create_hlr_db(pid=28531): Launched 21:11:47.446579 bus /gobi_6: Setting Powered False 21:11:48.509094 run create_hlr_db(pid=28531): Terminated: ok {rc=0} 21:11:48.968266 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28533): Launched 21:11:49.305732 run osmo-hlr_10.42.42.2(pid=28534): Launched 21:11:49.434443 run osmo-stp_10.42.42.5: Starting osmo-stp 21:11:50.018138 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28536): Launched 21:11:50.356232 run osmo-stp_10.42.42.5(pid=28537): Launched 21:11:50.485988 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:11:51.069617 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28539): Launched 21:11:51.199070 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:11:51.486046 run patchelf(pid=28540): Launched 21:11:51.673972 run osmo-stp_10.42.42.5(pid=28537): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28537)] 21:11:51.816495 run osmo-stp_10.42.42.5(pid=28537): stdout: | (launched: 2022-12-12_21:11:50.294592) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:11:51.960776 run osmo-stp_10.42.42.5(pid=28537): stderr: | 20221212211150487 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211150487 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211150487 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211150488 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211150488 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211150488 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211150488 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:11:52.104366 run osmo-stp_10.42.42.5(pid=28537): stdout: | (launched: 2022-12-12_21:11:50.294592) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:11:52.242728 run osmo-stp_10.42.42.5(pid=28537): stderr: | 20221212211150487 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211150487 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211150487 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211150488 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211150488 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211150488 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211150488 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:11:52.406519 run patchelf(pid=28540): Terminating (SIGINT) 21:11:52.595648 run patchelf(pid=28540): Terminated: ok {rc=0} 21:11:52.732492 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28537): Process ended prematurely: osmo-stp_10.42.42.5(pid=28537) [trial-2382↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28537)] [trial-2382↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8] 21:11:52.742907 tst iperf3.py:8: Test FAILED (8.0 sec) 21:11:52.772941 run osmo-hlr_10.42.42.2(pid=28534): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28534)] 21:11:52.824921 run osmo-hlr_10.42.42.2(pid=28534): stdout: | (launched: 2022-12-12_21:11:49.243866) 21:11:52.878861 run osmo-hlr_10.42.42.2(pid=28534): stderr: | 20221212211149446 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212211149446 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212211149446 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212211149446 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212211149446 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212211149446 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212211149460 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212211149470 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212211149470 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212211149470 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:11:52.933294 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28529): Terminating (SIGTERM) 21:11:52.976546 run iperf3-srv_10.42.42.10(pid=28530): Terminating (SIGTERM) 21:11:53.019402 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28533): Terminating (SIGTERM) 21:11:53.063053 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28536): Terminating (SIGTERM) 21:11:53.106349 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28539): Terminating (SIGTERM) 21:11:53.150068 --- ParallelTerminationStrategy: PID 28529 died... 21:11:53.170691 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28529): Terminated: ok {rc=0} 21:11:53.218581 --- ParallelTerminationStrategy: PID 28530 died... 21:11:53.238457 run iperf3-srv_10.42.42.10(pid=28530): Terminated {rc=256} 21:11:53.285975 --- ParallelTerminationStrategy: PID 28533 died... 21:11:53.306358 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28533): Terminated: ok {rc=0} 21:11:53.354231 --- ParallelTerminationStrategy: PID 28536 died... 21:11:53.374119 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28536): Terminated: ok {rc=0} 21:11:53.421804 --- ParallelTerminationStrategy: PID 28539 died... 21:11:53.441852 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28539): Terminated: ok {rc=0} 21:11:53.532336 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 21:11:54.687846 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:11:54.700322 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 21:11:54.775085 tst iperf3m4.py: using LAC 31531 21:11:54.909333 tst iperf3m4.py: using RAC 166 21:11:55.042287 tst iperf3m4.py: using CellId 31531 21:11:55.174337 tst iperf3m4.py: using BVCI 31532 21:11:55.298675 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:11:55.310426 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:11:55.321928 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:11:55.333948 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:11:55.345703 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:11:55.357425 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:11:55.369261 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:11:55.380845 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:11:55.392857 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 21:11:55.516567 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 21:11:55.638429 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 21:11:55.763112 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 21:11:55.885485 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 21:11:56.097676 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:11:56.414609 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28541): Launched 21:11:56.691027 run iperf3-srv_10.42.42.10(pid=28542): Launched 21:11:56.811390 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 21:11:57.022463 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:11:57.339988 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28543): Launched 21:11:57.614104 run iperf3-srv_10.42.42.10(pid=28544): Launched 21:11:57.734917 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 21:11:57.946482 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:11:58.263239 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28545): Launched 21:11:58.539044 run iperf3-srv_10.42.42.10(pid=28546): Launched 21:11:58.658723 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 21:11:58.869453 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:11:59.185532 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28547): Launched 21:11:59.460305 run iperf3-srv_10.42.42.10(pid=28548): Launched 21:11:59.578166 tst iperf3m4.py:8: start network... 21:11:59.789086 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:12:00.278011 run create_hlr_db(pid=28549): Launched 21:12:00.406127 bus /gobi_6: Setting Powered False 21:12:01.466654 run create_hlr_db(pid=28549): Terminated: ok {rc=0} 21:12:01.912843 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28551): Launched 21:12:02.246235 run osmo-hlr_10.42.42.2(pid=28552): Launched 21:12:02.366740 run osmo-stp_10.42.42.5: Starting osmo-stp 21:12:02.927958 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28554): Launched 21:12:03.242437 run osmo-stp_10.42.42.5(pid=28555): Launched 21:12:03.363647 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:12:03.904840 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28557): Launched 21:12:04.027135 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:12:04.292833 run patchelf(pid=28558): Launched 21:12:04.481612 run osmo-stp_10.42.42.5(pid=28555): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28555)] 21:12:04.624487 run osmo-stp_10.42.42.5(pid=28555): stdout: | (launched: 2022-12-12_21:12:03.184076) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:12:04.769452 run osmo-stp_10.42.42.5(pid=28555): stderr: | 20221212211203357 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211203357 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211203357 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211203358 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211203360 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211203360 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211203360 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:12:04.913692 run osmo-stp_10.42.42.5(pid=28555): stdout: | (launched: 2022-12-12_21:12:03.184076) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:12:05.052320 run osmo-stp_10.42.42.5(pid=28555): stderr: | 20221212211203357 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211203357 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211203357 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211203358 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211203360 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211203360 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211203360 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:12:05.217031 run patchelf(pid=28558): Terminating (SIGINT) 21:12:05.406656 run patchelf(pid=28558): Terminated: ok {rc=0} 21:12:05.543413 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28555): Process ended prematurely: osmo-stp_10.42.42.5(pid=28555) [trial-2382↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28555)] [trial-2382↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8] 21:12:05.554080 tst iperf3m4.py:8: Test FAILED (10.9 sec) 21:12:05.584607 run osmo-hlr_10.42.42.2(pid=28552): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28552)] 21:12:05.637100 run osmo-hlr_10.42.42.2(pid=28552): stdout: | (launched: 2022-12-12_21:12:02.187607) 21:12:05.691346 run osmo-hlr_10.42.42.2(pid=28552): stderr: | 20221212211202365 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212211202365 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212211202365 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212211202365 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212211202365 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212211202366 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212211202378 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212211202386 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212211202386 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212211202386 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:12:05.746304 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28541): Terminating (SIGTERM) 21:12:05.790139 run iperf3-srv_10.42.42.10(pid=28542): Terminating (SIGTERM) 21:12:05.834012 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28543): Terminating (SIGTERM) 21:12:05.877722 run iperf3-srv_10.42.42.10(pid=28544): Terminating (SIGTERM) 21:12:05.921298 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28545): Terminating (SIGTERM) 21:12:05.965092 run iperf3-srv_10.42.42.10(pid=28546): Terminating (SIGTERM) 21:12:06.008857 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28547): Terminating (SIGTERM) 21:12:06.052521 run iperf3-srv_10.42.42.10(pid=28548): Terminating (SIGTERM) 21:12:06.096109 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28551): Terminating (SIGTERM) 21:12:06.139826 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28554): Terminating (SIGTERM) 21:12:06.183407 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28557): Terminating (SIGTERM) 21:12:06.227387 --- ParallelTerminationStrategy: PID 28541 died... 21:12:06.248060 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28541): Terminated: ok {rc=0} 21:12:06.296521 --- ParallelTerminationStrategy: PID 28542 died... 21:12:06.317112 run iperf3-srv_10.42.42.10(pid=28542): Terminated {rc=256} 21:12:06.365326 --- ParallelTerminationStrategy: PID 28543 died... 21:12:06.385645 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28543): Terminated: ok {rc=0} 21:12:06.433991 --- ParallelTerminationStrategy: PID 28544 died... 21:12:06.454230 run iperf3-srv_10.42.42.10(pid=28544): Terminated {rc=256} 21:12:06.502697 --- ParallelTerminationStrategy: PID 28545 died... 21:12:06.522910 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28545): Terminated: ok {rc=0} 21:12:06.571240 --- ParallelTerminationStrategy: PID 28546 died... 21:12:06.591525 run iperf3-srv_10.42.42.10(pid=28546): Terminated {rc=256} 21:12:06.639956 --- ParallelTerminationStrategy: PID 28547 died... 21:12:06.660182 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28547): Terminated: ok {rc=0} 21:12:06.708465 --- ParallelTerminationStrategy: PID 28548 died... 21:12:06.728669 run iperf3-srv_10.42.42.10(pid=28548): Terminated {rc=256} 21:12:06.777240 --- ParallelTerminationStrategy: PID 28551 died... 21:12:06.797771 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28551): Terminated: ok {rc=0} 21:12:06.846399 --- ParallelTerminationStrategy: PID 28554 died... 21:12:06.866745 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28554): Terminated: ok {rc=0} 21:12:06.915332 --- ParallelTerminationStrategy: PID 28557 died... 21:12:06.935605 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28557): Terminated: ok {rc=0} 21:12:07.027895 bus /gobi_4: Setting Powered False 21:12:08.131182 bus /gobi_4: Setting Powered False 21:12:09.251409 bus /gobi_1: Setting Powered False 21:12:10.352808 bus /gobi_1: Setting Powered False 21:12:11.474684 bus /gobi_0: Setting Powered False 21:12:12.576657 bus /gobi_0: Setting Powered False 21:12:13.696704 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 21:12:14.801956 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:12:14.814391 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 21:12:14.888267 tst ping.py: using LAC 31532 21:12:15.020389 tst ping.py: using RAC 167 21:12:15.143017 tst ping.py: using CellId 31532 21:12:15.266469 tst ping.py: using BVCI 31533 21:12:15.379455 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:12:15.390906 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:12:15.402260 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:12:15.413281 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:12:15.424128 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:12:15.435158 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:12:15.446230 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:12:15.457535 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 21:12:15.576493 tst ping.py:19: start network... 21:12:15.798919 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:12:16.329991 run create_hlr_db(pid=28559): Launched 21:12:16.494949 bus /gobi_6: Setting Powered False 21:12:17.560583 run create_hlr_db(pid=28559): Terminated: ok {rc=0} 21:12:18.001465 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28561): Launched 21:12:18.312591 run osmo-hlr_10.42.42.2(pid=28562): Launched 21:12:18.429228 run osmo-stp_10.42.42.5: Starting osmo-stp 21:12:19.011489 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28564): Launched 21:12:19.342017 run osmo-stp_10.42.42.5(pid=28565): Launched 21:12:19.469568 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:12:20.042250 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28567): Launched 21:12:20.168012 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:12:20.447591 run patchelf(pid=28568): Launched 21:12:20.631894 run osmo-stp_10.42.42.5(pid=28565): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28565)] 21:12:20.772006 run osmo-stp_10.42.42.5(pid=28565): stdout: | (launched: 2022-12-12_21:12:19.281254) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:12:20.913924 run osmo-stp_10.42.42.5(pid=28565): stderr: | 20221212211219477 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211219478 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211219478 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211219478 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211219481 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211219481 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211219481 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:12:21.055708 run osmo-stp_10.42.42.5(pid=28565): stdout: | (launched: 2022-12-12_21:12:19.281254) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:12:21.191561 run osmo-stp_10.42.42.5(pid=28565): stderr: | 20221212211219477 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211219478 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211219478 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211219478 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211219481 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211219481 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211219481 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:12:21.352094 run patchelf(pid=28568): Terminating (SIGINT) 21:12:21.537587 run patchelf(pid=28568): Terminated: ok {rc=0} 21:12:21.671364 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=28565): Process ended prematurely: osmo-stp_10.42.42.5(pid=28565) [trial-2382↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28565)] [trial-2382↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22] 21:12:21.681086 tst ping.py:22: Test FAILED (6.9 sec) 21:12:21.710242 run osmo-hlr_10.42.42.2(pid=28562): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28562)] 21:12:21.762068 run osmo-hlr_10.42.42.2(pid=28562): stdout: | (launched: 2022-12-12_21:12:18.255058) 21:12:21.815782 run osmo-hlr_10.42.42.2(pid=28562): stderr: | 20221212211218433 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212211218433 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212211218433 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212211218433 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212211218433 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212211218433 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212211218446 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212211218455 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212211218455 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212211218455 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:12:21.869533 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28561): Terminating (SIGTERM) 21:12:21.912918 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28564): Terminating (SIGTERM) 21:12:21.955999 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28567): Terminating (SIGTERM) 21:12:21.999442 --- ParallelTerminationStrategy: PID 28561 died... 21:12:22.019923 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28561): Terminated: ok {rc=0} 21:12:22.067997 --- ParallelTerminationStrategy: PID 28564 died... 21:12:22.087956 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28564): Terminated: ok {rc=0} 21:12:22.136158 --- ParallelTerminationStrategy: PID 28567 died... 21:12:22.156631 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28567): Terminated: ok {rc=0} 21:12:22.246346 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 21:12:23.338428 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:12:23.350890 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 21:12:23.426211 tst ping_idle_ping.py: using LAC 31533 21:12:23.546367 tst ping_idle_ping.py: using RAC 168 21:12:23.666488 tst ping_idle_ping.py: using CellId 31533 21:12:23.786451 tst ping_idle_ping.py: using BVCI 31534 21:12:23.897431 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:12:23.908416 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:12:23.919357 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:12:23.930378 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:12:23.941191 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:12:23.952026 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:12:23.963042 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:12:23.973917 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 21:12:24.091498 tst ping_idle_ping.py:24: start network... 21:12:24.298412 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:12:24.780878 run create_hlr_db(pid=28569): Launched 21:12:24.907377 bus /gobi_6: Setting Powered False 21:12:25.969196 run create_hlr_db(pid=28569): Terminated: ok {rc=0} 21:12:26.400601 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28571): Launched 21:12:26.710666 run osmo-hlr_10.42.42.2(pid=28572): Launched 21:12:26.830522 run osmo-stp_10.42.42.5: Starting osmo-stp 21:12:27.377248 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28574): Launched 21:12:27.686461 run osmo-stp_10.42.42.5(pid=28575): Launched 21:12:27.803785 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:12:28.340450 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28577): Launched 21:12:28.458804 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:12:28.721631 run patchelf(pid=28578): Launched 21:12:28.894682 run osmo-stp_10.42.42.5(pid=28575): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28575)] 21:12:29.026361 run osmo-stp_10.42.42.5(pid=28575): stdout: | (launched: 2022-12-12_21:12:27.629166) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:12:29.159748 run osmo-stp_10.42.42.5(pid=28575): stderr: | 20221212211227803 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211227804 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211227804 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211227804 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211227805 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211227805 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211227805 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:12:29.293493 run osmo-stp_10.42.42.5(pid=28575): stdout: | (launched: 2022-12-12_21:12:27.629166) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:12:29.421220 run osmo-stp_10.42.42.5(pid=28575): stderr: | 20221212211227803 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211227804 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211227804 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211227804 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211227805 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211227805 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211227805 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:12:29.572138 run patchelf(pid=28578): Terminating (SIGINT) 21:12:29.748212 run patchelf(pid=28578): Terminated: ok {rc=0} 21:12:29.874933 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=28575): Process ended prematurely: osmo-stp_10.42.42.5(pid=28575) [trial-2382↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28575)] [trial-2382↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 21:12:29.883884 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 21:12:29.910895 run osmo-hlr_10.42.42.2(pid=28572): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28572)] 21:12:29.959747 run osmo-hlr_10.42.42.2(pid=28572): stdout: | (launched: 2022-12-12_21:12:26.652591) 21:12:30.010120 run osmo-hlr_10.42.42.2(pid=28572): stderr: | 20221212211226837 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212211226837 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212211226837 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212211226837 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212211226837 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212211226838 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212211226850 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212211226859 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212211226859 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212211226859 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:12:30.061273 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28571): Terminating (SIGTERM) 21:12:30.102045 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28574): Terminating (SIGTERM) 21:12:30.142765 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28577): Terminating (SIGTERM) 21:12:30.184116 --- ParallelTerminationStrategy: PID 28571 died... 21:12:30.203634 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28571): Terminated: ok {rc=0} 21:12:30.249106 --- ParallelTerminationStrategy: PID 28574 died... 21:12:30.269239 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28574): Terminated: ok {rc=0} 21:12:30.314145 --- ParallelTerminationStrategy: PID 28577 died... 21:12:30.333315 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28577): Terminated: ok {rc=0} 21:12:30.421760 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2382 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 21:12:31.804896 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:12:31.816335 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 21:12:31.861505 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 21:12:31.909605 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 21:12:31.978230 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 21:12:32.026038 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 21:12:32.072005 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 21:12:32.609734 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2382 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 21:12:32.615061 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:12:32.626925 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 21:12:32.701442 tst switch_tch_pdch.py: using LAC 31534 21:12:32.832525 tst switch_tch_pdch.py: using RAC 169 21:12:32.963299 tst switch_tch_pdch.py: using CellId 31534 21:12:33.091987 tst switch_tch_pdch.py: using BVCI 31535 21:12:33.214151 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:12:33.226129 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:12:33.237811 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:12:33.250206 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:12:33.262671 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:12:33.275300 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:12:33.288526 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:12:33.300279 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:12:33.421621 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:12:33.544662 tst switch_tch_pdch.py:51: start network... 21:12:33.768005 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:12:34.281290 run create_hlr_db(pid=28582): Launched 21:12:34.409376 bus /gobi_6: Setting Powered False 21:12:35.470285 run create_hlr_db(pid=28582): Terminated: ok {rc=0} 21:12:35.912005 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28584): Launched 21:12:36.221765 run osmo-hlr_10.42.42.2(pid=28585): Launched 21:12:36.340081 run osmo-stp_10.42.42.5: Starting osmo-stp 21:12:36.892171 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28587): Launched 21:12:37.200504 run osmo-stp_10.42.42.5(pid=28588): Launched 21:12:37.317424 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:12:37.849602 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28590): Launched 21:12:37.967847 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:12:38.230668 run patchelf(pid=28591): Launched 21:12:38.403323 run osmo-stp_10.42.42.5(pid=28588): ERR: Terminated: ERROR {rc=1} [trial-2382↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28588)] 21:12:38.532636 run osmo-stp_10.42.42.5(pid=28588): stdout: | (launched: 2022-12-12_21:12:37.143614) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:12:38.664651 run osmo-stp_10.42.42.5(pid=28588): stderr: | 20221212211237318 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211237318 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211237318 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211237319 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211237319 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211237319 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211237319 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:12:38.796845 run osmo-stp_10.42.42.5(pid=28588): stdout: | (launched: 2022-12-12_21:12:37.143614) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:12:38.922325 run osmo-stp_10.42.42.5(pid=28588): stderr: | 20221212211237318 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211237318 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211237318 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211237319 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211237319 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211237319 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211237319 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:12:39.071096 run patchelf(pid=28591): Terminating (SIGINT) 21:12:39.243623 run patchelf(pid=28591): Terminated: ok {rc=0} 21:12:39.368170 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=28588): Process ended prematurely: osmo-stp_10.42.42.5(pid=28588) [trial-2382↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28588)] [trial-2382↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 21:12:39.377223 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 21:12:39.404054 run osmo-hlr_10.42.42.2(pid=28585): ERR: Terminated: ERROR {rc=237} [trial-2382↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28585)] 21:12:39.452581 run osmo-hlr_10.42.42.2(pid=28585): stdout: | (launched: 2022-12-12_21:12:36.163994) 21:12:39.502991 run osmo-hlr_10.42.42.2(pid=28585): stderr: | 20221212211236345 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212211236345 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212211236345 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212211236345 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212211236345 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212211236345 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212211236357 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212211236365 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212211236366 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212211236366 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:12:39.553827 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28584): Terminating (SIGTERM) 21:12:39.594409 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28587): Terminating (SIGTERM) 21:12:39.634824 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28590): Terminating (SIGTERM) 21:12:39.675578 --- ParallelTerminationStrategy: PID 28584 died... 21:12:39.695086 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28584): Terminated: ok {rc=0} 21:12:39.740408 --- ParallelTerminationStrategy: PID 28587 died... 21:12:39.759482 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28587): Terminated: ok {rc=0} 21:12:39.804693 --- ParallelTerminationStrategy: PID 28590 died... 21:12:39.823980 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28590): Terminated: ok {rc=0} 21:12:39.911886 bus /gobi_0: Setting Powered False 21:12:41.018167 bus /gobi_0: Setting Powered False 21:12:42.137868 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2382 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 21:12:43.396197 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:12:43.402410 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 21:12:43.436318 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 21:12:43.470906 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 21:12:43.523988 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 21:12:43.558182 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 21:12:43.593365 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 21:12:44.148845 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2382 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 21:12:44.156074 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 21:12:44.168505 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 21:12:44.241598 tst switch_tch_pdch.py: using LAC 31535 21:12:44.366592 tst switch_tch_pdch.py: using RAC 170 21:12:44.488655 tst switch_tch_pdch.py: using CellId 31535 21:12:44.610000 tst switch_tch_pdch.py: using BVCI 31536 21:12:44.722722 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 21:12:44.734094 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 21:12:44.745193 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 21:12:44.756151 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 21:12:44.767124 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 21:12:44.778090 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 21:12:44.789079 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 21:12:44.799967 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 21:12:44.921993 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 21:12:45.045919 tst switch_tch_pdch.py:51: start network... 21:12:45.269833 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:12:45.754653 run create_hlr_db(pid=28596): Launched 21:12:45.917911 bus /gobi_6: Setting Powered False 21:12:46.979211 run create_hlr_db(pid=28596): Terminated: ok {rc=0} 21:12:47.392200 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28598): Launched 21:12:47.702717 run osmo-hlr_10.42.42.2(pid=28599): Launched 21:12:47.820285 run osmo-stp_10.42.42.5: Starting osmo-stp 21:12:48.326304 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28601): Launched 21:12:48.634287 run osmo-stp_10.42.42.5(pid=28602): Launched 21:12:48.750957 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:12:49.275789 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28604): Launched 21:12:49.393422 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:12:49.653957 run patchelf(pid=28605): Launched 21:12:49.828024 run osmo-stp_10.42.42.5(pid=28602): ERR: Terminated: ERROR {rc=1} [trial-2382↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28602)] 21:12:49.958680 run osmo-stp_10.42.42.5(pid=28602): stdout: | (launched: 2022-12-12_21:12:48.576921) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:12:50.091103 run osmo-stp_10.42.42.5(pid=28602): stderr: | 20221212211248751 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211248751 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211248752 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211248753 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211248753 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211248753 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211248753 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:12:50.223936 run osmo-stp_10.42.42.5(pid=28602): stdout: | (launched: 2022-12-12_21:12:48.576921) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:12:50.351032 run osmo-stp_10.42.42.5(pid=28602): stderr: | 20221212211248751 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211248751 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211248752 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211248753 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211248753 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211248753 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211248753 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:12:50.500665 run patchelf(pid=28605): Terminating (SIGINT) 21:12:50.675690 run patchelf(pid=28605): Terminated: ok {rc=0} 21:12:50.802739 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=28602): Process ended prematurely: osmo-stp_10.42.42.5(pid=28602) [trial-2382↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28602)] [trial-2382↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 21:12:50.812139 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 21:12:50.839176 run osmo-hlr_10.42.42.2(pid=28599): ERR: Terminated: ERROR {rc=237} [trial-2382↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28599)] 21:12:50.887898 run osmo-hlr_10.42.42.2(pid=28599): stdout: | (launched: 2022-12-12_21:12:47.645418) 21:12:50.938188 run osmo-hlr_10.42.42.2(pid=28599): stderr: | 20221212211247823 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212211247823 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212211247824 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212211247824 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212211247824 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212211247824 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212211247836 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212211247844 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212211247845 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212211247845 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:12:50.989167 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28598): Terminating (SIGTERM) 21:12:51.030010 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28601): Terminating (SIGTERM) 21:12:51.070902 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28604): Terminating (SIGTERM) 21:12:51.112035 --- ParallelTerminationStrategy: PID 28598 died... 21:12:51.131271 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28598): Terminated: ok {rc=0} 21:12:51.176240 --- ParallelTerminationStrategy: PID 28601 died... 21:12:51.195279 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28601): Terminated: ok {rc=0} 21:12:51.240120 --- ParallelTerminationStrategy: PID 28604 died... 21:12:51.259185 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28604): Terminated: ok {rc=0} 21:12:51.347138 bus /gobi_0: Setting Powered False 21:12:52.449423 bus /gobi_0: Setting Powered False 21:12:53.568396 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2382 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 nitb_sms:trx-umtrx --------------------------------------------------------------------- 21:12:54.830076 tst nitb_sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:12:54.834336 tst nitb_sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 21:12:54.868490 tst nitb_sms:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 21:12:54.875633 tst nitb_sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 21:12:54.930028 tst nitb_sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 21:12:54.963938 tst nitb_sms:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 21:12:54.970945 tst nitb_sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 21:12:55.509029 tst nitb_sms:trx-umtrx: RESERVED RESOURCES for nitb_sms: bts UmTRX ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 nitb_sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 21:12:55.514146 tst nitb_sms:trx-umtrx: Using 1 x ip_address (candidates: 1) 21:12:55.525476 tst nitb_sms:trx-umtrx: Using 1 x bts (candidates: 1) 21:12:55.579683 tst mo_mt_sms.py: using LAC 31536 21:12:55.718640 tst mo_mt_sms.py: using RAC 171 21:12:55.849400 tst mo_mt_sms.py: using CellId 31536 21:12:55.979172 tst mo_mt_sms.py: using BVCI 31537 21:12:56.100332 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 21:12:56.222249 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 21:12:56.338736 tst mo_mt_sms.py:9: start nitb and bts... 21:12:56.546622 run osmo-nitb_10.42.42.2: Starting osmo-nitb 21:12:57.173404 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28611): Launched 21:12:57.483114 run osmo-nitb_10.42.42.2(pid=28612): Launched 21:12:57.655533 run osmo-nitb_10.42.42.2(pid=28612): ERR: Terminated: ERROR {rc=2} [trial-2382↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28612)] 21:12:57.793500 run osmo-nitb_10.42.42.2(pid=28612): stdout: | (launched: 2022-12-12_21:12:57.425917) 21:12:57.932845 run osmo-nitb_10.42.42.2(pid=28612): stderr: | (launched: 2022-12-12_21:12:57.471715) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 21:12:58.071846 run osmo-nitb_10.42.42.2(pid=28612): stdout: | (launched: 2022-12-12_21:12:57.425917) 21:12:58.205679 run osmo-nitb_10.42.42.2(pid=28612): stderr: | (launched: 2022-12-12_21:12:57.471715) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7ff6b86c2268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=28612): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28612) [trial-2382↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28612)] 21:12:58.601105 tst osmo-nitb_10.42.42.2(pid=28612): stdout: | (launched: 2022-12-12_21:12:57.425917) 21:12:58.726326 tst osmo-nitb_10.42.42.2(pid=28612): stderr: | (launched: 2022-12-12_21:12:57.471715) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 21:12:58.874069 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=28612): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28612) [trial-2382↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28612)] [trial-2382↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11] 21:12:58.882748 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 21:12:58.889474 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28611): Terminating (SIGTERM) 21:12:59.098796 --- ParallelTerminationStrategy: PID 28611 died... 21:12:59.120018 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28611): Terminated: ok {rc=0} 21:12:59.205193 bus /sierra_3: Setting Powered False 21:13:00.306995 bus /sierra_3: Setting Powered False 21:13:01.426248 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 nitb_sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 sms:trx-umtrx --------------------------------------------------------------------- 21:13:02.631964 tst sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:13:02.636369 tst sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 21:13:02.670626 tst sms:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 21:13:02.698430 tst sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 21:13:02.753126 tst sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 21:13:02.787877 tst sms:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 21:13:02.815619 tst sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 21:13:03.361592 tst sms:trx-umtrx: RESERVED RESOURCES for sms: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 21:13:03.366760 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 21:13:03.377987 tst sms:trx-umtrx: Using 1 x bts (candidates: 1) 21:13:03.426299 tst mo_mt_sms.py: using LAC 31537 21:13:03.557369 tst mo_mt_sms.py: using RAC 172 21:13:03.686931 tst mo_mt_sms.py: using CellId 31537 21:13:03.819058 tst mo_mt_sms.py: using BVCI 31538 21:13:03.940513 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 21:13:03.951841 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 21:13:03.962850 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 21:13:03.974146 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 21:13:03.985508 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 21:13:03.996701 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 21:13:04.119810 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 21:13:04.237708 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:13:04.716137 run create_hlr_db(pid=28616): Launched 21:13:04.842230 bus /sierra_2: Setting Powered False 21:13:05.904560 run create_hlr_db(pid=28616): Terminated: ok {rc=0} 21:13:06.354370 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28618): Launched 21:13:06.685406 run osmo-hlr_10.42.42.2(pid=28619): Launched 21:13:06.814853 run osmo-stp_10.42.42.5: Starting osmo-stp 21:13:07.388741 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28621): Launched 21:13:07.721778 run osmo-stp_10.42.42.5(pid=28622): Launched 21:13:07.850144 run osmo-msc_10.42.42.6: Starting osmo-msc 21:13:08.449632 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28624): Launched 21:13:08.765740 run osmo-msc_10.42.42.6(pid=28625): Launched 21:13:08.937229 run osmo-stp_10.42.42.5(pid=28622): ERR: Terminated: ERROR {rc=1} [trial-2382↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28622)] 21:13:09.066566 run osmo-stp_10.42.42.5(pid=28622): stdout: | (launched: 2022-12-12_21:13:07.660829) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:13:09.197613 run osmo-stp_10.42.42.5(pid=28622): stderr: | 20221212211307857 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211307857 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211307857 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211307858 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211307860 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211307860 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211307860 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:13:09.325758 run osmo-stp_10.42.42.5(pid=28622): stdout: | (launched: 2022-12-12_21:13:07.660829) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:13:09.448148 run osmo-stp_10.42.42.5(pid=28622): stderr: | 20221212211307857 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211307857 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211307857 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211307858 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211307860 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211307860 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211307860 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:13:09.594283 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=28622): Process ended prematurely: osmo-stp_10.42.42.5(pid=28622) [trial-2382↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28622)] [trial-2382↪sms:trx-umtrx↪mo_mt_sms.py:16] 21:13:09.602581 tst mo_mt_sms.py:16: Test FAILED (6.2 sec) 21:13:09.629031 run osmo-hlr_10.42.42.2(pid=28619): ERR: Terminated: ERROR {rc=237} [trial-2382↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28619)] 21:13:09.678253 run osmo-hlr_10.42.42.2(pid=28619): stdout: | (launched: 2022-12-12_21:13:06.624536) 21:13:09.728630 run osmo-hlr_10.42.42.2(pid=28619): stderr: | 20221212211306828 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212211306828 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212211306828 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212211306828 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212211306828 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212211306828 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212211306838 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/sms:trx-umtrx/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212211306848 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212211306848 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212211306848 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:13:09.799226 run osmo-msc_10.42.42.6(pid=28625): ERR: Terminated: ERROR {rc=2} [trial-2382↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28625)] 21:13:09.847994 run osmo-msc_10.42.42.6(pid=28625): stdout: | (launched: 2022-12-12_21:13:08.707726) 21:13:09.898690 run osmo-msc_10.42.42.6(pid=28625): stderr: | 20221212211308984 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212211308984 DLGLOBAL DEBUG validating counter group 0x7f5491b2ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212211308984 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212211308984 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212211308984 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212211308985 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212211308986 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212211308987 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212211308987 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212211308988 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:13:09.949444 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28618): Terminating (SIGTERM) 21:13:09.989743 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28621): Terminating (SIGTERM) 21:13:10.030112 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28624): Terminating (SIGTERM) 21:13:10.070920 --- ParallelTerminationStrategy: PID 28618 died... 21:13:10.090499 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28618): Terminated: ok {rc=0} 21:13:10.135358 --- ParallelTerminationStrategy: PID 28621 died... 21:13:10.154354 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28621): Terminated: ok {rc=0} 21:13:10.198992 --- ParallelTerminationStrategy: PID 28624 died... 21:13:10.217895 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28624): Terminated: ok {rc=0} 21:13:10.306254 bus /sierra_3: Setting Powered False 21:13:11.408931 bus /sierra_3: Setting Powered False 21:13:12.525180 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 nitb_ussd:trx-umtrx --------------------------------------------------------------------- 21:13:13.767143 tst nitb_ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:13:13.771547 tst nitb_ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 21:13:13.805870 tst nitb_ussd:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 21:13:13.812929 tst nitb_ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 21:13:13.847810 tst nitb_ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 21:13:13.882250 tst nitb_ussd:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 21:13:13.889411 tst nitb_ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 21:13:14.413882 tst nitb_ussd:trx-umtrx: RESERVED RESOURCES for nitb_ussd: bts UmTRX ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2382 nitb_ussd:trx-umtrx assert_extension.py ---------------------------------------------- 21:13:14.419982 tst nitb_ussd:trx-umtrx: Using 1 x ip_address (candidates: 1) 21:13:14.431917 tst nitb_ussd:trx-umtrx: Using 1 x bts (candidates: 1) 21:13:14.479685 tst assert_extension.py: using LAC 31538 21:13:14.601456 tst assert_extension.py: using RAC 173 21:13:14.722739 tst assert_extension.py: using CellId 31538 21:13:14.843665 tst assert_extension.py: using BVCI 31539 21:13:14.956735 tst nitb_ussd:trx-umtrx: Using 1 x modem (candidates: 1) 21:13:15.075529 tst assert_extension.py:10: start nitb and bts... 21:13:15.298671 run osmo-nitb_10.42.42.2: Starting osmo-nitb 21:13:15.980842 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28630): Launched 21:13:16.322004 run osmo-nitb_10.42.42.2(pid=28631): Launched 21:13:16.505218 run osmo-nitb_10.42.42.2(pid=28631): ERR: Terminated: ERROR {rc=2} [trial-2382↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28631)] 21:13:16.649778 run osmo-nitb_10.42.42.2(pid=28631): stdout: | (launched: 2022-12-12_21:13:16.263191) 21:13:16.795737 run osmo-nitb_10.42.42.2(pid=28631): stderr: | (launched: 2022-12-12_21:13:16.310394) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 21:13:16.938887 run osmo-nitb_10.42.42.2(pid=28631): stdout: | (launched: 2022-12-12_21:13:16.263191) 21:13:17.076522 run osmo-nitb_10.42.42.2(pid=28631): stderr: | (launched: 2022-12-12_21:13:16.310394) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7ff6b86c2268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=28631): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28631) [trial-2382↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28631)] 21:13:17.450449 tst osmo-nitb_10.42.42.2(pid=28631): stdout: | (launched: 2022-12-12_21:13:16.263191) 21:13:17.575930 tst osmo-nitb_10.42.42.2(pid=28631): stderr: | (launched: 2022-12-12_21:13:16.310394) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 21:13:17.722984 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=28631): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28631) [trial-2382↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28631)] [trial-2382↪nitb_ussd:trx-umtrx↪assert_extension.py:12] 21:13:17.731642 tst assert_extension.py:12: Test FAILED (3.3 sec) 21:13:17.738129 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28630): Terminating (SIGTERM) 21:13:17.947368 --- ParallelTerminationStrategy: PID 28630 died... 21:13:17.968472 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28630): Terminated: ok {rc=0} 21:13:18.055976 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 nitb_ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 ussd:trx-umtrx --------------------------------------------------------------------- 21:13:19.256831 tst ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:13:19.261510 tst ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 21:13:19.296184 tst ussd:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 21:13:19.324194 tst ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 21:13:19.361180 tst ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 21:13:19.394121 tst ussd:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 21:13:19.421017 tst ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 21:13:19.952334 tst ussd:trx-umtrx: RESERVED RESOURCES for ussd: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2382 ussd:trx-umtrx assert_extension.py ---------------------------------------------- 21:13:19.957614 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 21:13:19.968591 tst ussd:trx-umtrx: Using 1 x bts (candidates: 1) 21:13:20.017277 tst assert_extension.py: using LAC 31539 21:13:20.145707 tst assert_extension.py: using RAC 174 21:13:20.275387 tst assert_extension.py: using CellId 31539 21:13:20.406865 tst assert_extension.py: using BVCI 31540 21:13:20.527973 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 21:13:20.539234 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 21:13:20.550313 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 21:13:20.561879 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 21:13:20.573213 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 21:13:20.584582 tst ussd:trx-umtrx: Using 1 x modem (candidates: 1) 21:13:20.706117 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:13:21.219051 run create_hlr_db(pid=28635): Launched 21:13:21.344257 bus /sierra_2: Setting Powered False 21:13:22.410233 run create_hlr_db(pid=28635): Terminated: ok {rc=0} 21:13:22.851499 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28637): Launched 21:13:23.161234 run osmo-hlr_10.42.42.2(pid=28638): Launched 21:13:23.278552 run osmo-stp_10.42.42.5: Starting osmo-stp 21:13:23.815510 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28640): Launched 21:13:24.122908 run osmo-stp_10.42.42.5(pid=28641): Launched 21:13:24.239926 run osmo-msc_10.42.42.6: Starting osmo-msc 21:13:24.795969 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28643): Launched 21:13:25.103058 run osmo-msc_10.42.42.6(pid=28644): Launched 21:13:25.274556 run osmo-stp_10.42.42.5(pid=28641): ERR: Terminated: ERROR {rc=1} [trial-2382↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28641)] 21:13:25.404316 run osmo-stp_10.42.42.5(pid=28641): stdout: | (launched: 2022-12-12_21:13:24.065844) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:13:25.534920 run osmo-stp_10.42.42.5(pid=28641): stderr: | 20221212211324237 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211324237 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211324238 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211324238 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211324240 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211324241 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211324241 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:13:25.663219 run osmo-stp_10.42.42.5(pid=28641): stdout: | (launched: 2022-12-12_21:13:24.065844) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:13:25.785220 run osmo-stp_10.42.42.5(pid=28641): stderr: | 20221212211324237 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211324237 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211324238 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211324238 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211324240 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211324241 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211324241 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:13:25.931248 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=28641): Process ended prematurely: osmo-stp_10.42.42.5(pid=28641) [trial-2382↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28641)] [trial-2382↪ussd:trx-umtrx↪assert_extension.py:17] 21:13:25.939801 tst assert_extension.py:17: Test FAILED (6.0 sec) 21:13:25.966299 run osmo-hlr_10.42.42.2(pid=28638): ERR: Terminated: ERROR {rc=237} [trial-2382↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28638)] 21:13:26.015270 run osmo-hlr_10.42.42.2(pid=28638): stdout: | (launched: 2022-12-12_21:13:23.103822) 21:13:26.065605 run osmo-hlr_10.42.42.2(pid=28638): stderr: | 20221212211323281 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212211323281 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212211323281 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212211323281 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212211323281 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212211323281 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212211323297 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/ussd:trx-umtrx/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212211323307 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212211323307 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212211323307 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:13:26.135973 run osmo-msc_10.42.42.6(pid=28644): ERR: Terminated: ERROR {rc=2} [trial-2382↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28644)] 21:13:26.184721 run osmo-msc_10.42.42.6(pid=28644): stdout: | (launched: 2022-12-12_21:13:25.046234) 21:13:26.234901 run osmo-msc_10.42.42.6(pid=28644): stderr: | 20221212211325320 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212211325320 DLGLOBAL DEBUG validating counter group 0x7f96dd9cec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212211325320 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212211325320 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212211325320 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212211325321 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212211325322 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212211325323 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212211325323 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212211325323 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:13:26.285802 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28637): Terminating (SIGTERM) 21:13:26.326222 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28640): Terminating (SIGTERM) 21:13:26.366537 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28643): Terminating (SIGTERM) 21:13:26.407469 --- ParallelTerminationStrategy: PID 28637 died... 21:13:26.427088 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28637): Terminated: ok {rc=0} 21:13:26.472039 --- ParallelTerminationStrategy: PID 28640 died... 21:13:26.490919 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28640): Terminated: ok {rc=0} 21:13:26.535700 --- ParallelTerminationStrategy: PID 28643 died... 21:13:26.554519 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28643): Terminated: ok {rc=0} 21:13:26.640286 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 21:13:27.848313 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:13:27.854878 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 21:13:27.887438 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 21:13:27.914190 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 21:13:27.967736 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 21:13:28.000687 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 21:13:28.027286 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 21:13:28.578124 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 21:13:28.629501 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:13:28.640824 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 21:13:28.710319 tst mo_mt_call.py: using LAC 31540 21:13:28.834864 tst mo_mt_call.py: using RAC 175 21:13:28.960076 tst mo_mt_call.py: using CellId 31540 21:13:29.085177 tst mo_mt_call.py: using BVCI 31541 21:13:29.200889 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:13:29.212092 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:13:29.222976 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:13:29.234003 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:13:29.245041 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:13:29.255937 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 21:13:29.377303 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 21:13:29.497574 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:13:30.020573 run create_hlr_db(pid=28649): Launched 21:13:30.150075 bus /sierra_2: Setting Powered False 21:13:31.212006 run create_hlr_db(pid=28649): Terminated: ok {rc=0} 21:13:31.703921 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28651): Launched 21:13:32.055841 run osmo-hlr_10.42.42.2(pid=28652): Launched 21:13:32.229546 run osmo-stp_10.42.42.5: Starting osmo-stp 21:13:32.772506 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28654): Launched 21:13:33.086634 run osmo-stp_10.42.42.5(pid=28655): Launched 21:13:33.208103 run osmo-msc_10.42.42.6: Starting osmo-msc 21:13:33.776465 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28657): Launched 21:13:34.090898 run osmo-msc_10.42.42.6(pid=28658): Launched 21:13:34.266837 run osmo-stp_10.42.42.5(pid=28655): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28655)] 21:13:34.399204 run osmo-stp_10.42.42.5(pid=28655): stdout: | (launched: 2022-12-12_21:13:33.028649) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:13:34.531207 run osmo-stp_10.42.42.5(pid=28655): stderr: | 20221212211333205 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211333205 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211333205 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211333205 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211333206 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211333206 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211333206 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:13:34.661275 run osmo-stp_10.42.42.5(pid=28655): stdout: | (launched: 2022-12-12_21:13:33.028649) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:13:34.786289 run osmo-stp_10.42.42.5(pid=28655): stderr: | 20221212211333205 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211333205 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211333205 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211333205 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211333206 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211333206 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211333206 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:13:34.935426 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28655): Process ended prematurely: osmo-stp_10.42.42.5(pid=28655) [trial-2382↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28655)] [trial-2382↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 21:13:34.944474 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 21:13:34.971322 run osmo-hlr_10.42.42.2(pid=28652): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28652)] 21:13:35.020389 run osmo-hlr_10.42.42.2(pid=28652): stdout: | (launched: 2022-12-12_21:13:31.994383) 21:13:35.071218 run osmo-hlr_10.42.42.2(pid=28652): stderr: | 20221212211332236 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212211332236 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212211332236 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212211332236 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212211332236 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212211332236 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212211332251 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212211332261 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212211332262 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212211332262 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:13:35.142597 run osmo-msc_10.42.42.6(pid=28658): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28658)] 21:13:35.192517 run osmo-msc_10.42.42.6(pid=28658): stdout: | (launched: 2022-12-12_21:13:34.032750) 21:13:35.243434 run osmo-msc_10.42.42.6(pid=28658): stderr: | 20221212211334307 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212211334307 DLGLOBAL DEBUG validating counter group 0x7fe23f166c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212211334307 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212211334307 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212211334307 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212211334307 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212211334309 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212211334310 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212211334310 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212211334310 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:13:35.294483 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28651): Terminating (SIGTERM) 21:13:35.335092 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28654): Terminating (SIGTERM) 21:13:35.376058 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28657): Terminating (SIGTERM) 21:13:35.417230 --- ParallelTerminationStrategy: PID 28651 died... 21:13:35.436739 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28651): Terminated: ok {rc=0} 21:13:35.481825 --- ParallelTerminationStrategy: PID 28654 died... 21:13:35.500712 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28654): Terminated: ok {rc=0} 21:13:35.546401 --- ParallelTerminationStrategy: PID 28657 died... 21:13:35.565536 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28657): Terminated: ok {rc=0} 21:13:35.653120 bus /sierra_3: Setting Powered False 21:13:36.756764 bus /sierra_3: Setting Powered False 21:13:37.876736 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2382 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 21:13:39.026068 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:13:39.038280 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 21:13:39.125814 tst mo_mt_call_osmux.py: using LAC 31541 21:13:39.251936 tst mo_mt_call_osmux.py: using RAC 176 21:13:39.386410 tst mo_mt_call_osmux.py: using CellId 31541 21:13:39.518706 tst mo_mt_call_osmux.py: using BVCI 31542 21:13:39.641538 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:13:39.653561 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:13:39.665277 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:13:39.677316 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:13:39.688784 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:13:39.700509 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 21:13:39.824511 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 21:13:39.944859 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:13:40.469354 run create_hlr_db(pid=28660): Launched 21:13:40.597135 bus /sierra_2: Setting Powered False 21:13:41.663482 run create_hlr_db(pid=28660): Terminated: ok {rc=0} 21:13:42.111336 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28662): Launched 21:13:42.425482 run osmo-hlr_10.42.42.2(pid=28663): Launched 21:13:42.547687 run osmo-stp_10.42.42.5: Starting osmo-stp 21:13:43.092133 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28665): Launched 21:13:43.406504 run osmo-stp_10.42.42.5(pid=28666): Launched 21:13:43.528540 run osmo-msc_10.42.42.6: Starting osmo-msc 21:13:44.096619 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28668): Launched 21:13:44.410508 run osmo-msc_10.42.42.6(pid=28669): Launched 21:13:44.586932 run osmo-stp_10.42.42.5(pid=28666): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28666)] 21:13:44.718505 run osmo-stp_10.42.42.5(pid=28666): stdout: | (launched: 2022-12-12_21:13:43.348376) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:13:44.850772 run osmo-stp_10.42.42.5(pid=28666): stderr: | 20221212211343520 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211343521 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211343521 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211343521 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211343522 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211343522 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211343522 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:13:44.980360 run osmo-stp_10.42.42.5(pid=28666): stdout: | (launched: 2022-12-12_21:13:43.348376) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:13:45.104725 run osmo-stp_10.42.42.5(pid=28666): stderr: | 20221212211343520 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211343521 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211343521 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211343521 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211343522 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211343522 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211343522 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:13:45.253514 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28666): Process ended prematurely: osmo-stp_10.42.42.5(pid=28666) [trial-2382↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28666)] [trial-2382↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 21:13:45.262528 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 21:13:45.289415 run osmo-hlr_10.42.42.2(pid=28663): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28663)] 21:13:45.338291 run osmo-hlr_10.42.42.2(pid=28663): stdout: | (launched: 2022-12-12_21:13:42.366973) 21:13:45.388739 run osmo-hlr_10.42.42.2(pid=28663): stderr: | 20221212211342545 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212211342545 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212211342545 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212211342545 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212211342545 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212211342545 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212211342557 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212211342566 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212211342566 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212211342566 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:13:45.459338 run osmo-msc_10.42.42.6(pid=28669): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28669)] 21:13:45.508645 run osmo-msc_10.42.42.6(pid=28669): stdout: | (launched: 2022-12-12_21:13:44.352121) 21:13:45.558932 run osmo-msc_10.42.42.6(pid=28669): stderr: | 20221212211344627 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212211344627 DLGLOBAL DEBUG validating counter group 0x7f48361afc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212211344627 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212211344627 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212211344627 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212211344627 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212211344629 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212211344629 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212211344630 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212211344630 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:13:45.609649 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28662): Terminating (SIGTERM) 21:13:45.650185 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28665): Terminating (SIGTERM) 21:13:45.690742 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28668): Terminating (SIGTERM) 21:13:45.731581 --- ParallelTerminationStrategy: PID 28662 died... 21:13:45.750712 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28662): Terminated: ok {rc=0} 21:13:45.795563 --- ParallelTerminationStrategy: PID 28665 died... 21:13:45.814634 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28665): Terminated: ok {rc=0} 21:13:45.867647 --- ParallelTerminationStrategy: PID 28668 died... 21:13:45.891075 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28668): Terminated: ok {rc=0} 21:13:45.984752 bus /sierra_3: Setting Powered False 21:13:47.083881 bus /sierra_3: Setting Powered False 21:13:48.206982 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 21:13:49.461989 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:13:49.469441 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 21:13:49.501771 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 21:13:49.528444 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 21:13:49.583129 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 21:13:49.618354 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 21:13:49.646305 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 21:13:50.191028 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 21:13:50.240880 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:13:50.252223 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 21:13:50.324500 tst mo_mt_call.py: using LAC 31542 21:13:50.448482 tst mo_mt_call.py: using RAC 177 21:13:50.570415 tst mo_mt_call.py: using CellId 31542 21:13:50.693426 tst mo_mt_call.py: using BVCI 31543 21:13:50.807106 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:13:50.818559 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:13:50.829621 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:13:50.840602 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:13:50.851845 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:13:50.862953 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 21:13:50.983372 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 21:13:51.104246 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:13:51.625737 run create_hlr_db(pid=28674): Launched 21:13:51.755336 bus /sierra_2: Setting Powered False 21:13:52.822223 run create_hlr_db(pid=28674): Terminated: ok {rc=0} 21:13:53.270640 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28676): Launched 21:13:53.584706 run osmo-hlr_10.42.42.2(pid=28677): Launched 21:13:53.705798 run osmo-stp_10.42.42.5: Starting osmo-stp 21:13:54.289895 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28679): Launched 21:13:54.628599 run osmo-stp_10.42.42.5(pid=28680): Launched 21:13:54.758553 run osmo-msc_10.42.42.6: Starting osmo-msc 21:13:55.367737 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28682): Launched 21:13:55.706082 run osmo-msc_10.42.42.6(pid=28683): Launched 21:13:55.895249 run osmo-stp_10.42.42.5(pid=28680): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28680)] 21:13:56.037993 run osmo-stp_10.42.42.5(pid=28680): stdout: | (launched: 2022-12-12_21:13:54.566803) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:13:56.180347 run osmo-stp_10.42.42.5(pid=28680): stderr: | 20221212211354763 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211354764 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211354764 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211354764 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211354765 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211354765 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211354765 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:13:56.320574 run osmo-stp_10.42.42.5(pid=28680): stdout: | (launched: 2022-12-12_21:13:54.566803) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:13:56.455463 run osmo-stp_10.42.42.5(pid=28680): stderr: | 20221212211354763 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211354764 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211354764 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211354764 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211354765 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211354765 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211354765 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:13:56.616789 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28680): Process ended prematurely: osmo-stp_10.42.42.5(pid=28680) [trial-2382↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28680)] [trial-2382↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 21:13:56.626647 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 21:13:56.655763 run osmo-hlr_10.42.42.2(pid=28677): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28677)] 21:13:56.708020 run osmo-hlr_10.42.42.2(pid=28677): stdout: | (launched: 2022-12-12_21:13:53.526615) 21:13:56.761863 run osmo-hlr_10.42.42.2(pid=28677): stderr: | 20221212211353706 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212211353707 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212211353707 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212211353707 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212211353707 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212211353707 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212211353719 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212211353728 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212211353728 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212211353728 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:13:56.837020 run osmo-msc_10.42.42.6(pid=28683): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28683)] 21:13:56.889285 run osmo-msc_10.42.42.6(pid=28683): stdout: | (launched: 2022-12-12_21:13:55.644026) 21:13:56.942978 run osmo-msc_10.42.42.6(pid=28683): stderr: | 20221212211355973 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212211355973 DLGLOBAL DEBUG validating counter group 0x7ff1a5d7dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212211355973 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212211355973 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212211355973 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212211355973 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212211355975 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212211355975 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212211355976 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212211355976 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:13:56.997241 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28676): Terminating (SIGTERM) 21:13:57.040576 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28679): Terminating (SIGTERM) 21:13:57.083888 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28682): Terminating (SIGTERM) 21:13:57.127411 --- ParallelTerminationStrategy: PID 28676 died... 21:13:57.148019 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28676): Terminated: ok {rc=0} 21:13:57.196530 --- ParallelTerminationStrategy: PID 28679 died... 21:13:57.216815 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28679): Terminated: ok {rc=0} 21:13:57.264860 --- ParallelTerminationStrategy: PID 28682 died... 21:13:57.285548 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28682): Terminated: ok {rc=0} 21:13:57.376209 bus /sierra_3: Setting Powered False 21:13:58.477635 bus /sierra_3: Setting Powered False 21:13:59.592745 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2382 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 21:14:00.746844 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:14:00.759429 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 21:14:00.837280 tst mo_mt_call_osmux.py: using LAC 31543 21:14:00.991289 tst mo_mt_call_osmux.py: using RAC 178 21:14:01.126312 tst mo_mt_call_osmux.py: using CellId 31543 21:14:01.261239 tst mo_mt_call_osmux.py: using BVCI 31544 21:14:01.388185 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:14:01.401358 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:14:01.415382 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:14:01.429358 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:14:01.442306 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:14:01.455768 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 21:14:01.583349 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 21:14:01.714598 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:14:02.223583 run create_hlr_db(pid=28685): Launched 21:14:02.358651 bus /sierra_2: Setting Powered False 21:14:03.426070 run create_hlr_db(pid=28685): Terminated: ok {rc=0} 21:14:03.874176 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28687): Launched 21:14:04.189992 run osmo-hlr_10.42.42.2(pid=28688): Launched 21:14:04.309867 run osmo-stp_10.42.42.5: Starting osmo-stp 21:14:04.891583 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28690): Launched 21:14:05.230784 run osmo-stp_10.42.42.5(pid=28691): Launched 21:14:05.360477 run osmo-msc_10.42.42.6: Starting osmo-msc 21:14:05.970251 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28693): Launched 21:14:06.309112 run osmo-msc_10.42.42.6(pid=28694): Launched 21:14:06.496124 run osmo-stp_10.42.42.5(pid=28691): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28691)] 21:14:06.639576 run osmo-stp_10.42.42.5(pid=28691): stdout: | (launched: 2022-12-12_21:14:05.169073) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:14:06.782004 run osmo-stp_10.42.42.5(pid=28691): stderr: | 20221212211405364 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211405364 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211405364 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211405365 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211405365 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211405365 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211405365 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:14:06.923684 run osmo-stp_10.42.42.5(pid=28691): stdout: | (launched: 2022-12-12_21:14:05.169073) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:14:07.058661 run osmo-stp_10.42.42.5(pid=28691): stderr: | 20221212211405364 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211405364 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211405364 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211405365 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211405365 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211405365 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211405365 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:14:07.219769 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28691): Process ended prematurely: osmo-stp_10.42.42.5(pid=28691) [trial-2382↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28691)] [trial-2382↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 21:14:07.229571 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 21:14:07.258721 run osmo-hlr_10.42.42.2(pid=28688): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28688)] 21:14:07.310759 run osmo-hlr_10.42.42.2(pid=28688): stdout: | (launched: 2022-12-12_21:14:04.131743) 21:14:07.364633 run osmo-hlr_10.42.42.2(pid=28688): stderr: | 20221212211404311 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212211404311 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212211404311 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212211404311 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212211404311 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212211404311 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212211404323 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212211404331 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212211404332 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212211404332 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:14:07.439266 run osmo-msc_10.42.42.6(pid=28694): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28694)] 21:14:07.491287 run osmo-msc_10.42.42.6(pid=28694): stdout: | (launched: 2022-12-12_21:14:06.247095) 21:14:07.544922 run osmo-msc_10.42.42.6(pid=28694): stderr: | 20221212211406574 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212211406574 DLGLOBAL DEBUG validating counter group 0x7faf9633fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212211406574 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212211406574 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212211406574 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212211406575 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212211406576 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212211406577 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212211406577 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212211406577 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:14:07.599215 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28687): Terminating (SIGTERM) 21:14:07.642542 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28690): Terminating (SIGTERM) 21:14:07.685994 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28693): Terminating (SIGTERM) 21:14:07.729651 --- ParallelTerminationStrategy: PID 28687 died... 21:14:07.750062 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28687): Terminated: ok {rc=0} 21:14:07.798693 --- ParallelTerminationStrategy: PID 28690 died... 21:14:07.818827 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28690): Terminated: ok {rc=0} 21:14:07.867016 --- ParallelTerminationStrategy: PID 28693 died... 21:14:07.887029 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28693): Terminated: ok {rc=0} 21:14:07.976938 bus /sierra_3: Setting Powered False 21:14:09.078029 bus /sierra_3: Setting Powered False 21:14:10.194953 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 21:14:11.442733 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:14:11.449111 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 21:14:11.481640 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 21:14:11.508253 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 21:14:11.560996 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 21:14:11.594390 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 21:14:11.621174 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 21:14:12.170842 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 21:14:12.221186 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:14:12.232257 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 21:14:12.300816 tst mo_mt_call.py: using LAC 31544 21:14:12.424438 tst mo_mt_call.py: using RAC 179 21:14:12.548408 tst mo_mt_call.py: using CellId 31544 21:14:12.671920 tst mo_mt_call.py: using BVCI 31545 21:14:12.797065 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:14:12.809337 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:14:12.820828 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:14:12.832901 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:14:12.845071 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:14:12.857156 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 21:14:12.977365 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 21:14:13.095417 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:14:13.581992 run create_hlr_db(pid=28699): Launched 21:14:13.713909 bus /sierra_2: Setting Powered False 21:14:14.776938 run create_hlr_db(pid=28699): Terminated: ok {rc=0} 21:14:15.215463 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28701): Launched 21:14:15.530450 run osmo-hlr_10.42.42.2(pid=28702): Launched 21:14:15.650553 run osmo-stp_10.42.42.5: Starting osmo-stp 21:14:16.211667 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28704): Launched 21:14:16.578943 run osmo-stp_10.42.42.5(pid=28705): Launched 21:14:16.703241 run osmo-msc_10.42.42.6: Starting osmo-msc 21:14:17.393587 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28708): Launched 21:14:17.710966 run osmo-msc_10.42.42.6(pid=28709): Launched 21:14:17.889399 run osmo-stp_10.42.42.5(pid=28705): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28705)] 21:14:18.021617 run osmo-stp_10.42.42.5(pid=28705): stdout: | (launched: 2022-12-12_21:14:16.519773) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:14:18.154179 run osmo-stp_10.42.42.5(pid=28705): stderr: | 20221212211416887 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211416887 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211416888 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211416888 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211416889 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211416889 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211416889 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:14:18.285184 run osmo-stp_10.42.42.5(pid=28705): stdout: | (launched: 2022-12-12_21:14:16.519773) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:14:18.410460 run osmo-stp_10.42.42.5(pid=28705): stderr: | 20221212211416887 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211416887 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211416888 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211416888 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211416889 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211416889 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211416889 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:14:18.560231 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28705): Process ended prematurely: osmo-stp_10.42.42.5(pid=28705) [trial-2382↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28705)] [trial-2382↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 21:14:18.569357 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 21:14:18.596265 run osmo-hlr_10.42.42.2(pid=28702): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28702)] 21:14:18.645482 run osmo-hlr_10.42.42.2(pid=28702): stdout: | (launched: 2022-12-12_21:14:15.472365) 21:14:18.696439 run osmo-hlr_10.42.42.2(pid=28702): stderr: | 20221212211415652 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212211415652 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212211415652 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212211415652 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212211415652 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212211415652 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212211415664 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212211415672 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212211415673 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212211415673 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:14:18.767821 run osmo-msc_10.42.42.6(pid=28709): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28709)] 21:14:18.817218 run osmo-msc_10.42.42.6(pid=28709): stdout: | (launched: 2022-12-12_21:14:17.652263) 21:14:18.868350 run osmo-msc_10.42.42.6(pid=28709): stderr: | 20221212211417932 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212211417932 DLGLOBAL DEBUG validating counter group 0x7fb111373c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212211417932 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212211417933 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212211417933 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212211417933 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212211417935 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212211417935 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212211417935 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212211417935 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:14:18.919442 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28701): Terminating (SIGTERM) 21:14:18.960150 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28704): Terminating (SIGTERM) 21:14:19.001039 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28708): Terminating (SIGTERM) 21:14:19.042635 --- ParallelTerminationStrategy: PID 28701 died... 21:14:19.062434 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28701): Terminated: ok {rc=0} 21:14:19.107703 --- ParallelTerminationStrategy: PID 28704 died... 21:14:19.126962 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28704): Terminated: ok {rc=0} 21:14:19.172071 --- ParallelTerminationStrategy: PID 28708 died... 21:14:19.191158 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28708): Terminated: ok {rc=0} 21:14:19.279344 bus /sierra_3: Setting Powered False 21:14:20.380278 bus /sierra_3: Setting Powered False 21:14:21.497638 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2382 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 21:14:22.647231 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:14:22.659162 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 21:14:22.728441 tst mo_mt_call_osmux.py: using LAC 31545 21:14:22.853334 tst mo_mt_call_osmux.py: using RAC 180 21:14:22.978811 tst mo_mt_call_osmux.py: using CellId 31545 21:14:23.105456 tst mo_mt_call_osmux.py: using BVCI 31546 21:14:23.218841 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:14:23.230210 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:14:23.241302 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:14:23.252300 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:14:23.263623 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:14:23.274749 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 21:14:23.398273 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 21:14:23.516768 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:14:24.004559 run create_hlr_db(pid=28711): Launched 21:14:24.133182 bus /sierra_2: Setting Powered False 21:14:25.196028 run create_hlr_db(pid=28711): Terminated: ok {rc=0} 21:14:25.654292 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28713): Launched 21:14:25.993489 run osmo-hlr_10.42.42.2(pid=28714): Launched 21:14:26.124514 run osmo-stp_10.42.42.5: Starting osmo-stp 21:14:26.705662 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28716): Launched 21:14:27.044560 run osmo-stp_10.42.42.5(pid=28717): Launched 21:14:27.174243 run osmo-msc_10.42.42.6: Starting osmo-msc 21:14:27.783433 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28719): Launched 21:14:28.120331 run osmo-msc_10.42.42.6(pid=28720): Launched 21:14:28.309365 run osmo-stp_10.42.42.5(pid=28717): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28717)] 21:14:28.451488 run osmo-stp_10.42.42.5(pid=28717): stdout: | (launched: 2022-12-12_21:14:26.982555) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:14:28.593715 run osmo-stp_10.42.42.5(pid=28717): stderr: | 20221212211427179 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211427179 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211427179 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211427180 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211427180 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211427180 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211427180 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:14:28.734125 run osmo-stp_10.42.42.5(pid=28717): stdout: | (launched: 2022-12-12_21:14:26.982555) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:14:28.869316 run osmo-stp_10.42.42.5(pid=28717): stderr: | 20221212211427179 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211427179 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211427179 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211427180 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211427180 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211427180 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211427180 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:14:29.030360 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28717): Process ended prematurely: osmo-stp_10.42.42.5(pid=28717) [trial-2382↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28717)] [trial-2382↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 21:14:29.040262 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 21:14:29.069284 run osmo-hlr_10.42.42.2(pid=28714): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28714)] 21:14:29.121284 run osmo-hlr_10.42.42.2(pid=28714): stdout: | (launched: 2022-12-12_21:14:25.931285) 21:14:29.174969 run osmo-hlr_10.42.42.2(pid=28714): stderr: | 20221212211426132 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212211426132 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212211426132 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212211426132 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212211426132 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212211426132 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212211426145 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212211426153 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212211426154 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212211426154 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:14:29.249455 run osmo-msc_10.42.42.6(pid=28720): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28720)] 21:14:29.301222 run osmo-msc_10.42.42.6(pid=28720): stdout: | (launched: 2022-12-12_21:14:28.058525) 21:14:29.354665 run osmo-msc_10.42.42.6(pid=28720): stderr: | 20221212211428384 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212211428384 DLGLOBAL DEBUG validating counter group 0x7fad462c2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212211428384 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212211428384 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212211428385 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212211428385 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212211428387 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212211428387 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212211428387 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212211428387 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:14:29.408793 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28713): Terminating (SIGTERM) 21:14:29.451945 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28716): Terminating (SIGTERM) 21:14:29.495496 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28719): Terminating (SIGTERM) 21:14:29.539030 --- ParallelTerminationStrategy: PID 28713 died... 21:14:29.559582 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28713): Terminated: ok {rc=0} 21:14:29.607753 --- ParallelTerminationStrategy: PID 28716 died... 21:14:29.627802 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28716): Terminated: ok {rc=0} 21:14:29.675612 --- ParallelTerminationStrategy: PID 28719 died... 21:14:29.695871 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28719): Terminated: ok {rc=0} 21:14:29.786207 bus /sierra_3: Setting Powered False 21:14:30.899433 bus /sierra_3: Setting Powered False 21:14:32.057282 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 21:14:33.323641 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:14:33.331118 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 21:14:33.365697 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 21:14:33.393570 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 21:14:33.444852 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 21:14:33.478733 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 21:14:33.506743 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 21:14:34.059693 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 21:14:34.114157 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:14:34.125941 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 21:14:34.194767 tst mo_mt_call.py: using LAC 31546 21:14:34.325360 tst mo_mt_call.py: using RAC 181 21:14:34.461342 tst mo_mt_call.py: using CellId 31546 21:14:34.584706 tst mo_mt_call.py: using BVCI 31547 21:14:34.699827 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:14:34.711035 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:14:34.722142 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:14:34.733025 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:14:34.743978 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:14:34.754888 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 21:14:34.877240 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 21:14:35.003921 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:14:35.526857 run create_hlr_db(pid=28726): Launched 21:14:35.656412 bus /sierra_2: Setting Powered False 21:14:36.723970 run create_hlr_db(pid=28726): Terminated: ok {rc=0} 21:14:37.173517 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28728): Launched 21:14:37.490808 run osmo-hlr_10.42.42.2(pid=28729): Launched 21:14:37.611322 run osmo-stp_10.42.42.5: Starting osmo-stp 21:14:38.156401 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28731): Launched 21:14:38.471612 run osmo-stp_10.42.42.5(pid=28732): Launched 21:14:38.592088 run osmo-msc_10.42.42.6: Starting osmo-msc 21:14:39.160197 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28734): Launched 21:14:39.474998 run osmo-msc_10.42.42.6(pid=28735): Launched 21:14:39.652216 run osmo-stp_10.42.42.5(pid=28732): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28732)] 21:14:39.784743 run osmo-stp_10.42.42.5(pid=28732): stdout: | (launched: 2022-12-12_21:14:38.413555) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:14:39.917306 run osmo-stp_10.42.42.5(pid=28732): stderr: | 20221212211438585 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211438585 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211438585 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211438586 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211438588 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211438588 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211438588 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:14:40.059037 run osmo-stp_10.42.42.5(pid=28732): stdout: | (launched: 2022-12-12_21:14:38.413555) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:14:40.194354 run osmo-stp_10.42.42.5(pid=28732): stderr: | 20221212211438585 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211438585 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211438585 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211438586 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211438588 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211438588 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211438588 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:14:40.356477 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28732): Process ended prematurely: osmo-stp_10.42.42.5(pid=28732) [trial-2382↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28732)] [trial-2382↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 21:14:40.366451 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 21:14:40.395678 run osmo-hlr_10.42.42.2(pid=28729): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28729)] 21:14:40.448257 run osmo-hlr_10.42.42.2(pid=28729): stdout: | (launched: 2022-12-12_21:14:37.432374) 21:14:40.502484 run osmo-hlr_10.42.42.2(pid=28729): stderr: | 20221212211437613 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212211437613 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212211437613 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212211437613 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212211437613 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212211437613 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212211437625 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212211437634 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212211437634 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212211437634 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:14:40.577908 run osmo-msc_10.42.42.6(pid=28735): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28735)] 21:14:40.630066 run osmo-msc_10.42.42.6(pid=28735): stdout: | (launched: 2022-12-12_21:14:39.416860) 21:14:40.683974 run osmo-msc_10.42.42.6(pid=28735): stderr: | 20221212211439693 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212211439694 DLGLOBAL DEBUG validating counter group 0x7fcacc88ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212211439694 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212211439694 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212211439694 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212211439694 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212211439696 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212211439696 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212211439696 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212211439696 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:14:40.738377 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28728): Terminating (SIGTERM) 21:14:40.782066 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28731): Terminating (SIGTERM) 21:14:40.825818 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28734): Terminating (SIGTERM) 21:14:40.869511 --- ParallelTerminationStrategy: PID 28728 died... 21:14:40.890127 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28728): Terminated: ok {rc=0} 21:14:40.938610 --- ParallelTerminationStrategy: PID 28731 died... 21:14:40.958925 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28731): Terminated: ok {rc=0} 21:14:41.007079 --- ParallelTerminationStrategy: PID 28734 died... 21:14:41.027558 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28734): Terminated: ok {rc=0} 21:14:41.118384 bus /sierra_3: Setting Powered False 21:14:42.220267 bus /sierra_3: Setting Powered False 21:14:43.338944 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2382 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 21:14:44.491969 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:14:44.504415 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 21:14:44.576328 tst mo_mt_call_osmux.py: using LAC 31547 21:14:44.711484 tst mo_mt_call_osmux.py: using RAC 182 21:14:44.856654 tst mo_mt_call_osmux.py: using CellId 31547 21:14:44.991577 tst mo_mt_call_osmux.py: using BVCI 31548 21:14:45.115897 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:14:45.127646 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:14:45.139227 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:14:45.151120 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:14:45.163040 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:14:45.174883 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 21:14:45.294226 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 21:14:45.417821 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:14:45.967915 run create_hlr_db(pid=28737): Launched 21:14:46.140586 bus /sierra_2: Setting Powered False 21:14:47.206033 run create_hlr_db(pid=28737): Terminated: ok {rc=0} 21:14:47.671860 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28739): Launched 21:14:48.009507 run osmo-hlr_10.42.42.2(pid=28740): Launched 21:14:48.139771 run osmo-stp_10.42.42.5: Starting osmo-stp 21:14:48.721629 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28742): Launched 21:14:49.062401 run osmo-stp_10.42.42.5(pid=28743): Launched 21:14:49.192199 run osmo-msc_10.42.42.6: Starting osmo-msc 21:14:49.802598 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28745): Launched 21:14:50.141721 run osmo-msc_10.42.42.6(pid=28746): Launched 21:14:50.329126 run osmo-stp_10.42.42.5(pid=28743): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28743)] 21:14:50.471837 run osmo-stp_10.42.42.5(pid=28743): stdout: | (launched: 2022-12-12_21:14:49.000147) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:14:50.614239 run osmo-stp_10.42.42.5(pid=28743): stderr: | 20221212211449196 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211449196 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211449196 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211449197 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211449197 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211449197 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211449197 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:14:50.755006 run osmo-stp_10.42.42.5(pid=28743): stdout: | (launched: 2022-12-12_21:14:49.000147) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:14:50.890243 run osmo-stp_10.42.42.5(pid=28743): stderr: | 20221212211449196 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211449196 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211449196 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211449197 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211449197 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211449197 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211449197 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:14:51.051459 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28743): Process ended prematurely: osmo-stp_10.42.42.5(pid=28743) [trial-2382↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28743)] [trial-2382↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 21:14:51.061387 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 21:14:51.090879 run osmo-hlr_10.42.42.2(pid=28740): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28740)] 21:14:51.143049 run osmo-hlr_10.42.42.2(pid=28740): stdout: | (launched: 2022-12-12_21:14:47.947547) 21:14:51.196897 run osmo-hlr_10.42.42.2(pid=28740): stderr: | 20221212211448146 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212211448146 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212211448146 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212211448146 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212211448146 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212211448146 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212211448161 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212211448171 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212211448171 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212211448171 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:14:51.271718 run osmo-msc_10.42.42.6(pid=28746): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28746)] 21:14:51.324050 run osmo-msc_10.42.42.6(pid=28746): stdout: | (launched: 2022-12-12_21:14:50.079838) 21:14:51.377421 run osmo-msc_10.42.42.6(pid=28746): stderr: | 20221212211450407 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212211450407 DLGLOBAL DEBUG validating counter group 0x7f5a9f8fec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212211450407 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212211450407 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212211450407 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212211450408 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212211450409 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212211450410 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212211450410 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212211450410 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:14:51.431519 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28739): Terminating (SIGTERM) 21:14:51.474930 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28742): Terminating (SIGTERM) 21:14:51.518219 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28745): Terminating (SIGTERM) 21:14:51.562022 --- ParallelTerminationStrategy: PID 28739 died... 21:14:51.582712 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28739): Terminated: ok {rc=0} 21:14:51.630821 --- ParallelTerminationStrategy: PID 28742 died... 21:14:51.650973 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28742): Terminated: ok {rc=0} 21:14:51.698560 --- ParallelTerminationStrategy: PID 28745 died... 21:14:51.718867 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28745): Terminated: ok {rc=0} 21:14:51.809078 bus /sierra_3: Setting Powered False 21:14:52.910771 bus /sierra_3: Setting Powered False 21:14:54.028437 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 21:14:55.288422 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:14:55.295769 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 21:14:55.330680 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 21:14:55.358639 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 21:14:55.411035 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 21:14:55.443628 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 21:14:55.470301 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 21:14:56.023073 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 21:14:56.073384 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:14:56.084727 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 21:14:56.152563 tst mo_mt_call.py: using LAC 31548 21:14:56.275717 tst mo_mt_call.py: using RAC 183 21:14:56.401089 tst mo_mt_call.py: using CellId 31548 21:14:56.522872 tst mo_mt_call.py: using BVCI 31549 21:14:56.639734 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:14:56.650995 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:14:56.661985 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:14:56.672912 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:14:56.684068 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:14:56.695057 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 21:14:56.816366 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 21:14:56.941524 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:14:57.464742 run create_hlr_db(pid=28752): Launched 21:14:57.593946 bus /sierra_2: Setting Powered False 21:14:58.661575 run create_hlr_db(pid=28752): Terminated: ok {rc=0} 21:14:59.110421 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28754): Launched 21:14:59.426921 run osmo-hlr_10.42.42.2(pid=28755): Launched 21:14:59.545856 run osmo-stp_10.42.42.5: Starting osmo-stp 21:15:00.091839 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28757): Launched 21:15:00.406595 run osmo-stp_10.42.42.5(pid=28758): Launched 21:15:00.527638 run osmo-msc_10.42.42.6: Starting osmo-msc 21:15:01.146198 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28761): Launched 21:15:01.529702 run osmo-msc_10.42.42.6(pid=28764): Launched 21:15:01.758899 run osmo-stp_10.42.42.5(pid=28758): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28758)] 21:15:01.998373 run osmo-stp_10.42.42.5(pid=28758): stdout: | (launched: 2022-12-12_21:15:00.348634) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:15:02.331097 run osmo-stp_10.42.42.5(pid=28758): stderr: | 20221212211500519 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211500520 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211500520 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211500520 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211500522 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211500523 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211500523 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:15:02.561299 run osmo-stp_10.42.42.5(pid=28758): stdout: | (launched: 2022-12-12_21:15:00.348634) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:15:02.696931 run osmo-stp_10.42.42.5(pid=28758): stderr: | 20221212211500519 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211500520 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211500520 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211500520 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211500522 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211500523 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211500523 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:15:02.859031 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28758): Process ended prematurely: osmo-stp_10.42.42.5(pid=28758) [trial-2382↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28758)] [trial-2382↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 21:15:02.869074 tst mo_mt_call.py:8: Test FAILED (6.8 sec) 21:15:02.899694 run osmo-hlr_10.42.42.2(pid=28755): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28755)] 21:15:02.952874 run osmo-hlr_10.42.42.2(pid=28755): stdout: | (launched: 2022-12-12_21:14:59.367652) 21:15:03.008076 run osmo-hlr_10.42.42.2(pid=28755): stderr: | 20221212211459546 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212211459546 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212211459546 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212211459546 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212211459546 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212211459546 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212211459559 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212211459569 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212211459570 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212211459570 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:15:03.084334 run osmo-msc_10.42.42.6(pid=28764): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28764)] 21:15:03.137452 run osmo-msc_10.42.42.6(pid=28764): stdout: | (launched: 2022-12-12_21:15:01.461455) 21:15:03.192299 run osmo-msc_10.42.42.6(pid=28764): stderr: | 20221212211502156 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212211502156 DLGLOBAL DEBUG validating counter group 0x7fe94cb08c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212211502156 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212211502156 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212211502156 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212211502156 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212211502158 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212211502159 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212211502159 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212211502159 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:15:03.247372 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28754): Terminating (SIGTERM) 21:15:03.291513 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28757): Terminating (SIGTERM) 21:15:03.335875 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28761): Terminating (SIGTERM) 21:15:03.380891 --- ParallelTerminationStrategy: PID 28754 died... 21:15:03.401994 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28754): Terminated: ok {rc=0} 21:15:03.451935 --- ParallelTerminationStrategy: PID 28757 died... 21:15:03.472537 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28757): Terminated: ok {rc=0} 21:15:03.522263 --- ParallelTerminationStrategy: PID 28761 died... 21:15:03.542684 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28761): Terminated: ok {rc=0} 21:15:03.635520 bus /sierra_3: Setting Powered False 21:15:04.737833 bus /sierra_3: Setting Powered False 21:15:05.859601 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2382 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 21:15:07.010325 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:15:07.022285 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 21:15:07.095991 tst mo_mt_call_osmux.py: using LAC 31549 21:15:07.220209 tst mo_mt_call_osmux.py: using RAC 184 21:15:07.346381 tst mo_mt_call_osmux.py: using CellId 31549 21:15:07.470039 tst mo_mt_call_osmux.py: using BVCI 31550 21:15:07.584225 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:15:07.595552 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:15:07.606650 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:15:07.617707 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:15:07.628829 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:15:07.639881 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 21:15:07.757511 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 21:15:07.876735 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:15:08.363997 run create_hlr_db(pid=28768): Launched 21:15:08.494419 bus /sierra_2: Setting Powered False 21:15:09.557775 run create_hlr_db(pid=28768): Terminated: ok {rc=0} 21:15:09.996231 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28770): Launched 21:15:10.311924 run osmo-hlr_10.42.42.2(pid=28771): Launched 21:15:10.431838 run osmo-stp_10.42.42.5: Starting osmo-stp 21:15:10.974747 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28773): Launched 21:15:11.288198 run osmo-stp_10.42.42.5(pid=28774): Launched 21:15:11.407558 run osmo-msc_10.42.42.6: Starting osmo-msc 21:15:11.975916 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28776): Launched 21:15:12.290776 run osmo-msc_10.42.42.6(pid=28777): Launched 21:15:12.467912 run osmo-stp_10.42.42.5(pid=28774): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28774)] 21:15:12.599880 run osmo-stp_10.42.42.5(pid=28774): stdout: | (launched: 2022-12-12_21:15:11.230167) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:15:12.731949 run osmo-stp_10.42.42.5(pid=28774): stderr: | 20221212211511406 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211511407 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211511407 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211511407 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211511408 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211511408 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211511408 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:15:12.862742 run osmo-stp_10.42.42.5(pid=28774): stdout: | (launched: 2022-12-12_21:15:11.230167) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:15:12.987419 run osmo-stp_10.42.42.5(pid=28774): stderr: | 20221212211511406 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211511407 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211511407 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211511407 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211511408 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211511408 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211511408 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:15:13.136509 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28774): Process ended prematurely: osmo-stp_10.42.42.5(pid=28774) [trial-2382↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28774)] [trial-2382↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 21:15:13.145627 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 21:15:13.172505 run osmo-hlr_10.42.42.2(pid=28771): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28771)] 21:15:13.221274 run osmo-hlr_10.42.42.2(pid=28771): stdout: | (launched: 2022-12-12_21:15:10.253852) 21:15:13.272056 run osmo-hlr_10.42.42.2(pid=28771): stderr: | 20221212211510432 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212211510432 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212211510432 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212211510432 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212211510432 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212211510432 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212211510444 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212211510453 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212211510453 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212211510453 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:15:13.342967 run osmo-msc_10.42.42.6(pid=28777): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28777)] 21:15:13.391631 run osmo-msc_10.42.42.6(pid=28777): stdout: | (launched: 2022-12-12_21:15:12.232574) 21:15:13.442091 run osmo-msc_10.42.42.6(pid=28777): stderr: | 20221212211512507 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212211512508 DLGLOBAL DEBUG validating counter group 0x7fe5a2168c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212211512508 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212211512508 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212211512508 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212211512508 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212211512510 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212211512510 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212211512511 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212211512511 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:15:13.493221 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28770): Terminating (SIGTERM) 21:15:13.533352 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28773): Terminating (SIGTERM) 21:15:13.573617 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28776): Terminating (SIGTERM) 21:15:13.614241 --- ParallelTerminationStrategy: PID 28770 died... 21:15:13.633796 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28770): Terminated: ok {rc=0} 21:15:13.678631 --- ParallelTerminationStrategy: PID 28773 died... 21:15:13.697599 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28773): Terminated: ok {rc=0} 21:15:13.742358 --- ParallelTerminationStrategy: PID 28776 died... 21:15:13.761352 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28776): Terminated: ok {rc=0} 21:15:13.848271 bus /sierra_3: Setting Powered False 21:15:14.949934 bus /sierra_3: Setting Powered False 21:15:16.072068 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 21:15:17.336143 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:15:17.342671 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 21:15:17.375119 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 21:15:17.401575 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 21:15:17.452461 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 21:15:17.485037 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 21:15:17.511690 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 21:15:18.064503 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 21:15:18.114704 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:15:18.125959 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 21:15:18.194666 tst mo_mt_call.py: using LAC 31550 21:15:18.320194 tst mo_mt_call.py: using RAC 185 21:15:18.452895 tst mo_mt_call.py: using CellId 31550 21:15:18.584893 tst mo_mt_call.py: using BVCI 31551 21:15:18.707720 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:15:18.719760 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:15:18.731525 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:15:18.743525 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:15:18.755559 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:15:18.767364 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:15:18.890022 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:15:19.010434 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:15:19.498690 run create_hlr_db(pid=28782): Launched 21:15:19.629779 bus /sierra_2: Setting Powered False 21:15:20.692746 run create_hlr_db(pid=28782): Terminated: ok {rc=0} 21:15:21.151279 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28784): Launched 21:15:21.489388 run osmo-hlr_10.42.42.2(pid=28785): Launched 21:15:21.618504 run osmo-stp_10.42.42.5: Starting osmo-stp 21:15:22.200745 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28787): Launched 21:15:22.539336 run osmo-stp_10.42.42.5(pid=28788): Launched 21:15:22.669485 run osmo-msc_10.42.42.6: Starting osmo-msc 21:15:23.279055 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28790): Launched 21:15:23.618481 run osmo-msc_10.42.42.6(pid=28791): Launched 21:15:23.807280 run osmo-stp_10.42.42.5(pid=28788): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28788)] 21:15:23.950599 run osmo-stp_10.42.42.5(pid=28788): stdout: | (launched: 2022-12-12_21:15:22.477626) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:15:24.093666 run osmo-stp_10.42.42.5(pid=28788): stderr: | 20221212211522673 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211522674 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211522674 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211522674 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211522675 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211522675 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211522675 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:15:24.234711 run osmo-stp_10.42.42.5(pid=28788): stdout: | (launched: 2022-12-12_21:15:22.477626) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:15:24.369711 run osmo-stp_10.42.42.5(pid=28788): stderr: | 20221212211522673 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211522674 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211522674 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211522674 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211522675 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211522675 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211522675 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:15:24.530600 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28788): Process ended prematurely: osmo-stp_10.42.42.5(pid=28788) [trial-2382↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28788)] [trial-2382↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 21:15:24.540401 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 21:15:24.569663 run osmo-hlr_10.42.42.2(pid=28785): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28785)] 21:15:24.621431 run osmo-hlr_10.42.42.2(pid=28785): stdout: | (launched: 2022-12-12_21:15:21.427363) 21:15:24.674970 run osmo-hlr_10.42.42.2(pid=28785): stderr: | 20221212211521631 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212211521631 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212211521631 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212211521631 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212211521631 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212211521631 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212211521644 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212211521652 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212211521652 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212211521652 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:15:24.749445 run osmo-msc_10.42.42.6(pid=28791): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28791)] 21:15:24.800868 run osmo-msc_10.42.42.6(pid=28791): stdout: | (launched: 2022-12-12_21:15:23.556178) 21:15:24.854573 run osmo-msc_10.42.42.6(pid=28791): stderr: | 20221212211523884 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212211523884 DLGLOBAL DEBUG validating counter group 0x7f68318ccc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212211523884 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212211523884 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212211523884 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212211523884 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212211523886 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212211523886 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212211523887 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212211523887 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:15:24.908762 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28784): Terminating (SIGTERM) 21:15:24.951759 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28787): Terminating (SIGTERM) 21:15:24.994942 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28790): Terminating (SIGTERM) 21:15:25.038122 --- ParallelTerminationStrategy: PID 28784 died... 21:15:25.058757 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28784): Terminated: ok {rc=0} 21:15:25.106942 --- ParallelTerminationStrategy: PID 28787 died... 21:15:25.127142 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28787): Terminated: ok {rc=0} 21:15:25.175024 --- ParallelTerminationStrategy: PID 28790 died... 21:15:25.195134 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28790): Terminated: ok {rc=0} 21:15:25.286274 bus /sierra_3: Setting Powered False 21:15:26.387977 bus /sierra_3: Setting Powered False 21:15:27.507878 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2382 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 21:15:28.663911 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:15:28.676497 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 21:15:28.749189 tst mo_mt_call_osmux.py: using LAC 31551 21:15:28.882681 tst mo_mt_call_osmux.py: using RAC 186 21:15:29.014688 tst mo_mt_call_osmux.py: using CellId 31551 21:15:29.146636 tst mo_mt_call_osmux.py: using BVCI 31552 21:15:29.270068 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:15:29.281920 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:15:29.293953 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:15:29.305735 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:15:29.317669 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:15:29.329634 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:15:29.449710 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:15:29.572508 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:15:30.063207 run create_hlr_db(pid=28793): Launched 21:15:30.192115 bus /sierra_2: Setting Powered False 21:15:31.257609 run create_hlr_db(pid=28793): Terminated: ok {rc=0} 21:15:31.738081 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28795): Launched 21:15:32.089713 run osmo-hlr_10.42.42.2(pid=28796): Launched 21:15:32.222801 run osmo-stp_10.42.42.5: Starting osmo-stp 21:15:32.766286 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28798): Launched 21:15:33.082990 run osmo-stp_10.42.42.5(pid=28799): Launched 21:15:33.204237 run osmo-msc_10.42.42.6: Starting osmo-msc 21:15:33.778134 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28801): Launched 21:15:34.092607 run osmo-msc_10.42.42.6(pid=28802): Launched 21:15:34.267343 run osmo-stp_10.42.42.5(pid=28799): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28799)] 21:15:34.399772 run osmo-stp_10.42.42.5(pid=28799): stdout: | (launched: 2022-12-12_21:15:33.024631) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:15:34.532357 run osmo-stp_10.42.42.5(pid=28799): stderr: | 20221212211533198 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211533199 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211533199 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211533199 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211533200 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211533200 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211533200 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:15:34.663044 run osmo-stp_10.42.42.5(pid=28799): stdout: | (launched: 2022-12-12_21:15:33.024631) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:15:34.787585 run osmo-stp_10.42.42.5(pid=28799): stderr: | 20221212211533198 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211533199 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211533199 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211533199 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211533200 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211533200 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211533200 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:15:34.936788 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28799): Process ended prematurely: osmo-stp_10.42.42.5(pid=28799) [trial-2382↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28799)] [trial-2382↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 21:15:34.945882 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 21:15:34.972698 run osmo-hlr_10.42.42.2(pid=28796): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28796)] 21:15:35.021528 run osmo-hlr_10.42.42.2(pid=28796): stdout: | (launched: 2022-12-12_21:15:32.023179) 21:15:35.072028 run osmo-hlr_10.42.42.2(pid=28796): stderr: | 20221212211532262 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212211532263 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212211532263 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212211532263 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212211532263 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212211532263 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212211532278 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212211532287 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212211532287 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212211532288 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:15:35.142965 run osmo-msc_10.42.42.6(pid=28802): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28802)] 21:15:35.191640 run osmo-msc_10.42.42.6(pid=28802): stdout: | (launched: 2022-12-12_21:15:34.034351) 21:15:35.241974 run osmo-msc_10.42.42.6(pid=28802): stderr: | 20221212211534310 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212211534310 DLGLOBAL DEBUG validating counter group 0x7f7fae9c3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212211534310 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212211534310 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212211534310 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212211534310 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212211534312 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212211534312 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212211534313 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212211534313 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:15:35.292530 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28795): Terminating (SIGTERM) 21:15:35.333147 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28798): Terminating (SIGTERM) 21:15:35.373743 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28801): Terminating (SIGTERM) 21:15:35.414567 --- ParallelTerminationStrategy: PID 28795 died... 21:15:35.434114 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28795): Terminated: ok {rc=0} 21:15:35.479131 --- ParallelTerminationStrategy: PID 28798 died... 21:15:35.498232 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28798): Terminated: ok {rc=0} 21:15:35.543001 --- ParallelTerminationStrategy: PID 28801 died... 21:15:35.562025 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28801): Terminated: ok {rc=0} 21:15:35.647417 bus /sierra_3: Setting Powered False 21:15:36.746151 bus /sierra_3: Setting Powered False 21:15:37.862794 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 voice:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 21:15:39.114500 tst voice:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:15:39.120450 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 21:15:39.153154 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 21:15:39.179895 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 21:15:39.232993 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 21:15:39.266367 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 21:15:39.292848 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 21:15:39.841456 tst voice:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 21:15:39.891049 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:15:39.902121 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 21:15:39.976491 tst mo_mt_call.py: using LAC 31552 21:15:40.108518 tst mo_mt_call.py: using RAC 187 21:15:40.238342 tst mo_mt_call.py: using CellId 31552 21:15:40.369230 tst mo_mt_call.py: using BVCI 31553 21:15:40.492172 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:15:40.503923 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:15:40.515429 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:15:40.527273 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:15:40.539026 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:15:40.550805 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 21:15:40.668332 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 21:15:40.786799 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:15:41.276087 run create_hlr_db(pid=28807): Launched 21:15:41.405962 bus /sierra_2: Setting Powered False 21:15:42.469036 run create_hlr_db(pid=28807): Terminated: ok {rc=0} 21:15:42.932011 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28809): Launched 21:15:43.272424 run osmo-hlr_10.42.42.2(pid=28810): Launched 21:15:43.403091 run osmo-stp_10.42.42.5: Starting osmo-stp 21:15:43.983336 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28812): Launched 21:15:44.321235 run osmo-stp_10.42.42.5(pid=28813): Launched 21:15:44.451578 run osmo-msc_10.42.42.6: Starting osmo-msc 21:15:45.060939 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28815): Launched 21:15:45.400067 run osmo-msc_10.42.42.6(pid=28816): Launched 21:15:45.587543 run osmo-stp_10.42.42.5(pid=28813): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28813)] 21:15:45.729719 run osmo-stp_10.42.42.5(pid=28813): stdout: | (launched: 2022-12-12_21:15:44.259046) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:15:45.921829 run osmo-stp_10.42.42.5(pid=28813): stderr: | 20221212211544455 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211544455 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211544455 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211544456 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211544458 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211544459 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211544459 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:15:46.064477 run osmo-stp_10.42.42.5(pid=28813): stdout: | (launched: 2022-12-12_21:15:44.259046) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:15:46.205941 run osmo-stp_10.42.42.5(pid=28813): stderr: | 20221212211544455 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211544455 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211544455 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211544456 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211544458 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211544459 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211544459 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:15:46.370561 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28813): Process ended prematurely: osmo-stp_10.42.42.5(pid=28813) [trial-2382↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28813)] [trial-2382↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 21:15:46.381341 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 21:15:46.413593 run osmo-hlr_10.42.42.2(pid=28810): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28810)] 21:15:46.468101 run osmo-hlr_10.42.42.2(pid=28810): stdout: | (launched: 2022-12-12_21:15:43.210588) 21:15:46.524555 run osmo-hlr_10.42.42.2(pid=28810): stderr: | 20221212211543411 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212211543411 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212211543411 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212211543411 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212211543411 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212211543411 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212211543423 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212211543432 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212211543432 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212211543432 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:15:46.602970 run osmo-msc_10.42.42.6(pid=28816): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28816)] 21:15:46.657631 run osmo-msc_10.42.42.6(pid=28816): stdout: | (launched: 2022-12-12_21:15:45.338137) 21:15:46.713868 run osmo-msc_10.42.42.6(pid=28816): stderr: | 20221212211545663 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212211545664 DLGLOBAL DEBUG validating counter group 0x7f64133aac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212211545664 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212211545664 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212211545664 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212211545664 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212211545666 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212211545666 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212211545667 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212211545667 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:15:46.770646 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28809): Terminating (SIGTERM) 21:15:46.816052 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28812): Terminating (SIGTERM) 21:15:46.862122 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28815): Terminating (SIGTERM) 21:15:46.907894 --- ParallelTerminationStrategy: PID 28809 died... 21:15:46.929313 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28809): Terminated: ok {rc=0} 21:15:46.980852 --- ParallelTerminationStrategy: PID 28812 died... 21:15:47.002264 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28812): Terminated: ok {rc=0} 21:15:47.053799 --- ParallelTerminationStrategy: PID 28815 died... 21:15:47.075210 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28815): Terminated: ok {rc=0} 21:15:47.170322 bus /sierra_3: Setting Powered False 21:15:48.276883 bus /sierra_3: Setting Powered False 21:15:49.398696 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2382 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 21:15:50.549677 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:15:50.561430 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 21:15:50.631837 tst mo_mt_call_osmux.py: using LAC 31553 21:15:50.757145 tst mo_mt_call_osmux.py: using RAC 188 21:15:50.882664 tst mo_mt_call_osmux.py: using CellId 31553 21:15:51.009113 tst mo_mt_call_osmux.py: using BVCI 31554 21:15:51.125441 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:15:51.136447 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:15:51.147274 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:15:51.158016 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:15:51.168730 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:15:51.179580 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 21:15:51.299786 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 21:15:51.418516 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:15:51.909983 run create_hlr_db(pid=28818): Launched 21:15:52.038044 bus /sierra_2: Setting Powered False 21:15:53.101178 run create_hlr_db(pid=28818): Terminated: ok {rc=0} 21:15:53.539704 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28820): Launched 21:15:53.855841 run osmo-hlr_10.42.42.2(pid=28821): Launched 21:15:53.976932 run osmo-stp_10.42.42.5: Starting osmo-stp 21:15:54.517669 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28823): Launched 21:15:54.831375 run osmo-stp_10.42.42.5(pid=28824): Launched 21:15:54.950586 run osmo-msc_10.42.42.6: Starting osmo-msc 21:15:55.526453 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28826): Launched 21:15:55.845897 run osmo-msc_10.42.42.6(pid=28827): Launched 21:15:56.024908 run osmo-stp_10.42.42.5(pid=28824): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28824)] 21:15:56.159163 run osmo-stp_10.42.42.5(pid=28824): stdout: | (launched: 2022-12-12_21:15:54.773237) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:15:56.292404 run osmo-stp_10.42.42.5(pid=28824): stderr: | 20221212211554947 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211554947 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211554947 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211554948 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211554950 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211554950 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211554950 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:15:56.424134 run osmo-stp_10.42.42.5(pid=28824): stdout: | (launched: 2022-12-12_21:15:54.773237) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:15:56.550753 run osmo-stp_10.42.42.5(pid=28824): stderr: | 20221212211554947 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211554947 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211554947 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211554948 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211554950 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211554950 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211554950 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:15:56.701494 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28824): Process ended prematurely: osmo-stp_10.42.42.5(pid=28824) [trial-2382↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28824)] [trial-2382↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 21:15:56.710444 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 21:15:56.737618 run osmo-hlr_10.42.42.2(pid=28821): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28821)] 21:15:56.786957 run osmo-hlr_10.42.42.2(pid=28821): stdout: | (launched: 2022-12-12_21:15:53.797272) 21:15:56.837943 run osmo-hlr_10.42.42.2(pid=28821): stderr: | 20221212211553980 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212211553980 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212211553980 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212211553980 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212211553980 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212211553980 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212211553992 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212211554001 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212211554002 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212211554002 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:15:56.909292 run osmo-msc_10.42.42.6(pid=28827): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28827)] 21:15:56.958431 run osmo-msc_10.42.42.6(pid=28827): stdout: | (launched: 2022-12-12_21:15:55.786580) 21:15:57.009317 run osmo-msc_10.42.42.6(pid=28827): stderr: | 20221212211556062 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212211556062 DLGLOBAL DEBUG validating counter group 0x7f24a1fecc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212211556062 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212211556062 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212211556062 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212211556063 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212211556064 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212211556065 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212211556065 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212211556065 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:15:57.060617 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28820): Terminating (SIGTERM) 21:15:57.101699 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28823): Terminating (SIGTERM) 21:15:57.142587 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28826): Terminating (SIGTERM) 21:15:57.183737 --- ParallelTerminationStrategy: PID 28820 died... 21:15:57.203046 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28820): Terminated: ok {rc=0} 21:15:57.248343 --- ParallelTerminationStrategy: PID 28823 died... 21:15:57.267651 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28823): Terminated: ok {rc=0} 21:15:57.312695 --- ParallelTerminationStrategy: PID 28826 died... 21:15:57.331792 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28826): Terminated: ok {rc=0} 21:15:57.417831 bus /sierra_3: Setting Powered False 21:15:58.518314 bus /sierra_3: Setting Powered False 21:15:59.639344 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 voice:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 21:16:00.911702 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:16:00.924289 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 21:16:00.966228 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 21:16:00.995538 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 21:16:01.050161 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 21:16:01.093389 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 21:16:01.128885 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 21:16:01.691191 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 21:16:01.749486 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 21:16:01.762425 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 21:16:01.818857 tst mo_mt_call.py: using LAC 31554 21:16:01.984571 tst mo_mt_call.py: using RAC 189 21:16:02.110306 tst mo_mt_call.py: using CellId 31554 21:16:02.277390 tst mo_mt_call.py: using BVCI 31555 21:16:02.398566 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 21:16:02.410804 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 21:16:02.422761 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 21:16:02.435155 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 21:16:02.447177 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 21:16:02.459146 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 21:16:02.585192 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 21:16:02.706837 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:16:03.231040 run create_hlr_db(pid=28832): Launched 21:16:03.359397 bus /sierra_2: Setting Powered False 21:16:04.425886 run create_hlr_db(pid=28832): Terminated: ok {rc=0} 21:16:04.873073 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28834): Launched 21:16:05.188174 run osmo-hlr_10.42.42.2(pid=28835): Launched 21:16:05.310215 run osmo-stp_10.42.42.5: Starting osmo-stp 21:16:05.851368 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28837): Launched 21:16:06.166786 run osmo-stp_10.42.42.5(pid=28838): Launched 21:16:06.286943 run osmo-msc_10.42.42.6: Starting osmo-msc 21:16:06.855645 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28840): Launched 21:16:07.170974 run osmo-msc_10.42.42.6(pid=28841): Launched 21:16:07.347139 run osmo-stp_10.42.42.5(pid=28838): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28838)] 21:16:07.479493 run osmo-stp_10.42.42.5(pid=28838): stdout: | (launched: 2022-12-12_21:16:06.108417) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:16:07.612633 run osmo-stp_10.42.42.5(pid=28838): stderr: | 20221212211606281 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211606281 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211606281 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211606282 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211606282 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211606282 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211606282 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:16:07.743129 run osmo-stp_10.42.42.5(pid=28838): stdout: | (launched: 2022-12-12_21:16:06.108417) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:16:07.868516 run osmo-stp_10.42.42.5(pid=28838): stderr: | 20221212211606281 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211606281 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211606281 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211606282 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211606282 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211606282 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211606282 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:16:08.018881 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28838): Process ended prematurely: osmo-stp_10.42.42.5(pid=28838) [trial-2382↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28838)] [trial-2382↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 21:16:08.027877 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 21:16:08.054838 run osmo-hlr_10.42.42.2(pid=28835): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28835)] 21:16:08.104015 run osmo-hlr_10.42.42.2(pid=28835): stdout: | (launched: 2022-12-12_21:16:05.130279) 21:16:08.155083 run osmo-hlr_10.42.42.2(pid=28835): stderr: | 20221212211605308 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212211605308 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212211605308 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212211605308 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212211605308 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212211605308 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212211605318 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212211605328 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212211605328 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212211605328 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:16:08.226375 run osmo-msc_10.42.42.6(pid=28841): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28841)] 21:16:08.275593 run osmo-msc_10.42.42.6(pid=28841): stdout: | (launched: 2022-12-12_21:16:07.112692) 21:16:08.326359 run osmo-msc_10.42.42.6(pid=28841): stderr: | 20221212211607386 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212211607386 DLGLOBAL DEBUG validating counter group 0x7f7182b05c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212211607386 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212211607386 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212211607387 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212211607387 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212211607388 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212211607389 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212211607389 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212211607389 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:16:08.377400 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28834): Terminating (SIGTERM) 21:16:08.418068 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28837): Terminating (SIGTERM) 21:16:08.458957 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28840): Terminating (SIGTERM) 21:16:08.500173 --- ParallelTerminationStrategy: PID 28834 died... 21:16:08.519864 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28834): Terminated: ok {rc=0} 21:16:08.565195 --- ParallelTerminationStrategy: PID 28837 died... 21:16:08.584338 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28837): Terminated: ok {rc=0} 21:16:08.629351 --- ParallelTerminationStrategy: PID 28840 died... 21:16:08.648237 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28840): Terminated: ok {rc=0} 21:16:08.733687 bus /sierra_3: Setting Powered False 21:16:09.831919 bus /sierra_3: Setting Powered False 21:16:10.949717 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2382 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 21:16:12.102988 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 21:16:12.115806 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 21:16:12.170208 tst mo_mt_call_osmux.py: using LAC 31555 21:16:12.304497 tst mo_mt_call_osmux.py: using RAC 190 21:16:12.437326 tst mo_mt_call_osmux.py: using CellId 31555 21:16:12.570846 tst mo_mt_call_osmux.py: using BVCI 31556 21:16:12.696161 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 21:16:12.708151 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 21:16:12.719865 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 21:16:12.732060 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 21:16:12.744376 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 21:16:12.756526 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 21:16:12.878073 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 21:16:13.001378 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:16:13.491324 run create_hlr_db(pid=28843): Launched 21:16:13.622577 bus /sierra_2: Setting Powered False 21:16:14.685863 run create_hlr_db(pid=28843): Terminated: ok {rc=0} 21:16:15.124081 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28845): Launched 21:16:15.438742 run osmo-hlr_10.42.42.2(pid=28846): Launched 21:16:15.558399 run osmo-stp_10.42.42.5: Starting osmo-stp 21:16:16.112593 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28848): Launched 21:16:16.486440 run osmo-stp_10.42.42.5(pid=28849): Launched 21:16:16.776315 run osmo-msc_10.42.42.6: Starting osmo-msc 21:16:17.371035 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28851): Launched 21:16:17.713217 run osmo-msc_10.42.42.6(pid=28852): Launched 21:16:17.903494 run osmo-stp_10.42.42.5(pid=28849): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28849)] 21:16:18.046461 run osmo-stp_10.42.42.5(pid=28849): stdout: | (launched: 2022-12-12_21:16:16.426992) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:16:18.189566 run osmo-stp_10.42.42.5(pid=28849): stderr: | 20221212211616665 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211616665 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211616665 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211616666 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211616666 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211616666 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211616666 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:16:18.331207 run osmo-stp_10.42.42.5(pid=28849): stdout: | (launched: 2022-12-12_21:16:16.426992) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:16:18.466375 run osmo-stp_10.42.42.5(pid=28849): stderr: | 20221212211616665 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211616665 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211616665 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211616666 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211616666 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211616666 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211616666 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:16:18.628003 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28849): Process ended prematurely: osmo-stp_10.42.42.5(pid=28849) [trial-2382↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28849)] [trial-2382↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 21:16:18.638250 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 21:16:18.668070 run osmo-hlr_10.42.42.2(pid=28846): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28846)] 21:16:18.720603 run osmo-hlr_10.42.42.2(pid=28846): stdout: | (launched: 2022-12-12_21:16:15.380550) 21:16:18.775012 run osmo-hlr_10.42.42.2(pid=28846): stderr: | 20221212211615561 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212211615561 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212211615561 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212211615561 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212211615561 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212211615561 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212211615571 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212211615580 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212211615580 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212211615580 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:16:18.849914 run osmo-msc_10.42.42.6(pid=28852): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28852)] 21:16:18.902319 run osmo-msc_10.42.42.6(pid=28852): stdout: | (launched: 2022-12-12_21:16:17.650728) 21:16:18.956090 run osmo-msc_10.42.42.6(pid=28852): stderr: | 20221212211617978 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212211617978 DLGLOBAL DEBUG validating counter group 0x7fa21ea42c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212211617978 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212211617978 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212211617978 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212211617978 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212211617980 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212211617980 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212211617981 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212211617981 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:16:19.010481 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28845): Terminating (SIGTERM) 21:16:19.053863 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28848): Terminating (SIGTERM) 21:16:19.097336 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28851): Terminating (SIGTERM) 21:16:19.141150 --- ParallelTerminationStrategy: PID 28845 died... 21:16:19.161714 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28845): Terminated: ok {rc=0} 21:16:19.210293 --- ParallelTerminationStrategy: PID 28848 died... 21:16:19.230560 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28848): Terminated: ok {rc=0} 21:16:19.278865 --- ParallelTerminationStrategy: PID 28851 died... 21:16:19.299081 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28851): Terminated: ok {rc=0} 21:16:19.390521 bus /sierra_3: Setting Powered False 21:16:20.492171 bus /sierra_3: Setting Powered False 21:16:21.611103 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 emergency:trx-umtrx --------------------------------------------------------------------- 21:16:22.868140 tst emergency:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:16:22.873486 tst emergency:trx-umtrx: Verifying 1 x bts (candidates: 11) 21:16:22.905987 tst emergency:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 21:16:22.932703 tst emergency:trx-umtrx: Verifying 4 x modem (candidates: 12) 21:16:23.017649 tst emergency:trx-umtrx: Reserving 1 x bts (candidates: 11) 21:16:23.050070 tst emergency:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 21:16:23.076534 tst emergency:trx-umtrx: Reserving 4 x modem (candidates: 12) 21:16:23.660435 tst emergency:trx-umtrx: RESERVED RESOURCES for emergency: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2382 emergency:trx-umtrx emergency_mo_mt_call.py ---------------------------------------------- 21:16:23.665445 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 21:16:23.676205 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 21:16:23.724285 tst emergency_mo_mt_call.py: using LAC 31556 21:16:23.845345 tst emergency_mo_mt_call.py: using RAC 191 21:16:23.966904 tst emergency_mo_mt_call.py: using CellId 31556 21:16:24.090208 tst emergency_mo_mt_call.py: using BVCI 31557 21:16:24.204878 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 21:16:24.215649 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 21:16:24.226178 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 21:16:24.236715 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 21:16:24.247197 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 21:16:24.257649 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 21:16:24.378686 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 21:16:24.502908 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:16:25.020939 run create_hlr_db(pid=28857): Launched 21:16:25.148858 bus /sierra_2: Setting Powered False 21:16:26.214930 run create_hlr_db(pid=28857): Terminated: ok {rc=0} 21:16:26.660120 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28859): Launched 21:16:26.973838 run osmo-hlr_10.42.42.2(pid=28860): Launched 21:16:27.092663 run osmo-stp_10.42.42.5: Starting osmo-stp 21:16:27.627610 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28862): Launched 21:16:27.938707 run osmo-stp_10.42.42.5(pid=28863): Launched 21:16:28.072185 tst emergency_mo_mt_call.py: using MSISDN 7973 21:16:28.230353 run osmo-msc_10.42.42.6: Starting osmo-msc 21:16:28.787881 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28865): Launched 21:16:29.098891 run osmo-msc_10.42.42.6(pid=28866): Launched 21:16:29.275048 run osmo-stp_10.42.42.5(pid=28863): ERR: Terminated: ERROR {rc=1} [trial-2382↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28863)] 21:16:29.406860 run osmo-stp_10.42.42.5(pid=28863): stdout: | (launched: 2022-12-12_21:16:27.880686) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:16:29.538721 run osmo-stp_10.42.42.5(pid=28863): stderr: | 20221212211628054 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211628054 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211628054 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211628055 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211628055 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211628055 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211628055 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:16:29.668367 run osmo-stp_10.42.42.5(pid=28863): stdout: | (launched: 2022-12-12_21:16:27.880686) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:16:29.791902 run osmo-stp_10.42.42.5(pid=28863): stderr: | 20221212211628054 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211628054 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211628054 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211628055 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211628055 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211628055 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211628055 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:16:29.939838 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=28863): Process ended prematurely: osmo-stp_10.42.42.5(pid=28863) [trial-2382↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28863)] [trial-2382↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19] 21:16:29.948260 tst emergency_mo_mt_call.py:19: Test FAILED (6.3 sec) 21:16:29.974805 run osmo-hlr_10.42.42.2(pid=28860): ERR: Terminated: ERROR {rc=237} [trial-2382↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28860)] 21:16:30.023657 run osmo-hlr_10.42.42.2(pid=28860): stdout: | (launched: 2022-12-12_21:16:26.916423) 21:16:30.074740 run osmo-hlr_10.42.42.2(pid=28860): stderr: | 20221212211627096 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212211627096 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212211627096 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212211627096 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212211627096 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212211627096 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212211627108 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/emergency:trx-umtrx/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212211627117 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212211627117 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212211627117 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:16:30.145910 run osmo-msc_10.42.42.6(pid=28866): ERR: Terminated: ERROR {rc=2} [trial-2382↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28866)] 21:16:30.194758 run osmo-msc_10.42.42.6(pid=28866): stdout: | (launched: 2022-12-12_21:16:29.041312) 21:16:30.245323 run osmo-msc_10.42.42.6(pid=28866): stderr: | 20221212211629315 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212211629315 DLGLOBAL DEBUG validating counter group 0x7f16cb835c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212211629315 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212211629315 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212211629316 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212211629316 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212211629318 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212211629318 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212211629318 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212211629318 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:16:30.296044 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28859): Terminating (SIGTERM) 21:16:30.336743 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28862): Terminating (SIGTERM) 21:16:30.377336 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28865): Terminating (SIGTERM) 21:16:30.417991 --- ParallelTerminationStrategy: PID 28859 died... 21:16:30.437561 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28859): Terminated: ok {rc=0} 21:16:30.482412 --- ParallelTerminationStrategy: PID 28862 died... 21:16:30.501536 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28862): Terminated: ok {rc=0} 21:16:30.546206 --- ParallelTerminationStrategy: PID 28865 died... 21:16:30.565230 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28865): Terminated: ok {rc=0} 21:16:30.650093 bus /sierra_3: Setting Powered False 21:16:31.751257 bus /sierra_3: Setting Powered False 21:16:32.868390 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2382 emergency:trx-umtrx emergency_preemptive_call.py ---------------------------------------------- 21:16:33.956724 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 21:16:33.969219 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 21:16:34.029032 tst emergency_preemptive_call.py: using LAC 31557 21:16:34.160709 tst emergency_preemptive_call.py: using RAC 192 21:16:34.290124 tst emergency_preemptive_call.py: using CellId 31557 21:16:34.421301 tst emergency_preemptive_call.py: using BVCI 31558 21:16:34.542616 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 21:16:34.554328 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 21:16:34.565670 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 21:16:34.577317 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 21:16:34.588798 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 21:16:34.600493 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 21:16:34.720431 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 21:16:34.843232 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 21:16:34.962187 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 21:16:35.083446 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:16:35.605396 run create_hlr_db(pid=28868): Launched 21:16:35.733840 bus /sierra_2: Setting Powered False 21:16:36.800039 run create_hlr_db(pid=28868): Terminated: ok {rc=0} 21:16:37.246257 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28870): Launched 21:16:37.558798 run osmo-hlr_10.42.42.2(pid=28871): Launched 21:16:37.679841 run osmo-stp_10.42.42.5: Starting osmo-stp 21:16:38.227626 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28873): Launched 21:16:38.538002 run osmo-stp_10.42.42.5(pid=28874): Launched 21:16:38.669794 tst emergency_preemptive_call.py: using MSISDN 7974 21:16:38.840527 run osmo-msc_10.42.42.6: Starting osmo-msc 21:16:39.396911 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28876): Launched 21:16:39.706325 run osmo-msc_10.42.42.6(pid=28877): Launched 21:16:39.880571 run osmo-stp_10.42.42.5(pid=28874): ERR: Terminated: ERROR {rc=1} [trial-2382↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28874)] 21:16:40.012907 run osmo-stp_10.42.42.5(pid=28874): stdout: | (launched: 2022-12-12_21:16:38.480390) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:16:40.144329 run osmo-stp_10.42.42.5(pid=28874): stderr: | 20221212211638654 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211638654 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211638654 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211638655 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211638655 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211638655 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211638655 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:16:40.273887 run osmo-stp_10.42.42.5(pid=28874): stdout: | (launched: 2022-12-12_21:16:38.480390) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:16:40.396430 run osmo-stp_10.42.42.5(pid=28874): stderr: | 20221212211638654 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211638654 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211638654 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211638655 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211638655 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211638655 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211638655 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:16:40.543140 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=28874): Process ended prematurely: osmo-stp_10.42.42.5(pid=28874) [trial-2382↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28874)] [trial-2382↪emergency:trx-umtrx↪emergency_preemptive_call.py:32] 21:16:40.551634 tst emergency_preemptive_call.py:32: Test FAILED (6.6 sec) 21:16:40.578315 run osmo-hlr_10.42.42.2(pid=28871): ERR: Terminated: ERROR {rc=237} [trial-2382↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28871)] 21:16:40.627713 run osmo-hlr_10.42.42.2(pid=28871): stdout: | (launched: 2022-12-12_21:16:37.500554) 21:16:40.678418 run osmo-hlr_10.42.42.2(pid=28871): stderr: | 20221212211637678 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212211637678 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212211637678 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212211637678 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212211637678 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212211637678 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212211637691 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/emergency:trx-umtrx/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212211637701 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212211637701 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212211637701 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:16:40.749463 run osmo-msc_10.42.42.6(pid=28877): ERR: Terminated: ERROR {rc=2} [trial-2382↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28877)] 21:16:40.798435 run osmo-msc_10.42.42.6(pid=28877): stdout: | (launched: 2022-12-12_21:16:39.648777) 21:16:40.849275 run osmo-msc_10.42.42.6(pid=28877): stderr: | 20221212211639925 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212211639926 DLGLOBAL DEBUG validating counter group 0x7fa2b327fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212211639926 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212211639926 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212211639926 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212211639926 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212211639930 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212211639930 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212211639930 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212211639930 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:16:40.900210 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28870): Terminating (SIGTERM) 21:16:40.941026 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28873): Terminating (SIGTERM) 21:16:40.981944 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28876): Terminating (SIGTERM) 21:16:41.023209 --- ParallelTerminationStrategy: PID 28870 died... 21:16:41.042967 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28870): Terminated: ok {rc=0} 21:16:41.088453 --- ParallelTerminationStrategy: PID 28873 died... 21:16:41.107884 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28873): Terminated: ok {rc=0} 21:16:41.154550 --- ParallelTerminationStrategy: PID 28876 died... 21:16:41.173705 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28876): Terminated: ok {rc=0} 21:16:41.260821 bus /sierra_9: Setting Powered False 21:16:42.364169 bus /sierra_9: Setting Powered False 21:16:43.482500 bus /sierra_8: Setting Powered False 21:16:44.584146 bus /sierra_8: Setting Powered False 21:16:45.701962 bus /sierra_3: Setting Powered False 21:16:46.813094 bus /sierra_3: Setting Powered False 21:16:47.940411 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 emergency:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 gprs:trx-umtrx --------------------------------------------------------------------- 21:16:49.224823 tst gprs:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:16:49.229789 tst gprs:trx-umtrx: Verifying 1 x bts (candidates: 11) 21:16:49.264450 tst gprs:trx-umtrx: Verifying 9 x ip_address (candidates: 9) 21:16:49.304484 tst gprs:trx-umtrx: Verifying 4 x modem (candidates: 12) 21:16:49.393984 tst gprs:trx-umtrx: Reserving 1 x bts (candidates: 11) 21:16:49.427872 tst gprs:trx-umtrx: Reserving 9 x ip_address (candidates: 9) 21:16:49.468436 tst gprs:trx-umtrx: Reserving 4 x modem (candidates: 12) 21:16:50.059048 tst gprs:trx-umtrx: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2382 gprs:trx-umtrx cs_paging_gprs_active.py ---------------------------------------------- 21:16:50.115210 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 21:16:50.126603 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 21:16:50.180184 tst cs_paging_gprs_active.py: using LAC 31558 21:16:50.313466 tst cs_paging_gprs_active.py: using RAC 193 21:16:50.446932 tst cs_paging_gprs_active.py: using CellId 31558 21:16:50.569424 tst cs_paging_gprs_active.py: using BVCI 31559 21:16:50.686881 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 21:16:50.697649 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 21:16:50.708047 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 21:16:50.718605 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 21:16:50.729031 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 21:16:50.739785 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 21:16:50.750482 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 21:16:50.760776 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 21:16:50.771287 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 21:16:50.894383 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 21:16:51.017775 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 21:16:51.249077 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:16:51.590717 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28882): Launched 21:16:51.886239 run iperf3-srv_10.42.42.10(pid=28883): Launched 21:16:52.013830 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 21:16:52.244225 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:16:52.586878 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28884): Launched 21:16:52.881698 run iperf3-srv_10.42.42.10(pid=28885): Launched 21:16:53.010674 tst cs_paging_gprs_active.py:38: start network... 21:16:53.241793 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:16:53.771498 run create_hlr_db(pid=28886): Launched 21:16:53.902993 bus /sierra_2: Setting Powered False 21:16:54.969631 run create_hlr_db(pid=28886): Terminated: ok {rc=0} 21:16:55.422306 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28888): Launched 21:16:55.738700 run osmo-hlr_10.42.42.2(pid=28889): Launched 21:16:55.858411 run osmo-stp_10.42.42.5: Starting osmo-stp 21:16:56.407292 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28891): Launched 21:16:56.723815 run osmo-stp_10.42.42.5(pid=28892): Launched 21:16:56.845916 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:16:57.391245 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28894): Launched 21:16:57.511434 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:16:57.778950 run patchelf(pid=28895): Launched 21:16:57.955067 run osmo-stp_10.42.42.5(pid=28892): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28892)] 21:16:58.087766 run osmo-stp_10.42.42.5(pid=28892): stdout: | (launched: 2022-12-12_21:16:56.665389) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:16:58.223033 run osmo-stp_10.42.42.5(pid=28892): stderr: | 20221212211656842 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211656842 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211656843 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211656843 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211656843 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211656844 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211656844 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:16:58.358626 run osmo-stp_10.42.42.5(pid=28892): stdout: | (launched: 2022-12-12_21:16:56.665389) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:16:58.487484 run osmo-stp_10.42.42.5(pid=28892): stderr: | 20221212211656842 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211656842 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211656843 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211656843 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211656843 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211656844 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211656844 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:16:58.639938 run patchelf(pid=28895): Terminating (SIGINT) 21:16:58.817317 run patchelf(pid=28895): Terminated: ok {rc=0} 21:16:58.945087 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=28892): Process ended prematurely: osmo-stp_10.42.42.5(pid=28892) [trial-2382↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28892)] [trial-2382↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38] 21:16:58.954685 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 21:16:58.982374 run osmo-hlr_10.42.42.2(pid=28889): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-umtrx↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28889)] 21:16:59.031021 run osmo-hlr_10.42.42.2(pid=28889): stdout: | (launched: 2022-12-12_21:16:55.680107) 21:16:59.082040 run osmo-hlr_10.42.42.2(pid=28889): stderr: | 20221212211655859 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212211655859 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212211655859 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212211655859 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212211655859 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212211655859 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212211655871 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-umtrx/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212211655880 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212211655880 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212211655880 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:16:59.133080 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28882): Terminating (SIGTERM) 21:16:59.173593 run iperf3-srv_10.42.42.10(pid=28883): Terminating (SIGTERM) 21:16:59.213950 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28884): Terminating (SIGTERM) 21:16:59.254492 run iperf3-srv_10.42.42.10(pid=28885): Terminating (SIGTERM) 21:16:59.294618 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28888): Terminating (SIGTERM) 21:16:59.335035 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28891): Terminating (SIGTERM) 21:16:59.375504 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28894): Terminating (SIGTERM) 21:16:59.416325 --- ParallelTerminationStrategy: PID 28882 died... 21:16:59.435907 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28882): Terminated: ok {rc=0} 21:16:59.480723 --- ParallelTerminationStrategy: PID 28883 died... 21:16:59.499805 run iperf3-srv_10.42.42.10(pid=28883): Terminated {rc=256} 21:16:59.544366 --- ParallelTerminationStrategy: PID 28884 died... 21:16:59.563401 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28884): Terminated: ok {rc=0} 21:16:59.608876 --- ParallelTerminationStrategy: PID 28885 died... 21:16:59.628265 run iperf3-srv_10.42.42.10(pid=28885): Terminated {rc=256} 21:16:59.672719 --- ParallelTerminationStrategy: PID 28888 died... 21:16:59.691754 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28888): Terminated: ok {rc=0} 21:16:59.737195 --- ParallelTerminationStrategy: PID 28891 died... 21:16:59.756525 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28891): Terminated: ok {rc=0} 21:16:59.801435 --- ParallelTerminationStrategy: PID 28894 died... 21:16:59.820662 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28894): Terminated: ok {rc=0} 21:16:59.909216 bus /gobi_0: Setting Powered False 21:17:01.037076 bus /gobi_0: Setting Powered False 21:17:02.176575 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:trx-umtrx iperf3.py ---------------------------------------------- 21:17:03.333370 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 21:17:03.345556 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 21:17:03.398758 tst iperf3.py: using LAC 31559 21:17:03.532742 tst iperf3.py: using RAC 194 21:17:03.665654 tst iperf3.py: using CellId 31559 21:17:03.800573 tst iperf3.py: using BVCI 31560 21:17:03.925212 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 21:17:03.936679 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 21:17:03.947858 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 21:17:03.959255 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 21:17:03.970595 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 21:17:03.981871 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 21:17:03.993387 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 21:17:04.004313 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 21:17:04.015564 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 21:17:04.135217 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 21:17:04.366148 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:17:04.706626 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28899): Launched 21:17:05.001602 run iperf3-srv_10.42.42.10(pid=28900): Launched 21:17:05.130735 tst iperf3.py:8: start network... 21:17:05.360913 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:17:05.889424 run create_hlr_db(pid=28901): Launched 21:17:06.019403 bus /gobi_6: Setting Powered False 21:17:07.085798 run create_hlr_db(pid=28901): Terminated: ok {rc=0} 21:17:07.535848 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28903): Launched 21:17:07.854876 run osmo-hlr_10.42.42.2(pid=28904): Launched 21:17:07.975302 run osmo-stp_10.42.42.5: Starting osmo-stp 21:17:08.537660 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28906): Launched 21:17:08.855433 run osmo-stp_10.42.42.5(pid=28907): Launched 21:17:08.974886 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:17:09.518262 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28909): Launched 21:17:09.637884 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:17:09.905142 run patchelf(pid=28910): Launched 21:17:10.079867 run osmo-stp_10.42.42.5(pid=28907): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28907)] 21:17:10.213942 run osmo-stp_10.42.42.5(pid=28907): stdout: | (launched: 2022-12-12_21:17:08.796697) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:17:10.349315 run osmo-stp_10.42.42.5(pid=28907): stderr: | 20221212211708969 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211708970 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211708970 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211708970 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211708971 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211708971 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211708971 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:17:10.485324 run osmo-stp_10.42.42.5(pid=28907): stdout: | (launched: 2022-12-12_21:17:08.796697) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:17:10.614986 run osmo-stp_10.42.42.5(pid=28907): stderr: | 20221212211708969 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211708970 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211708970 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211708970 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211708971 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211708971 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211708971 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:17:10.768290 run patchelf(pid=28910): Terminating (SIGINT) 21:17:10.945671 run patchelf(pid=28910): Terminated: ok {rc=0} 21:17:11.073553 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28907): Process ended prematurely: osmo-stp_10.42.42.5(pid=28907) [trial-2382↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28907)] [trial-2382↪gprs:trx-umtrx↪iperf3.py:8] 21:17:11.083004 tst iperf3.py:8: Test FAILED (7.8 sec) 21:17:11.110476 run osmo-hlr_10.42.42.2(pid=28904): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-umtrx↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28904)] 21:17:11.158925 run osmo-hlr_10.42.42.2(pid=28904): stdout: | (launched: 2022-12-12_21:17:07.796029) 21:17:11.209341 run osmo-hlr_10.42.42.2(pid=28904): stderr: | 20221212211707975 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212211707975 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212211707975 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212211707975 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212211707975 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212211707975 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212211707987 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-umtrx/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212211707995 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212211707996 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212211707996 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:17:11.260109 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28899): Terminating (SIGTERM) 21:17:11.300844 run iperf3-srv_10.42.42.10(pid=28900): Terminating (SIGTERM) 21:17:11.341835 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28903): Terminating (SIGTERM) 21:17:11.382480 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28906): Terminating (SIGTERM) 21:17:11.422874 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28909): Terminating (SIGTERM) 21:17:11.463757 --- ParallelTerminationStrategy: PID 28899 died... 21:17:11.483376 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28899): Terminated: ok {rc=0} 21:17:11.528564 --- ParallelTerminationStrategy: PID 28900 died... 21:17:11.547771 run iperf3-srv_10.42.42.10(pid=28900): Terminated {rc=256} 21:17:11.593216 --- ParallelTerminationStrategy: PID 28903 died... 21:17:11.612277 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28903): Terminated: ok {rc=0} 21:17:11.657206 --- ParallelTerminationStrategy: PID 28906 died... 21:17:11.676336 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28906): Terminated: ok {rc=0} 21:17:11.721381 --- ParallelTerminationStrategy: PID 28909 died... 21:17:11.740541 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28909): Terminated: ok {rc=0} 21:17:11.828300 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:trx-umtrx iperf3m4.py ---------------------------------------------- 21:17:12.980321 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 21:17:12.992411 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 21:17:13.039334 tst iperf3m4.py: using LAC 31560 21:17:13.166541 tst iperf3m4.py: using RAC 195 21:17:13.292104 tst iperf3m4.py: using CellId 31560 21:17:13.418942 tst iperf3m4.py: using BVCI 31561 21:17:13.535164 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 21:17:13.546211 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 21:17:13.556895 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 21:17:13.567640 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 21:17:13.578447 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 21:17:13.588839 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 21:17:13.599654 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 21:17:13.610432 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 21:17:13.621186 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 21:17:13.742010 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 21:17:13.868525 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 21:17:13.991551 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 21:17:14.115784 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 21:17:14.346822 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:17:14.688917 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28911): Launched 21:17:14.985338 run iperf3-srv_10.42.42.10(pid=28912): Launched 21:17:15.115418 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 21:17:15.346097 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:17:15.687852 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28913): Launched 21:17:15.988875 run iperf3-srv_10.42.42.10(pid=28914): Launched 21:17:16.131157 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 21:17:16.351200 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:17:16.683475 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28915): Launched 21:17:16.993908 run iperf3-srv_10.42.42.10(pid=28916): Launched 21:17:17.123489 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 21:17:17.356451 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:17:17.698023 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28917): Launched 21:17:17.993999 run iperf3-srv_10.42.42.10(pid=28918): Launched 21:17:18.123440 tst iperf3m4.py:8: start network... 21:17:18.353457 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:17:18.884385 run create_hlr_db(pid=28919): Launched 21:17:19.016230 bus /gobi_6: Setting Powered False 21:17:20.083522 run create_hlr_db(pid=28919): Terminated: ok {rc=0} 21:17:20.554416 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28921): Launched 21:17:20.894381 run osmo-hlr_10.42.42.2(pid=28922): Launched 21:17:21.025226 run osmo-stp_10.42.42.5: Starting osmo-stp 21:17:21.609141 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28924): Launched 21:17:21.952455 run osmo-stp_10.42.42.5(pid=28925): Launched 21:17:22.084113 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:17:22.670914 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28927): Launched 21:17:22.800607 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:17:23.089335 run patchelf(pid=28928): Launched 21:17:23.278857 run osmo-stp_10.42.42.5(pid=28925): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28925)] 21:17:23.422509 run osmo-stp_10.42.42.5(pid=28925): stdout: | (launched: 2022-12-12_21:17:21.889452) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:17:23.567485 run osmo-stp_10.42.42.5(pid=28925): stderr: | 20221212211722084 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211722084 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211722084 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211722085 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211722087 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211722087 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211722087 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:17:23.712463 run osmo-stp_10.42.42.5(pid=28925): stdout: | (launched: 2022-12-12_21:17:21.889452) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:17:23.851714 run osmo-stp_10.42.42.5(pid=28925): stderr: | 20221212211722084 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211722084 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211722084 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211722085 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211722087 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211722087 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211722087 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:17:24.017542 run patchelf(pid=28928): Terminating (SIGINT) 21:17:24.208094 run patchelf(pid=28928): Terminated: ok {rc=0} 21:17:24.345493 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28925): Process ended prematurely: osmo-stp_10.42.42.5(pid=28925) [trial-2382↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28925)] [trial-2382↪gprs:trx-umtrx↪iperf3m4.py:8] 21:17:24.355892 tst iperf3m4.py:8: Test FAILED (11.4 sec) 21:17:24.385806 run osmo-hlr_10.42.42.2(pid=28922): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-umtrx↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28922)] 21:17:24.437886 run osmo-hlr_10.42.42.2(pid=28922): stdout: | (launched: 2022-12-12_21:17:20.831750) 21:17:24.491649 run osmo-hlr_10.42.42.2(pid=28922): stderr: | 20221212211721035 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212211721035 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212211721035 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212211721035 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212211721036 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212211721036 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212211721058 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-umtrx/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212211721068 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212211721068 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212211721068 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:17:24.545921 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28911): Terminating (SIGTERM) 21:17:24.589171 run iperf3-srv_10.42.42.10(pid=28912): Terminating (SIGTERM) 21:17:24.632327 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28913): Terminating (SIGTERM) 21:17:24.675089 run iperf3-srv_10.42.42.10(pid=28914): Terminating (SIGTERM) 21:17:24.718615 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28915): Terminating (SIGTERM) 21:17:24.761973 run iperf3-srv_10.42.42.10(pid=28916): Terminating (SIGTERM) 21:17:24.804994 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28917): Terminating (SIGTERM) 21:17:24.848032 run iperf3-srv_10.42.42.10(pid=28918): Terminating (SIGTERM) 21:17:24.891155 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28921): Terminating (SIGTERM) 21:17:24.934715 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28924): Terminating (SIGTERM) 21:17:24.977892 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28927): Terminating (SIGTERM) 21:17:25.021511 --- ParallelTerminationStrategy: PID 28911 died... 21:17:25.042116 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28911): Terminated: ok {rc=0} 21:17:25.090025 --- ParallelTerminationStrategy: PID 28912 died... 21:17:25.110075 run iperf3-srv_10.42.42.10(pid=28912): Terminated {rc=256} 21:17:25.157783 --- ParallelTerminationStrategy: PID 28913 died... 21:17:25.177921 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28913): Terminated: ok {rc=0} 21:17:25.225748 --- ParallelTerminationStrategy: PID 28914 died... 21:17:25.245838 run iperf3-srv_10.42.42.10(pid=28914): Terminated {rc=256} 21:17:25.293475 --- ParallelTerminationStrategy: PID 28915 died... 21:17:25.313550 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28915): Terminated: ok {rc=0} 21:17:25.361466 --- ParallelTerminationStrategy: PID 28916 died... 21:17:25.381422 run iperf3-srv_10.42.42.10(pid=28916): Terminated {rc=256} 21:17:25.429180 --- ParallelTerminationStrategy: PID 28917 died... 21:17:25.449295 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28917): Terminated: ok {rc=0} 21:17:25.497147 --- ParallelTerminationStrategy: PID 28918 died... 21:17:25.517292 run iperf3-srv_10.42.42.10(pid=28918): Terminated {rc=256} 21:17:25.565260 --- ParallelTerminationStrategy: PID 28921 died... 21:17:25.585285 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28921): Terminated: ok {rc=0} 21:17:25.633153 --- ParallelTerminationStrategy: PID 28924 died... 21:17:25.653477 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28924): Terminated: ok {rc=0} 21:17:25.701339 --- ParallelTerminationStrategy: PID 28927 died... 21:17:25.721422 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28927): Terminated: ok {rc=0} 21:17:25.811142 bus /gobi_4: Setting Powered False 21:17:26.912751 bus /gobi_4: Setting Powered False 21:17:28.032259 bus /gobi_1: Setting Powered False 21:17:29.133451 bus /gobi_1: Setting Powered False 21:17:30.251485 bus /gobi_0: Setting Powered False 21:17:31.361295 bus /gobi_0: Setting Powered False 21:17:32.490435 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:trx-umtrx ping.py ---------------------------------------------- 21:17:33.597834 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 21:17:33.609367 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 21:17:33.659327 tst ping.py: using LAC 31561 21:17:33.782902 tst ping.py: using RAC 196 21:17:33.907556 tst ping.py: using CellId 31561 21:17:34.030842 tst ping.py: using BVCI 31562 21:17:34.145578 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 21:17:34.156237 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 21:17:34.166871 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 21:17:34.177550 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 21:17:34.187961 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 21:17:34.198511 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 21:17:34.209178 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 21:17:34.219725 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 21:17:34.342165 tst ping.py:19: start network... 21:17:34.566368 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:17:35.083662 run create_hlr_db(pid=28929): Launched 21:17:35.212453 bus /gobi_6: Setting Powered False 21:17:36.278209 run create_hlr_db(pid=28929): Terminated: ok {rc=0} 21:17:36.741417 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28931): Launched 21:17:37.076635 run osmo-hlr_10.42.42.2(pid=28932): Launched 21:17:37.205103 run osmo-stp_10.42.42.5: Starting osmo-stp 21:17:37.780595 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28934): Launched 21:17:38.116331 run osmo-stp_10.42.42.5(pid=28935): Launched 21:17:38.245296 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:17:38.822786 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28937): Launched 21:17:38.950478 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:17:39.233646 run patchelf(pid=28938): Launched 21:17:39.420045 run osmo-stp_10.42.42.5(pid=28935): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28935)] 21:17:39.561878 run osmo-stp_10.42.42.5(pid=28935): stdout: | (launched: 2022-12-12_21:17:38.054756) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:17:39.705189 run osmo-stp_10.42.42.5(pid=28935): stderr: | 20221212211738252 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211738252 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211738252 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211738253 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211738253 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211738253 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211738253 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:17:39.848642 run osmo-stp_10.42.42.5(pid=28935): stdout: | (launched: 2022-12-12_21:17:38.054756) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:17:39.987022 run osmo-stp_10.42.42.5(pid=28935): stderr: | 20221212211738252 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211738252 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211738252 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211738253 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211738253 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211738253 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211738253 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:17:40.149827 run patchelf(pid=28938): Terminating (SIGINT) 21:17:40.338688 run patchelf(pid=28938): Terminated: ok {rc=0} 21:17:40.474954 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=28935): Process ended prematurely: osmo-stp_10.42.42.5(pid=28935) [trial-2382↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28935)] [trial-2382↪gprs:trx-umtrx↪ping.py:22] 21:17:40.484528 tst ping.py:22: Test FAILED (6.9 sec) 21:17:40.514033 run osmo-hlr_10.42.42.2(pid=28932): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-umtrx↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28932)] 21:17:40.565773 run osmo-hlr_10.42.42.2(pid=28932): stdout: | (launched: 2022-12-12_21:17:37.015141) 21:17:40.619593 run osmo-hlr_10.42.42.2(pid=28932): stderr: | 20221212211737217 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212211737217 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212211737217 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212211737217 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212211737217 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212211737217 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212211737230 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-umtrx/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212211737238 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212211737238 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212211737238 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:17:40.673949 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28931): Terminating (SIGTERM) 21:17:40.717185 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28934): Terminating (SIGTERM) 21:17:40.760818 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28937): Terminating (SIGTERM) 21:17:40.804211 --- ParallelTerminationStrategy: PID 28931 died... 21:17:40.824615 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28931): Terminated: ok {rc=0} 21:17:40.873123 --- ParallelTerminationStrategy: PID 28934 died... 21:17:40.893417 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28934): Terminated: ok {rc=0} 21:17:40.941686 --- ParallelTerminationStrategy: PID 28937 died... 21:17:40.962007 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28937): Terminated: ok {rc=0} 21:17:41.053933 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:trx-umtrx ping_idle_ping.py ---------------------------------------------- 21:17:42.144239 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 21:17:42.156919 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 21:17:42.210290 tst ping_idle_ping.py: using LAC 31562 21:17:42.342527 tst ping_idle_ping.py: using RAC 197 21:17:42.473203 tst ping_idle_ping.py: using CellId 31562 21:17:42.603566 tst ping_idle_ping.py: using BVCI 31563 21:17:42.726445 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 21:17:42.737949 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 21:17:42.749277 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 21:17:42.760482 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 21:17:42.771891 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 21:17:42.783197 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 21:17:42.794685 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 21:17:42.806318 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 21:17:42.926422 tst ping_idle_ping.py:24: start network... 21:17:43.134794 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:17:43.618320 run create_hlr_db(pid=28939): Launched 21:17:43.747543 bus /gobi_6: Setting Powered False 21:17:44.809254 run create_hlr_db(pid=28939): Terminated: ok {rc=0} 21:17:45.242380 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28941): Launched 21:17:45.553481 run osmo-hlr_10.42.42.2(pid=28942): Launched 21:17:45.671971 run osmo-stp_10.42.42.5: Starting osmo-stp 21:17:46.234434 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28944): Launched 21:17:46.596639 run osmo-stp_10.42.42.5(pid=28945): Launched 21:17:46.900160 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:17:47.517560 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28947): Launched 21:17:47.636526 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:17:47.901446 run patchelf(pid=28948): Launched 21:17:48.074962 run osmo-stp_10.42.42.5(pid=28945): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28945)] 21:17:48.205890 run osmo-stp_10.42.42.5(pid=28945): stdout: | (launched: 2022-12-12_21:17:46.533164) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:17:48.338673 run osmo-stp_10.42.42.5(pid=28945): stderr: | 20221212211746860 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211746860 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211746862 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211746863 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211746863 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211746863 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211746863 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:17:48.471315 run osmo-stp_10.42.42.5(pid=28945): stdout: | (launched: 2022-12-12_21:17:46.533164) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:17:48.598064 run osmo-stp_10.42.42.5(pid=28945): stderr: | 20221212211746860 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211746860 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211746862 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211746863 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211746863 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211746863 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211746863 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:17:48.749070 run patchelf(pid=28948): Terminating (SIGINT) 21:17:48.923881 run patchelf(pid=28948): Terminated: ok {rc=0} 21:17:49.050271 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=28945): Process ended prematurely: osmo-stp_10.42.42.5(pid=28945) [trial-2382↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28945)] [trial-2382↪gprs:trx-umtrx↪ping_idle_ping.py:27] 21:17:49.059385 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 21:17:49.086702 run osmo-hlr_10.42.42.2(pid=28942): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-umtrx↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28942)] 21:17:49.135905 run osmo-hlr_10.42.42.2(pid=28942): stdout: | (launched: 2022-12-12_21:17:45.495643) 21:17:49.186910 run osmo-hlr_10.42.42.2(pid=28942): stderr: | 20221212211745674 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212211745674 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212211745674 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212211745674 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212211745674 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212211745674 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212211745687 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-umtrx/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212211745698 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212211745698 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212211745698 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:17:49.238482 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28941): Terminating (SIGTERM) 21:17:49.279269 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28944): Terminating (SIGTERM) 21:17:49.319839 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28947): Terminating (SIGTERM) 21:17:49.360839 --- ParallelTerminationStrategy: PID 28941 died... 21:17:49.380501 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28941): Terminated: ok {rc=0} 21:17:49.425574 --- ParallelTerminationStrategy: PID 28944 died... 21:17:49.444638 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28944): Terminated: ok {rc=0} 21:17:49.489326 --- ParallelTerminationStrategy: PID 28947 died... 21:17:49.508440 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28947): Terminated: ok {rc=0} 21:17:49.596520 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2382 gprs:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 gprs:trx-umtrx+mod-bts0-egprs --------------------------------------------------------------------- 21:17:50.899432 tst gprs:trx-umtrx+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:17:50.905324 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 21:17:50.938030 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 21:17:50.976523 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 21:17:51.064009 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 21:17:51.096561 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 21:17:51.135171 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 21:17:51.727712 tst gprs:trx-umtrx+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2382 gprs:trx-umtrx+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 21:17:51.778505 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:17:51.789600 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:17:51.839845 tst cs_paging_gprs_active.py: using LAC 31563 21:17:51.966106 tst cs_paging_gprs_active.py: using RAC 198 21:17:52.100863 tst cs_paging_gprs_active.py: using CellId 31563 21:17:52.234137 tst cs_paging_gprs_active.py: using BVCI 31564 21:17:52.360020 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:17:52.371767 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:17:52.383149 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:17:52.395050 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:17:52.406522 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:17:52.418020 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:17:52.429809 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:17:52.441256 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:17:52.452916 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:17:52.575661 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:17:52.694783 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 21:17:52.911187 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:17:53.230506 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28954): Launched 21:17:53.506502 run iperf3-srv_10.42.42.10(pid=28955): Launched 21:17:53.626978 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 21:17:53.839976 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:17:54.159591 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28956): Launched 21:17:54.437355 run iperf3-srv_10.42.42.10(pid=28957): Launched 21:17:54.556657 tst cs_paging_gprs_active.py:38: start network... 21:17:54.769682 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:17:55.261067 run create_hlr_db(pid=28958): Launched 21:17:55.391695 bus /gobi_6: Setting Powered False 21:17:56.454453 run create_hlr_db(pid=28958): Terminated: ok {rc=0} 21:17:56.894984 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28960): Launched 21:17:57.213062 run osmo-hlr_10.42.42.2(pid=28961): Launched 21:17:57.334320 run osmo-stp_10.42.42.5: Starting osmo-stp 21:17:57.878602 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28963): Launched 21:17:58.196374 run osmo-stp_10.42.42.5(pid=28964): Launched 21:17:58.318140 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:17:58.863356 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28966): Launched 21:17:58.985736 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:17:59.253863 run patchelf(pid=28967): Launched 21:17:59.429711 run osmo-stp_10.42.42.5(pid=28964): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28964)] 21:17:59.562920 run osmo-stp_10.42.42.5(pid=28964): stdout: | (launched: 2022-12-12_21:17:58.137729) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:17:59.697437 run osmo-stp_10.42.42.5(pid=28964): stderr: | 20221212211758310 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211758311 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211758311 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211758311 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211758312 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211758312 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211758312 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:17:59.832027 run osmo-stp_10.42.42.5(pid=28964): stdout: | (launched: 2022-12-12_21:17:58.137729) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:17:59.961158 run osmo-stp_10.42.42.5(pid=28964): stderr: | 20221212211758310 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211758311 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211758311 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211758311 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211758312 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211758312 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211758312 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:18:00.114105 run patchelf(pid=28967): Terminating (SIGINT) 21:18:00.291536 run patchelf(pid=28967): Terminated: ok {rc=0} 21:18:00.419571 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=28964): Process ended prematurely: osmo-stp_10.42.42.5(pid=28964) [trial-2382↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28964)] [trial-2382↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 21:18:00.429163 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 21:18:00.456744 run osmo-hlr_10.42.42.2(pid=28961): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28961)] 21:18:00.505401 run osmo-hlr_10.42.42.2(pid=28961): stdout: | (launched: 2022-12-12_21:17:57.154020) 21:18:00.555693 run osmo-hlr_10.42.42.2(pid=28961): stderr: | 20221212211757337 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212211757337 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212211757337 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212211757337 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212211757337 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212211757337 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212211757348 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-umtrx+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212211757357 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212211757357 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212211757357 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:18:00.606562 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28954): Terminating (SIGTERM) 21:18:00.646936 run iperf3-srv_10.42.42.10(pid=28955): Terminating (SIGTERM) 21:18:00.687244 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28956): Terminating (SIGTERM) 21:18:00.727670 run iperf3-srv_10.42.42.10(pid=28957): Terminating (SIGTERM) 21:18:00.767906 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28960): Terminating (SIGTERM) 21:18:00.809191 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28963): Terminating (SIGTERM) 21:18:00.849790 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28966): Terminating (SIGTERM) 21:18:00.891117 --- ParallelTerminationStrategy: PID 28954 died... 21:18:00.910717 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28954): Terminated: ok {rc=0} 21:18:00.956181 --- ParallelTerminationStrategy: PID 28955 died... 21:18:00.975595 run iperf3-srv_10.42.42.10(pid=28955): Terminated {rc=256} 21:18:01.021033 --- ParallelTerminationStrategy: PID 28956 died... 21:18:01.040543 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28956): Terminated: ok {rc=0} 21:18:01.086019 --- ParallelTerminationStrategy: PID 28957 died... 21:18:01.105610 run iperf3-srv_10.42.42.10(pid=28957): Terminated {rc=256} 21:18:01.151059 --- ParallelTerminationStrategy: PID 28960 died... 21:18:01.170788 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28960): Terminated: ok {rc=0} 21:18:01.216632 --- ParallelTerminationStrategy: PID 28963 died... 21:18:01.236371 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28963): Terminated: ok {rc=0} 21:18:01.282083 --- ParallelTerminationStrategy: PID 28966 died... 21:18:01.301766 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28966): Terminated: ok {rc=0} 21:18:01.389159 bus /gobi_0: Setting Powered False 21:18:02.487257 bus /gobi_0: Setting Powered False 21:18:03.604569 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:trx-umtrx+mod-bts0-egprs iperf3.py ---------------------------------------------- 21:18:04.755073 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:18:04.766878 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:18:04.819149 tst iperf3.py: using LAC 31564 21:18:04.945305 tst iperf3.py: using RAC 199 21:18:05.071524 tst iperf3.py: using CellId 31564 21:18:05.197040 tst iperf3.py: using BVCI 31565 21:18:05.314893 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:18:05.326015 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:18:05.336730 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:18:05.347570 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:18:05.358254 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:18:05.368875 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:18:05.379795 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:18:05.390508 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:18:05.401406 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:18:05.525230 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 21:18:05.755417 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:18:06.098254 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28968): Launched 21:18:06.394118 run iperf3-srv_10.42.42.10(pid=28969): Launched 21:18:06.523584 tst iperf3.py:8: start network... 21:18:06.754305 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:18:07.282302 run create_hlr_db(pid=28970): Launched 21:18:07.413749 bus /gobi_6: Setting Powered False 21:18:08.481125 run create_hlr_db(pid=28970): Terminated: ok {rc=0} 21:18:08.932680 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28972): Launched 21:18:09.249630 run osmo-hlr_10.42.42.2(pid=28973): Launched 21:18:09.371210 run osmo-stp_10.42.42.5: Starting osmo-stp 21:18:09.924920 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28975): Launched 21:18:10.241272 run osmo-stp_10.42.42.5(pid=28976): Launched 21:18:10.362462 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:18:10.912254 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28978): Launched 21:18:11.034398 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:18:11.301598 run patchelf(pid=28979): Launched 21:18:11.477360 run osmo-stp_10.42.42.5(pid=28976): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28976)] 21:18:11.610936 run osmo-stp_10.42.42.5(pid=28976): stdout: | (launched: 2022-12-12_21:18:10.182778) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:18:11.746192 run osmo-stp_10.42.42.5(pid=28976): stderr: | 20221212211810359 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211810359 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211810359 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211810360 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211810360 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211810360 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211810360 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:18:11.881351 run osmo-stp_10.42.42.5(pid=28976): stdout: | (launched: 2022-12-12_21:18:10.182778) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:18:12.011223 run osmo-stp_10.42.42.5(pid=28976): stderr: | 20221212211810359 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211810359 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211810359 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211810360 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211810360 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211810360 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211810360 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:18:12.164373 run patchelf(pid=28979): Terminating (SIGINT) 21:18:12.342809 run patchelf(pid=28979): Terminated: ok {rc=0} 21:18:12.471846 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28976): Process ended prematurely: osmo-stp_10.42.42.5(pid=28976) [trial-2382↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28976)] [trial-2382↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8] 21:18:12.481649 tst iperf3.py:8: Test FAILED (7.8 sec) 21:18:12.509284 run osmo-hlr_10.42.42.2(pid=28973): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28973)] 21:18:12.557992 run osmo-hlr_10.42.42.2(pid=28973): stdout: | (launched: 2022-12-12_21:18:09.191033) 21:18:12.608800 run osmo-hlr_10.42.42.2(pid=28973): stderr: | 20221212211809369 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212211809369 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212211809369 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212211809369 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212211809369 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212211809369 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212211809382 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-umtrx+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212211809390 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212211809390 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212211809390 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:18:12.659969 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28968): Terminating (SIGTERM) 21:18:12.700704 run iperf3-srv_10.42.42.10(pid=28969): Terminating (SIGTERM) 21:18:12.741369 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28972): Terminating (SIGTERM) 21:18:12.782331 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28975): Terminating (SIGTERM) 21:18:12.823205 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28978): Terminating (SIGTERM) 21:18:12.864342 --- ParallelTerminationStrategy: PID 28968 died... 21:18:12.884333 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28968): Terminated: ok {rc=0} 21:18:12.929750 --- ParallelTerminationStrategy: PID 28969 died... 21:18:12.948825 run iperf3-srv_10.42.42.10(pid=28969): Terminated {rc=256} 21:18:12.994474 --- ParallelTerminationStrategy: PID 28972 died... 21:18:13.013528 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28972): Terminated: ok {rc=0} 21:18:13.058266 --- ParallelTerminationStrategy: PID 28975 died... 21:18:13.077304 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28975): Terminated: ok {rc=0} 21:18:13.122161 --- ParallelTerminationStrategy: PID 28978 died... 21:18:13.141224 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28978): Terminated: ok {rc=0} 21:18:13.228705 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:trx-umtrx+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 21:18:14.384439 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:18:14.396208 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:18:14.444702 tst iperf3m4.py: using LAC 31565 21:18:14.568211 tst iperf3m4.py: using RAC 200 21:18:14.693991 tst iperf3m4.py: using CellId 31565 21:18:14.817865 tst iperf3m4.py: using BVCI 31566 21:18:14.933065 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:18:14.944114 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:18:14.954895 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:18:14.965627 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:18:14.976289 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:18:14.987027 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:18:14.997925 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:18:15.008529 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:18:15.019408 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:18:15.142268 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:18:15.265533 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:18:15.389596 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:18:15.513794 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 21:18:15.744715 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:18:16.101178 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28980): Launched 21:18:16.401633 run iperf3-srv_10.42.42.10(pid=28981): Launched 21:18:16.536587 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 21:18:16.754354 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:18:17.083653 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28982): Launched 21:18:17.407143 run iperf3-srv_10.42.42.10(pid=28983): Launched 21:18:17.538113 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 21:18:17.767980 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:18:18.110725 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28984): Launched 21:18:18.406236 run iperf3-srv_10.42.42.10(pid=28985): Launched 21:18:18.535078 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 21:18:18.765752 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:18:19.109071 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28986): Launched 21:18:19.403986 run iperf3-srv_10.42.42.10(pid=28987): Launched 21:18:19.532853 tst iperf3m4.py:8: start network... 21:18:19.763246 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:18:20.293119 run create_hlr_db(pid=28988): Launched 21:18:20.423302 bus /gobi_6: Setting Powered False 21:18:21.490886 run create_hlr_db(pid=28988): Terminated: ok {rc=0} 21:18:21.962102 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28990): Launched 21:18:22.304683 run osmo-hlr_10.42.42.2(pid=28991): Launched 21:18:22.434814 run osmo-stp_10.42.42.5: Starting osmo-stp 21:18:23.024743 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28993): Launched 21:18:23.367013 run osmo-stp_10.42.42.5(pid=28994): Launched 21:18:23.499402 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:18:24.088256 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28996): Launched 21:18:24.217654 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:18:24.505695 run patchelf(pid=28997): Launched 21:18:24.695149 run osmo-stp_10.42.42.5(pid=28994): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28994)] 21:18:24.838516 run osmo-stp_10.42.42.5(pid=28994): stdout: | (launched: 2022-12-12_21:18:23.303954) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:18:24.983935 run osmo-stp_10.42.42.5(pid=28994): stderr: | 20221212211823498 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211823498 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211823499 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211823499 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211823499 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211823500 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211823500 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:18:25.129084 run osmo-stp_10.42.42.5(pid=28994): stdout: | (launched: 2022-12-12_21:18:23.303954) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:18:25.267967 run osmo-stp_10.42.42.5(pid=28994): stderr: | 20221212211823498 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211823498 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211823499 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211823499 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211823499 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211823500 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211823500 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:18:25.433180 run patchelf(pid=28997): Terminating (SIGINT) 21:18:25.623610 run patchelf(pid=28997): Terminated: ok {rc=0} 21:18:25.760703 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28994): Process ended prematurely: osmo-stp_10.42.42.5(pid=28994) [trial-2382↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28994)] [trial-2382↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8] 21:18:25.771164 tst iperf3m4.py:8: Test FAILED (11.4 sec) 21:18:25.801403 run osmo-hlr_10.42.42.2(pid=28991): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28991)] 21:18:25.853195 run osmo-hlr_10.42.42.2(pid=28991): stdout: | (launched: 2022-12-12_21:18:22.241606) 21:18:25.906872 run osmo-hlr_10.42.42.2(pid=28991): stderr: | 20221212211822445 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212211822445 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212211822445 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212211822445 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212211822445 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212211822445 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212211822462 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-umtrx+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212211822472 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212211822472 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212211822472 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:18:25.961489 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28980): Terminating (SIGTERM) 21:18:26.004703 run iperf3-srv_10.42.42.10(pid=28981): Terminating (SIGTERM) 21:18:26.047870 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28982): Terminating (SIGTERM) 21:18:26.091212 run iperf3-srv_10.42.42.10(pid=28983): Terminating (SIGTERM) 21:18:26.134252 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28984): Terminating (SIGTERM) 21:18:26.177481 run iperf3-srv_10.42.42.10(pid=28985): Terminating (SIGTERM) 21:18:26.220281 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28986): Terminating (SIGTERM) 21:18:26.263319 run iperf3-srv_10.42.42.10(pid=28987): Terminating (SIGTERM) 21:18:26.306165 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28990): Terminating (SIGTERM) 21:18:26.349458 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28993): Terminating (SIGTERM) 21:18:26.392505 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28996): Terminating (SIGTERM) 21:18:26.436239 --- ParallelTerminationStrategy: PID 28980 died... 21:18:26.456781 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28980): Terminated: ok {rc=0} 21:18:26.505223 --- ParallelTerminationStrategy: PID 28981 died... 21:18:26.525460 run iperf3-srv_10.42.42.10(pid=28981): Terminated {rc=256} 21:18:26.573254 --- ParallelTerminationStrategy: PID 28982 died... 21:18:26.593212 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28982): Terminated: ok {rc=0} 21:18:26.641374 --- ParallelTerminationStrategy: PID 28983 died... 21:18:26.661452 run iperf3-srv_10.42.42.10(pid=28983): Terminated {rc=256} 21:18:26.709173 --- ParallelTerminationStrategy: PID 28984 died... 21:18:26.729351 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28984): Terminated: ok {rc=0} 21:18:26.777373 --- ParallelTerminationStrategy: PID 28985 died... 21:18:26.797570 run iperf3-srv_10.42.42.10(pid=28985): Terminated {rc=256} 21:18:26.845649 --- ParallelTerminationStrategy: PID 28986 died... 21:18:26.866043 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28986): Terminated: ok {rc=0} 21:18:26.914159 --- ParallelTerminationStrategy: PID 28987 died... 21:18:26.934645 run iperf3-srv_10.42.42.10(pid=28987): Terminated {rc=256} 21:18:26.982735 --- ParallelTerminationStrategy: PID 28990 died... 21:18:27.003469 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28990): Terminated: ok {rc=0} 21:18:27.051875 --- ParallelTerminationStrategy: PID 28993 died... 21:18:27.072185 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28993): Terminated: ok {rc=0} 21:18:27.120490 --- ParallelTerminationStrategy: PID 28996 died... 21:18:27.140905 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28996): Terminated: ok {rc=0} 21:18:27.231776 bus /gobi_4: Setting Powered False 21:18:28.333921 bus /gobi_4: Setting Powered False 21:18:29.452310 bus /gobi_1: Setting Powered False 21:18:30.552744 bus /gobi_1: Setting Powered False 21:18:31.688076 bus /gobi_0: Setting Powered False 21:18:32.808265 bus /gobi_0: Setting Powered False 21:18:33.928183 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:trx-umtrx+mod-bts0-egprs ping.py ---------------------------------------------- 21:18:35.033212 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:18:35.045552 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:18:35.098897 tst ping.py: using LAC 31566 21:18:35.230212 tst ping.py: using RAC 201 21:18:35.365245 tst ping.py: using CellId 31566 21:18:35.495743 tst ping.py: using BVCI 31567 21:18:35.617364 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:18:35.628841 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:18:35.640173 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:18:35.651746 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:18:35.663220 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:18:35.674737 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:18:35.686479 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:18:35.698213 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:18:35.815616 tst ping.py:19: start network... 21:18:36.022184 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:18:36.501644 run create_hlr_db(pid=28998): Launched 21:18:36.629897 bus /gobi_6: Setting Powered False 21:18:37.691858 run create_hlr_db(pid=28998): Terminated: ok {rc=0} 21:18:38.147134 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29000): Launched 21:18:38.481637 run osmo-hlr_10.42.42.2(pid=29001): Launched 21:18:38.610588 run osmo-stp_10.42.42.5: Starting osmo-stp 21:18:39.191532 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29003): Launched 21:18:39.525679 run osmo-stp_10.42.42.5(pid=29004): Launched 21:18:39.653018 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:18:40.230586 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29006): Launched 21:18:40.358147 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:18:40.641108 run patchelf(pid=29007): Launched 21:18:40.827473 run osmo-stp_10.42.42.5(pid=29004): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29004)] 21:18:40.968879 run osmo-stp_10.42.42.5(pid=29004): stdout: | (launched: 2022-12-12_21:18:39.463937) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:18:41.112229 run osmo-stp_10.42.42.5(pid=29004): stderr: | 20221212211839658 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211839658 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211839659 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211839659 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211839662 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211839662 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211839662 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:18:41.255617 run osmo-stp_10.42.42.5(pid=29004): stdout: | (launched: 2022-12-12_21:18:39.463937) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:18:41.392426 run osmo-stp_10.42.42.5(pid=29004): stderr: | 20221212211839658 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211839658 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211839659 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211839659 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211839662 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211839662 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211839662 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:18:41.554693 run patchelf(pid=29007): Terminating (SIGINT) 21:18:41.741542 run patchelf(pid=29007): Terminated: ok {rc=0} 21:18:41.876192 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=29004): Process ended prematurely: osmo-stp_10.42.42.5(pid=29004) [trial-2382↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29004)] [trial-2382↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22] 21:18:41.886047 tst ping.py:22: Test FAILED (6.8 sec) 21:18:41.915274 run osmo-hlr_10.42.42.2(pid=29001): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29001)] 21:18:41.968043 run osmo-hlr_10.42.42.2(pid=29001): stdout: | (launched: 2022-12-12_21:18:38.419920) 21:18:42.022130 run osmo-hlr_10.42.42.2(pid=29001): stderr: | 20221212211838622 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212211838622 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212211838622 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212211838622 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212211838622 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212211838622 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212211838636 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-umtrx+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212211838646 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212211838646 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212211838646 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:18:42.076616 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29000): Terminating (SIGTERM) 21:18:42.120212 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29003): Terminating (SIGTERM) 21:18:42.163592 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29006): Terminating (SIGTERM) 21:18:42.207510 --- ParallelTerminationStrategy: PID 29000 died... 21:18:42.228323 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29000): Terminated: ok {rc=0} 21:18:42.277186 --- ParallelTerminationStrategy: PID 29003 died... 21:18:42.297503 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29003): Terminated: ok {rc=0} 21:18:42.345586 --- ParallelTerminationStrategy: PID 29006 died... 21:18:42.365977 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29006): Terminated: ok {rc=0} 21:18:42.457094 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:trx-umtrx+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 21:18:43.549153 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:18:43.561905 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:18:43.614571 tst ping_idle_ping.py: using LAC 31567 21:18:43.746525 tst ping_idle_ping.py: using RAC 202 21:18:43.876745 tst ping_idle_ping.py: using CellId 31567 21:18:44.008302 tst ping_idle_ping.py: using BVCI 31568 21:18:44.129958 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:18:44.141747 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:18:44.153321 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:18:44.165152 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:18:44.176802 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:18:44.188416 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:18:44.200232 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:18:44.212132 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:18:44.332712 tst ping_idle_ping.py:24: start network... 21:18:44.558270 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:18:45.080706 run create_hlr_db(pid=29008): Launched 21:18:45.207998 bus /gobi_6: Setting Powered False 21:18:46.276037 run create_hlr_db(pid=29008): Terminated: ok {rc=0} 21:18:46.750189 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29010): Launched 21:18:47.101783 run osmo-hlr_10.42.42.2(pid=29011): Launched 21:18:47.252335 run osmo-stp_10.42.42.5: Starting osmo-stp 21:18:47.834764 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29013): Launched 21:18:48.171117 run osmo-stp_10.42.42.5(pid=29014): Launched 21:18:48.300741 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:18:48.881537 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29016): Launched 21:18:49.010434 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:18:49.296527 run patchelf(pid=29017): Launched 21:18:49.484266 run osmo-stp_10.42.42.5(pid=29014): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29014)] 21:18:49.626049 run osmo-stp_10.42.42.5(pid=29014): stdout: | (launched: 2022-12-12_21:18:48.109263) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:18:49.769612 run osmo-stp_10.42.42.5(pid=29014): stderr: | 20221212211848302 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211848302 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211848302 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211848303 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211848305 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211848305 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211848305 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:18:49.913115 run osmo-stp_10.42.42.5(pid=29014): stdout: | (launched: 2022-12-12_21:18:48.109263) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:18:50.050971 run osmo-stp_10.42.42.5(pid=29014): stderr: | 20221212211848302 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211848302 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211848302 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211848303 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211848305 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211848305 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211848305 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:18:50.213977 run patchelf(pid=29017): Terminating (SIGINT) 21:18:50.401893 run patchelf(pid=29017): Terminated: ok {rc=0} 21:18:50.537235 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=29014): Process ended prematurely: osmo-stp_10.42.42.5(pid=29014) [trial-2382↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29014)] [trial-2382↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27] 21:18:50.547064 tst ping_idle_ping.py:27: Test FAILED (7.0 sec) 21:18:50.576499 run osmo-hlr_10.42.42.2(pid=29011): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29011)] 21:18:50.628618 run osmo-hlr_10.42.42.2(pid=29011): stdout: | (launched: 2022-12-12_21:18:47.040121) 21:18:50.682626 run osmo-hlr_10.42.42.2(pid=29011): stderr: | 20221212211847269 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212211847269 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212211847269 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212211847269 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212211847269 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212211847269 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212211847281 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-umtrx+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212211847290 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212211847290 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212211847290 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:18:50.736855 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29010): Terminating (SIGTERM) 21:18:50.780439 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29013): Terminating (SIGTERM) 21:18:50.824510 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29016): Terminating (SIGTERM) 21:18:50.868575 --- ParallelTerminationStrategy: PID 29010 died... 21:18:50.889476 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29010): Terminated: ok {rc=0} 21:18:50.939722 --- ParallelTerminationStrategy: PID 29013 died... 21:18:50.960136 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29013): Terminated: ok {rc=0} 21:18:51.008551 --- ParallelTerminationStrategy: PID 29016 died... 21:18:51.029124 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29016): Terminated: ok {rc=0} 21:18:51.120249 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2382 gprs:trx-umtrx+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 gprs:trx-umtrx+mod-bts0-dynts-ipa --------------------------------------------------------------------- 21:18:52.433628 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:18:52.440704 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 21:18:52.475403 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 21:18:52.515440 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 21:18:52.606137 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 21:18:52.640626 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 21:18:52.680606 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 21:18:53.276504 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2382 gprs:trx-umtrx+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 21:18:53.331840 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:18:53.343751 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 21:18:53.428746 tst cs_paging_gprs_active.py: using LAC 31568 21:18:53.569443 tst cs_paging_gprs_active.py: using RAC 203 21:18:53.703573 tst cs_paging_gprs_active.py: using CellId 31568 21:18:53.837725 tst cs_paging_gprs_active.py: using BVCI 31569 21:18:53.963840 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:18:53.975319 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:18:53.986765 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:18:53.998678 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:18:54.010248 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:18:54.021888 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:18:54.034066 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:18:54.045661 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:18:54.057462 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:18:54.178158 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:18:54.298081 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 21:18:54.512293 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:18:54.831642 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29022): Launched 21:18:55.107690 run iperf3-srv_10.42.42.10(pid=29023): Launched 21:18:55.227514 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 21:18:55.441785 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:18:55.783084 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29024): Launched 21:18:56.079628 run iperf3-srv_10.42.42.10(pid=29025): Launched 21:18:56.207141 tst cs_paging_gprs_active.py:38: start network... 21:18:56.437011 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:18:56.966042 run create_hlr_db(pid=29026): Launched 21:18:57.096907 bus /gobi_6: Setting Powered False 21:18:58.163622 run create_hlr_db(pid=29026): Terminated: ok {rc=0} 21:18:58.635694 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29028): Launched 21:18:58.977880 run osmo-hlr_10.42.42.2(pid=29029): Launched 21:18:59.107391 run osmo-stp_10.42.42.5: Starting osmo-stp 21:18:59.695129 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29031): Launched 21:19:00.034472 run osmo-stp_10.42.42.5(pid=29032): Launched 21:19:00.164254 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:19:00.751389 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29034): Launched 21:19:00.882394 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:19:01.184261 run patchelf(pid=29035): Launched 21:19:01.426982 run osmo-stp_10.42.42.5(pid=29032): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29032)] 21:19:01.587193 run osmo-stp_10.42.42.5(pid=29032): stdout: | (launched: 2022-12-12_21:18:59.971799) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:19:01.736625 run osmo-stp_10.42.42.5(pid=29032): stderr: | 20221212211900169 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211900169 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211900169 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211900170 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211900170 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211900170 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211900170 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:19:01.886976 run osmo-stp_10.42.42.5(pid=29032): stdout: | (launched: 2022-12-12_21:18:59.971799) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:19:02.031586 run osmo-stp_10.42.42.5(pid=29032): stderr: | 20221212211900169 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211900169 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211900169 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211900170 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211900170 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211900170 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211900170 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:19:02.202309 run patchelf(pid=29035): Terminating (SIGINT) 21:19:02.397144 run patchelf(pid=29035): Terminated: ok {rc=0} 21:19:02.535075 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=29032): Process ended prematurely: osmo-stp_10.42.42.5(pid=29032) [trial-2382↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29032)] [trial-2382↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 21:19:02.545596 tst cs_paging_gprs_active.py:38: Test FAILED (9.3 sec) 21:19:02.575656 run osmo-hlr_10.42.42.2(pid=29029): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29029)] 21:19:02.628026 run osmo-hlr_10.42.42.2(pid=29029): stdout: | (launched: 2022-12-12_21:18:58.914672) 21:19:02.682015 run osmo-hlr_10.42.42.2(pid=29029): stderr: | 20221212211859118 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212211859118 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212211859118 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212211859118 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212211859118 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212211859118 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212211859130 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-umtrx+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212211859142 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212211859142 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212211859142 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:19:02.736595 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29022): Terminating (SIGTERM) 21:19:02.780089 run iperf3-srv_10.42.42.10(pid=29023): Terminating (SIGTERM) 21:19:02.823550 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29024): Terminating (SIGTERM) 21:19:02.867047 run iperf3-srv_10.42.42.10(pid=29025): Terminating (SIGTERM) 21:19:02.910386 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29028): Terminating (SIGTERM) 21:19:02.954218 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29031): Terminating (SIGTERM) 21:19:02.997796 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29034): Terminating (SIGTERM) 21:19:03.041514 --- ParallelTerminationStrategy: PID 29022 died... 21:19:03.061754 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29022): Terminated: ok {rc=0} 21:19:03.110078 --- ParallelTerminationStrategy: PID 29023 died... 21:19:03.130341 run iperf3-srv_10.42.42.10(pid=29023): Terminated {rc=256} 21:19:03.179111 --- ParallelTerminationStrategy: PID 29024 died... 21:19:03.199408 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29024): Terminated: ok {rc=0} 21:19:03.247422 --- ParallelTerminationStrategy: PID 29025 died... 21:19:03.267562 run iperf3-srv_10.42.42.10(pid=29025): Terminated {rc=256} 21:19:03.316104 --- ParallelTerminationStrategy: PID 29028 died... 21:19:03.336362 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29028): Terminated: ok {rc=0} 21:19:03.384718 --- ParallelTerminationStrategy: PID 29031 died... 21:19:03.405073 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29031): Terminated: ok {rc=0} 21:19:03.453376 --- ParallelTerminationStrategy: PID 29034 died... 21:19:03.473635 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29034): Terminated: ok {rc=0} 21:19:03.564144 bus /gobi_0: Setting Powered False 21:19:04.666929 bus /gobi_0: Setting Powered False 21:19:05.786691 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 21:19:06.940883 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:19:06.953612 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 21:19:07.026712 tst iperf3.py: using LAC 31569 21:19:07.160533 tst iperf3.py: using RAC 204 21:19:07.293581 tst iperf3.py: using CellId 31569 21:19:07.418963 tst iperf3.py: using BVCI 31570 21:19:07.535549 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:19:07.546835 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:19:07.557795 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:19:07.569179 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:19:07.579851 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:19:07.590717 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:19:07.601646 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:19:07.612399 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:19:07.623395 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:19:07.740628 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 21:19:07.971074 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:19:08.313031 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29036): Launched 21:19:08.610130 run iperf3-srv_10.42.42.10(pid=29037): Launched 21:19:08.737319 tst iperf3.py:8: start network... 21:19:08.967059 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:19:09.494660 run create_hlr_db(pid=29038): Launched 21:19:09.624515 bus /gobi_6: Setting Powered False 21:19:10.691808 run create_hlr_db(pid=29038): Terminated: ok {rc=0} 21:19:11.143550 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29040): Launched 21:19:11.463320 run osmo-hlr_10.42.42.2(pid=29041): Launched 21:19:11.585949 run osmo-stp_10.42.42.5: Starting osmo-stp 21:19:12.243075 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29043): Launched 21:19:12.554933 run osmo-stp_10.42.42.5(pid=29044): Launched 21:19:12.674830 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:19:13.211930 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29046): Launched 21:19:13.329563 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:19:13.593106 run patchelf(pid=29047): Launched 21:19:13.765262 run osmo-stp_10.42.42.5(pid=29044): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29044)] 21:19:13.896551 run osmo-stp_10.42.42.5(pid=29044): stdout: | (launched: 2022-12-12_21:19:12.496682) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:19:14.029561 run osmo-stp_10.42.42.5(pid=29044): stderr: | 20221212211912668 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211912668 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211912669 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211912669 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211912671 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211912671 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211912672 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:19:14.162159 run osmo-stp_10.42.42.5(pid=29044): stdout: | (launched: 2022-12-12_21:19:12.496682) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:19:14.289957 run osmo-stp_10.42.42.5(pid=29044): stderr: | 20221212211912668 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211912668 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211912669 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211912669 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211912671 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211912671 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211912672 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:19:14.440354 run patchelf(pid=29047): Terminating (SIGINT) 21:19:14.614807 run patchelf(pid=29047): Terminated: ok {rc=0} 21:19:14.740766 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29044): Process ended prematurely: osmo-stp_10.42.42.5(pid=29044) [trial-2382↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29044)] [trial-2382↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8] 21:19:14.750421 tst iperf3.py:8: Test FAILED (7.9 sec) 21:19:14.778042 run osmo-hlr_10.42.42.2(pid=29041): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29041)] 21:19:14.826608 run osmo-hlr_10.42.42.2(pid=29041): stdout: | (launched: 2022-12-12_21:19:11.404622) 21:19:14.877183 run osmo-hlr_10.42.42.2(pid=29041): stderr: | 20221212211911584 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212211911584 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212211911584 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212211911584 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212211911584 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212211911584 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212211911601 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212211911611 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212211911611 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212211911612 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:19:14.928028 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29036): Terminating (SIGTERM) 21:19:14.968585 run iperf3-srv_10.42.42.10(pid=29037): Terminating (SIGTERM) 21:19:15.010598 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29040): Terminating (SIGTERM) 21:19:15.051564 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29043): Terminating (SIGTERM) 21:19:15.091963 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29046): Terminating (SIGTERM) 21:19:15.132610 --- ParallelTerminationStrategy: PID 29036 died... 21:19:15.152173 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29036): Terminated: ok {rc=0} 21:19:15.197098 --- ParallelTerminationStrategy: PID 29037 died... 21:19:15.216010 run iperf3-srv_10.42.42.10(pid=29037): Terminated {rc=256} 21:19:15.260692 --- ParallelTerminationStrategy: PID 29040 died... 21:19:15.279810 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29040): Terminated: ok {rc=0} 21:19:15.324516 --- ParallelTerminationStrategy: PID 29043 died... 21:19:15.343476 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29043): Terminated: ok {rc=0} 21:19:15.388748 --- ParallelTerminationStrategy: PID 29046 died... 21:19:15.407885 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29046): Terminated: ok {rc=0} 21:19:15.495027 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 21:19:16.659438 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:19:16.673652 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 21:19:16.750437 tst iperf3m4.py: using LAC 31570 21:19:16.891144 tst iperf3m4.py: using RAC 205 21:19:17.030198 tst iperf3m4.py: using CellId 31570 21:19:17.180391 tst iperf3m4.py: using BVCI 31571 21:19:17.303925 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:19:17.315685 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:19:17.327257 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:19:17.339838 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:19:17.352263 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:19:17.364750 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:19:17.377282 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:19:17.389599 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:19:17.402521 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:19:17.522994 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:19:17.648726 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:19:17.770489 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:19:17.891905 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 21:19:18.101257 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:19:18.413355 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29048): Launched 21:19:18.685219 run iperf3-srv_10.42.42.10(pid=29049): Launched 21:19:18.801502 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 21:19:19.009224 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:19:19.320784 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29050): Launched 21:19:19.592050 run iperf3-srv_10.42.42.10(pid=29051): Launched 21:19:19.708159 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 21:19:19.915577 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:19:20.227042 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29052): Launched 21:19:20.498921 run iperf3-srv_10.42.42.10(pid=29053): Launched 21:19:20.616343 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 21:19:20.823795 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:19:21.135442 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29054): Launched 21:19:21.405413 run iperf3-srv_10.42.42.10(pid=29055): Launched 21:19:21.522901 tst iperf3m4.py:8: start network... 21:19:21.731481 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:19:22.218452 run create_hlr_db(pid=29056): Launched 21:19:22.345092 bus /gobi_6: Setting Powered False 21:19:23.407389 run create_hlr_db(pid=29056): Terminated: ok {rc=0} 21:19:23.861346 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29058): Launched 21:19:24.197816 run osmo-hlr_10.42.42.2(pid=29059): Launched 21:19:24.324323 run osmo-stp_10.42.42.5: Starting osmo-stp 21:19:24.896423 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29061): Launched 21:19:25.229493 run osmo-stp_10.42.42.5(pid=29062): Launched 21:19:25.358296 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:19:25.934102 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29064): Launched 21:19:26.060909 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:19:26.342325 run patchelf(pid=29065): Launched 21:19:26.525811 run osmo-stp_10.42.42.5(pid=29062): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29062)] 21:19:26.666161 run osmo-stp_10.42.42.5(pid=29062): stdout: | (launched: 2022-12-12_21:19:25.167838) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:19:26.808273 run osmo-stp_10.42.42.5(pid=29062): stderr: | 20221212211925363 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211925363 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211925363 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211925364 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211925364 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211925364 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211925364 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:19:26.950078 run osmo-stp_10.42.42.5(pid=29062): stdout: | (launched: 2022-12-12_21:19:25.167838) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:19:27.086762 run osmo-stp_10.42.42.5(pid=29062): stderr: | 20221212211925363 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211925363 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211925363 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211925364 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211925364 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211925364 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211925364 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:19:27.248411 run patchelf(pid=29065): Terminating (SIGINT) 21:19:27.434438 run patchelf(pid=29065): Terminated: ok {rc=0} 21:19:27.569146 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29062): Process ended prematurely: osmo-stp_10.42.42.5(pid=29062) [trial-2382↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29062)] [trial-2382↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8] 21:19:27.579508 tst iperf3m4.py:8: Test FAILED (11.0 sec) 21:19:27.609561 run osmo-hlr_10.42.42.2(pid=29059): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29059)] 21:19:27.661354 run osmo-hlr_10.42.42.2(pid=29059): stdout: | (launched: 2022-12-12_21:19:24.135747) 21:19:27.714838 run osmo-hlr_10.42.42.2(pid=29059): stderr: | 20221212211924338 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212211924338 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212211924338 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212211924338 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212211924338 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212211924338 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212211924350 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212211924359 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212211924359 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212211924359 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:19:27.769411 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29048): Terminating (SIGTERM) 21:19:27.812531 run iperf3-srv_10.42.42.10(pid=29049): Terminating (SIGTERM) 21:19:27.855653 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29050): Terminating (SIGTERM) 21:19:27.898661 run iperf3-srv_10.42.42.10(pid=29051): Terminating (SIGTERM) 21:19:27.941465 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29052): Terminating (SIGTERM) 21:19:27.984840 run iperf3-srv_10.42.42.10(pid=29053): Terminating (SIGTERM) 21:19:28.027912 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29054): Terminating (SIGTERM) 21:19:28.070877 run iperf3-srv_10.42.42.10(pid=29055): Terminating (SIGTERM) 21:19:28.113646 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29058): Terminating (SIGTERM) 21:19:28.156424 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29061): Terminating (SIGTERM) 21:19:28.200352 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29064): Terminating (SIGTERM) 21:19:28.243668 --- ParallelTerminationStrategy: PID 29048 died... 21:19:28.264099 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29048): Terminated: ok {rc=0} 21:19:28.311962 --- ParallelTerminationStrategy: PID 29049 died... 21:19:28.331783 run iperf3-srv_10.42.42.10(pid=29049): Terminated {rc=256} 21:19:28.379224 --- ParallelTerminationStrategy: PID 29050 died... 21:19:28.399073 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29050): Terminated: ok {rc=0} 21:19:28.446532 --- ParallelTerminationStrategy: PID 29051 died... 21:19:28.466256 run iperf3-srv_10.42.42.10(pid=29051): Terminated {rc=256} 21:19:28.514040 --- ParallelTerminationStrategy: PID 29052 died... 21:19:28.533949 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29052): Terminated: ok {rc=0} 21:19:28.581592 --- ParallelTerminationStrategy: PID 29053 died... 21:19:28.601325 run iperf3-srv_10.42.42.10(pid=29053): Terminated {rc=256} 21:19:28.648574 --- ParallelTerminationStrategy: PID 29054 died... 21:19:28.668482 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29054): Terminated: ok {rc=0} 21:19:28.715967 --- ParallelTerminationStrategy: PID 29055 died... 21:19:28.735754 run iperf3-srv_10.42.42.10(pid=29055): Terminated {rc=256} 21:19:28.782987 --- ParallelTerminationStrategy: PID 29058 died... 21:19:28.802802 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29058): Terminated: ok {rc=0} 21:19:28.850102 --- ParallelTerminationStrategy: PID 29061 died... 21:19:28.869907 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29061): Terminated: ok {rc=0} 21:19:28.917228 --- ParallelTerminationStrategy: PID 29064 died... 21:19:28.937192 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29064): Terminated: ok {rc=0} 21:19:29.027075 bus /gobi_4: Setting Powered False 21:19:30.130295 bus /gobi_4: Setting Powered False 21:19:31.250121 bus /gobi_1: Setting Powered False 21:19:32.363581 bus /gobi_1: Setting Powered False 21:19:33.481380 bus /gobi_0: Setting Powered False 21:19:34.580194 bus /gobi_0: Setting Powered False 21:19:35.697751 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:trx-umtrx+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 21:19:36.798374 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:19:36.809974 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 21:19:36.879695 tst ping.py: using LAC 31571 21:19:37.000134 tst ping.py: using RAC 206 21:19:37.120213 tst ping.py: using CellId 31571 21:19:37.240299 tst ping.py: using BVCI 31572 21:19:37.350974 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:19:37.361906 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:19:37.372456 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:19:37.383070 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:19:37.393670 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:19:37.404347 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:19:37.415052 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:19:37.425725 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:19:37.543586 tst ping.py:19: start network... 21:19:37.760807 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:19:38.261689 run create_hlr_db(pid=29067): Launched 21:19:38.384755 bus /gobi_6: Setting Powered False 21:19:39.447281 run create_hlr_db(pid=29067): Terminated: ok {rc=0} 21:19:39.894712 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29069): Launched 21:19:40.216545 run osmo-hlr_10.42.42.2(pid=29070): Launched 21:19:40.339253 run osmo-stp_10.42.42.5: Starting osmo-stp 21:19:40.890783 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29072): Launched 21:19:41.213837 run osmo-stp_10.42.42.5(pid=29073): Launched 21:19:41.337118 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:19:41.895225 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29075): Launched 21:19:42.018027 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:19:42.289435 run patchelf(pid=29076): Launched 21:19:42.468115 run osmo-stp_10.42.42.5(pid=29073): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29073)] 21:19:42.604818 run osmo-stp_10.42.42.5(pid=29073): stdout: | (launched: 2022-12-12_21:19:41.153340) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:19:42.743107 run osmo-stp_10.42.42.5(pid=29073): stderr: | 20221212211941343 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211941343 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211941344 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211941344 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211941344 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211941344 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211941345 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:19:42.881666 run osmo-stp_10.42.42.5(pid=29073): stdout: | (launched: 2022-12-12_21:19:41.153340) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:19:43.015000 run osmo-stp_10.42.42.5(pid=29073): stderr: | 20221212211941343 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211941343 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211941344 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211941344 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211941344 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211941344 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211941345 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:19:43.172087 run patchelf(pid=29076): Terminating (SIGINT) 21:19:43.353935 run patchelf(pid=29076): Terminated: ok {rc=0} 21:19:43.484748 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=29073): Process ended prematurely: osmo-stp_10.42.42.5(pid=29073) [trial-2382↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29073)] [trial-2382↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22] 21:19:43.494357 tst ping.py:22: Test FAILED (6.7 sec) 21:19:43.522829 run osmo-hlr_10.42.42.2(pid=29070): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29070)] 21:19:43.574699 run osmo-hlr_10.42.42.2(pid=29070): stdout: | (launched: 2022-12-12_21:19:40.157753) 21:19:43.628062 run osmo-hlr_10.42.42.2(pid=29070): stderr: | 20221212211940353 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212211940353 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212211940353 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212211940353 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212211940353 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212211940353 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212211940364 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212211940373 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212211940373 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212211940373 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:19:43.681840 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29069): Terminating (SIGTERM) 21:19:43.724512 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29072): Terminating (SIGTERM) 21:19:43.767691 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29075): Terminating (SIGTERM) 21:19:43.810623 --- ParallelTerminationStrategy: PID 29069 died... 21:19:43.830936 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29069): Terminated: ok {rc=0} 21:19:43.878275 --- ParallelTerminationStrategy: PID 29072 died... 21:19:43.897930 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29072): Terminated: ok {rc=0} 21:19:43.945238 --- ParallelTerminationStrategy: PID 29075 died... 21:19:43.965329 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29075): Terminated: ok {rc=0} 21:19:44.055089 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:trx-umtrx+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 21:19:45.142502 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:19:45.154428 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 21:19:45.232287 tst ping_idle_ping.py: using LAC 31572 21:19:45.359116 tst ping_idle_ping.py: using RAC 207 21:19:45.484938 tst ping_idle_ping.py: using CellId 31572 21:19:45.610468 tst ping_idle_ping.py: using BVCI 31573 21:19:45.729421 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:19:45.740740 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:19:45.751980 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:19:45.763463 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:19:45.775019 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:19:45.786514 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:19:45.798114 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:19:45.809588 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:19:45.941306 tst ping_idle_ping.py:24: start network... 21:19:46.169175 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:19:46.682663 run create_hlr_db(pid=29077): Launched 21:19:46.836934 bus /gobi_6: Setting Powered False 21:19:47.897292 run create_hlr_db(pid=29077): Terminated: ok {rc=0} 21:19:48.348194 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29079): Launched 21:19:48.670009 run osmo-hlr_10.42.42.2(pid=29080): Launched 21:19:48.792254 run osmo-stp_10.42.42.5: Starting osmo-stp 21:19:49.343936 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29082): Launched 21:19:49.667498 run osmo-stp_10.42.42.5(pid=29083): Launched 21:19:49.790491 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:19:50.347638 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29085): Launched 21:19:50.466826 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:19:50.722539 run patchelf(pid=29086): Launched 21:19:50.889793 run osmo-stp_10.42.42.5(pid=29083): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29083)] 21:19:51.017876 run osmo-stp_10.42.42.5(pid=29083): stdout: | (launched: 2022-12-12_21:19:49.607687) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:19:51.147504 run osmo-stp_10.42.42.5(pid=29083): stderr: | 20221212211949797 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211949798 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211949798 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211949798 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211949799 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211949799 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211949799 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:19:51.277180 run osmo-stp_10.42.42.5(pid=29083): stdout: | (launched: 2022-12-12_21:19:49.607687) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:19:51.401099 run osmo-stp_10.42.42.5(pid=29083): stderr: | 20221212211949797 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212211949798 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212211949798 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212211949798 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212211949799 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212211949799 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212211949799 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:19:51.547306 run patchelf(pid=29086): Terminating (SIGINT) 21:19:51.717942 run patchelf(pid=29086): Terminated: ok {rc=0} 21:19:51.841113 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=29083): Process ended prematurely: osmo-stp_10.42.42.5(pid=29083) [trial-2382↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29083)] [trial-2382↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 21:19:51.850081 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 21:19:51.877024 run osmo-hlr_10.42.42.2(pid=29080): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29080)] 21:19:51.925207 run osmo-hlr_10.42.42.2(pid=29080): stdout: | (launched: 2022-12-12_21:19:48.610794) 21:19:51.975251 run osmo-hlr_10.42.42.2(pid=29080): stderr: | 20221212211948807 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212211948807 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212211948807 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212211948807 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212211948807 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212211948807 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212211948855 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212211948864 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212211948864 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212211948864 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:19:52.025705 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29079): Terminating (SIGTERM) 21:19:52.066200 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29082): Terminating (SIGTERM) 21:19:52.106729 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29085): Terminating (SIGTERM) 21:19:52.147421 --- ParallelTerminationStrategy: PID 29079 died... 21:19:52.166791 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29079): Terminated: ok {rc=0} 21:19:52.211925 --- ParallelTerminationStrategy: PID 29082 died... 21:19:52.230928 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29082): Terminated: ok {rc=0} 21:19:52.276068 --- ParallelTerminationStrategy: PID 29085 died... 21:19:52.295009 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29085): Terminated: ok {rc=0} 21:19:52.379385 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2382 gprs:trx-umtrx+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 gprs:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 21:19:53.685617 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:19:53.692165 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 21:19:53.726603 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 21:19:53.766081 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 21:19:53.856499 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 21:19:53.890668 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 21:19:53.930233 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 21:19:54.522611 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2382 gprs:trx-umtrx+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 21:19:54.575311 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:19:54.586780 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 21:19:54.658025 tst cs_paging_gprs_active.py: using LAC 31573 21:19:54.786678 tst cs_paging_gprs_active.py: using RAC 208 21:19:54.915517 tst cs_paging_gprs_active.py: using CellId 31573 21:19:55.037154 tst cs_paging_gprs_active.py: using BVCI 31574 21:19:55.150789 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:19:55.161803 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:19:55.172460 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:19:55.184148 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:19:55.195354 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:19:55.206672 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:19:55.218053 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:19:55.229292 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:19:55.240596 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 21:19:55.363133 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 21:19:55.484894 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 21:19:55.693507 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:19:56.003027 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29090): Launched 21:19:56.269708 run iperf3-srv_10.42.42.10(pid=29091): Launched 21:19:56.384781 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 21:19:56.591536 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:19:56.901592 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29092): Launched 21:19:57.169638 run iperf3-srv_10.42.42.10(pid=29093): Launched 21:19:57.284769 tst cs_paging_gprs_active.py:38: start network... 21:19:57.492334 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:19:57.972044 run create_hlr_db(pid=29094): Launched 21:19:58.097621 bus /gobi_6: Setting Powered False 21:19:59.159683 run create_hlr_db(pid=29094): Terminated: ok {rc=0} 21:19:59.607909 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29096): Launched 21:19:59.936218 run osmo-hlr_10.42.42.2(pid=29097): Launched 21:20:00.061999 run osmo-stp_10.42.42.5: Starting osmo-stp 21:20:00.626560 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29099): Launched 21:20:00.977084 run osmo-stp_10.42.42.5(pid=29100): Launched 21:20:01.215482 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:20:01.877740 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29105): Launched 21:20:02.006725 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:20:02.294053 run patchelf(pid=29106): Launched 21:20:02.485226 run osmo-stp_10.42.42.5(pid=29100): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29100)] 21:20:02.623869 run osmo-stp_10.42.42.5(pid=29100): stdout: | (launched: 2022-12-12_21:20:00.914754) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:20:02.763819 run osmo-stp_10.42.42.5(pid=29100): stderr: | 20221212212001248 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212001252 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212001252 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212001253 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212001253 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212001253 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212001253 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:20:02.903813 run osmo-stp_10.42.42.5(pid=29100): stdout: | (launched: 2022-12-12_21:20:00.914754) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:20:03.039235 run osmo-stp_10.42.42.5(pid=29100): stderr: | 20221212212001248 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212001252 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212001252 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212001253 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212001253 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212001253 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212001253 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:20:03.198981 run patchelf(pid=29106): Terminating (SIGINT) 21:20:03.383062 run patchelf(pid=29106): Terminated: ok {rc=0} 21:20:03.515807 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=29100): Process ended prematurely: osmo-stp_10.42.42.5(pid=29100) [trial-2382↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29100)] [trial-2382↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 21:20:03.526136 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 21:20:03.555795 run osmo-hlr_10.42.42.2(pid=29097): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29097)] 21:20:03.607774 run osmo-hlr_10.42.42.2(pid=29097): stdout: | (launched: 2022-12-12_21:19:59.876172) 21:20:03.661277 run osmo-hlr_10.42.42.2(pid=29097): stderr: | 20221212212000072 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212212000072 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212212000072 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212212000073 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212212000073 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212212000073 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212212000085 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-umtrx+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212212000095 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212212000095 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212212000095 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:20:03.715092 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29090): Terminating (SIGTERM) 21:20:03.758033 run iperf3-srv_10.42.42.10(pid=29091): Terminating (SIGTERM) 21:20:03.801017 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29092): Terminating (SIGTERM) 21:20:03.844058 run iperf3-srv_10.42.42.10(pid=29093): Terminating (SIGTERM) 21:20:03.887033 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29096): Terminating (SIGTERM) 21:20:03.930063 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29099): Terminating (SIGTERM) 21:20:03.973239 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29105): Terminating (SIGTERM) 21:20:04.016552 --- ParallelTerminationStrategy: PID 29090 died... 21:20:04.036862 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29090): Terminated: ok {rc=0} 21:20:04.084814 --- ParallelTerminationStrategy: PID 29091 died... 21:20:04.104659 run iperf3-srv_10.42.42.10(pid=29091): Terminated {rc=256} 21:20:04.152439 --- ParallelTerminationStrategy: PID 29092 died... 21:20:04.172394 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29092): Terminated: ok {rc=0} 21:20:04.220307 --- ParallelTerminationStrategy: PID 29093 died... 21:20:04.240384 run iperf3-srv_10.42.42.10(pid=29093): Terminated {rc=256} 21:20:04.288094 --- ParallelTerminationStrategy: PID 29096 died... 21:20:04.308008 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29096): Terminated: ok {rc=0} 21:20:04.355922 --- ParallelTerminationStrategy: PID 29099 died... 21:20:04.376094 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29099): Terminated: ok {rc=0} 21:20:04.423805 --- ParallelTerminationStrategy: PID 29105 died... 21:20:04.443994 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29105): Terminated: ok {rc=0} 21:20:04.534251 bus /gobi_0: Setting Powered False 21:20:05.634732 bus /gobi_0: Setting Powered False 21:20:06.753322 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 21:20:07.903572 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:20:07.915724 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 21:20:07.988225 tst iperf3.py: using LAC 31574 21:20:08.117371 tst iperf3.py: using RAC 209 21:20:08.244561 tst iperf3.py: using CellId 31574 21:20:08.372229 tst iperf3.py: using BVCI 31575 21:20:08.491000 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:20:08.502434 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:20:08.513597 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:20:08.525048 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:20:08.536435 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:20:08.547963 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:20:08.559499 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:20:08.571082 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:20:08.582927 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 21:20:08.703689 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 21:20:08.923449 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:20:09.249681 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29108): Launched 21:20:09.532581 run iperf3-srv_10.42.42.10(pid=29109): Launched 21:20:09.654991 tst iperf3.py:8: start network... 21:20:09.874754 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:20:10.379777 run create_hlr_db(pid=29110): Launched 21:20:10.503492 bus /gobi_6: Setting Powered False 21:20:11.567907 run create_hlr_db(pid=29110): Terminated: ok {rc=0} 21:20:12.011850 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29112): Launched 21:20:12.347784 run osmo-hlr_10.42.42.2(pid=29113): Launched 21:20:12.473548 run osmo-stp_10.42.42.5: Starting osmo-stp 21:20:13.048458 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29115): Launched 21:20:13.376580 run osmo-stp_10.42.42.5(pid=29116): Launched 21:20:13.502552 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:20:14.071136 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29118): Launched 21:20:14.197352 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:20:14.475359 run patchelf(pid=29119): Launched 21:20:14.658246 run osmo-stp_10.42.42.5(pid=29116): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29116)] 21:20:14.797631 run osmo-stp_10.42.42.5(pid=29116): stdout: | (launched: 2022-12-12_21:20:13.317084) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:20:14.938627 run osmo-stp_10.42.42.5(pid=29116): stderr: | 20221212212013505 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212013505 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212013505 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212013506 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212013506 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212013506 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212013506 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:20:15.080193 run osmo-stp_10.42.42.5(pid=29116): stdout: | (launched: 2022-12-12_21:20:13.317084) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:20:15.215687 run osmo-stp_10.42.42.5(pid=29116): stderr: | 20221212212013505 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212013505 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212013505 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212013506 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212013506 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212013506 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212013506 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:20:15.376358 run patchelf(pid=29119): Terminating (SIGINT) 21:20:15.562071 run patchelf(pid=29119): Terminated: ok {rc=0} 21:20:15.696089 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29116): Process ended prematurely: osmo-stp_10.42.42.5(pid=29116) [trial-2382↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29116)] [trial-2382↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8] 21:20:15.706517 tst iperf3.py:8: Test FAILED (7.8 sec) 21:20:15.736241 run osmo-hlr_10.42.42.2(pid=29113): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29113)] 21:20:15.788226 run osmo-hlr_10.42.42.2(pid=29113): stdout: | (launched: 2022-12-12_21:20:12.288595) 21:20:15.854743 run osmo-hlr_10.42.42.2(pid=29113): stderr: | 20221212212012481 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212212012481 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212212012481 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212212012481 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212212012481 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212212012481 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212212012499 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212212012509 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212212012509 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212212012509 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:20:15.910751 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29108): Terminating (SIGTERM) 21:20:15.956361 run iperf3-srv_10.42.42.10(pid=29109): Terminating (SIGTERM) 21:20:16.003253 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29112): Terminating (SIGTERM) 21:20:16.048867 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29115): Terminating (SIGTERM) 21:20:16.094153 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29118): Terminating (SIGTERM) 21:20:16.139660 --- ParallelTerminationStrategy: PID 29108 died... 21:20:16.160799 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29108): Terminated: ok {rc=0} 21:20:16.212939 --- ParallelTerminationStrategy: PID 29109 died... 21:20:16.234077 run iperf3-srv_10.42.42.10(pid=29109): Terminated {rc=256} 21:20:16.284862 --- ParallelTerminationStrategy: PID 29112 died... 21:20:16.305944 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29112): Terminated: ok {rc=0} 21:20:16.356770 --- ParallelTerminationStrategy: PID 29115 died... 21:20:16.377861 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29115): Terminated: ok {rc=0} 21:20:16.428834 --- ParallelTerminationStrategy: PID 29118 died... 21:20:16.450076 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29118): Terminated: ok {rc=0} 21:20:16.545088 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 21:20:17.693209 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:20:17.704861 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 21:20:17.774869 tst iperf3m4.py: using LAC 31575 21:20:17.898657 tst iperf3m4.py: using RAC 210 21:20:18.022330 tst iperf3m4.py: using CellId 31575 21:20:18.152339 tst iperf3m4.py: using BVCI 31576 21:20:18.265292 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:20:18.276190 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:20:18.287001 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:20:18.297947 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:20:18.308613 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:20:18.319405 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:20:18.330357 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:20:18.341046 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:20:18.352017 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 21:20:18.468106 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 21:20:18.591581 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 21:20:18.709495 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 21:20:18.829282 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 21:20:19.035014 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:20:19.342832 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29120): Launched 21:20:19.609956 run iperf3-srv_10.42.42.10(pid=29121): Launched 21:20:19.724469 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 21:20:19.931144 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:20:20.238926 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29122): Launched 21:20:20.505261 run iperf3-srv_10.42.42.10(pid=29123): Launched 21:20:20.620505 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 21:20:20.826470 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:20:21.134661 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29124): Launched 21:20:21.401451 run iperf3-srv_10.42.42.10(pid=29125): Launched 21:20:21.517005 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 21:20:21.723870 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:20:22.034527 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29126): Launched 21:20:22.301386 run iperf3-srv_10.42.42.10(pid=29127): Launched 21:20:22.417414 tst iperf3m4.py:8: start network... 21:20:22.623643 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:20:23.101645 run create_hlr_db(pid=29128): Launched 21:20:23.227298 bus /gobi_6: Setting Powered False 21:20:24.289265 run create_hlr_db(pid=29128): Terminated: ok {rc=0} 21:20:24.739904 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29130): Launched 21:20:25.071406 run osmo-hlr_10.42.42.2(pid=29131): Launched 21:20:25.196654 run osmo-stp_10.42.42.5: Starting osmo-stp 21:20:25.765706 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29133): Launched 21:20:26.095880 run osmo-stp_10.42.42.5(pid=29134): Launched 21:20:26.220583 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:20:26.788847 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29136): Launched 21:20:26.915001 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:20:27.194187 run patchelf(pid=29137): Launched 21:20:27.377792 run osmo-stp_10.42.42.5(pid=29134): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29134)] 21:20:27.517963 run osmo-stp_10.42.42.5(pid=29134): stdout: | (launched: 2022-12-12_21:20:26.035797) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:20:27.659785 run osmo-stp_10.42.42.5(pid=29134): stderr: | 20221212212026224 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212026225 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212026225 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212026225 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212026226 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212026226 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212026226 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:20:27.801533 run osmo-stp_10.42.42.5(pid=29134): stdout: | (launched: 2022-12-12_21:20:26.035797) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:20:27.937292 run osmo-stp_10.42.42.5(pid=29134): stderr: | 20221212212026224 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212026225 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212026225 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212026225 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212026226 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212026226 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212026226 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:20:28.099596 run patchelf(pid=29137): Terminating (SIGINT) 21:20:28.286026 run patchelf(pid=29137): Terminated: ok {rc=0} 21:20:28.420452 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29134): Process ended prematurely: osmo-stp_10.42.42.5(pid=29134) [trial-2382↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29134)] [trial-2382↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8] 21:20:28.430964 tst iperf3m4.py:8: Test FAILED (10.8 sec) 21:20:28.461147 run osmo-hlr_10.42.42.2(pid=29131): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29131)] 21:20:28.512936 run osmo-hlr_10.42.42.2(pid=29131): stdout: | (launched: 2022-12-12_21:20:25.011134) 21:20:28.566943 run osmo-hlr_10.42.42.2(pid=29131): stderr: | 20221212212025205 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212212025206 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212212025206 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212212025206 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212212025206 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212212025206 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212212025221 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212212025230 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212212025230 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212212025231 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:20:28.621367 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29120): Terminating (SIGTERM) 21:20:28.664489 run iperf3-srv_10.42.42.10(pid=29121): Terminating (SIGTERM) 21:20:28.707826 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29122): Terminating (SIGTERM) 21:20:28.751069 run iperf3-srv_10.42.42.10(pid=29123): Terminating (SIGTERM) 21:20:28.794363 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29124): Terminating (SIGTERM) 21:20:28.837636 run iperf3-srv_10.42.42.10(pid=29125): Terminating (SIGTERM) 21:20:28.880824 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29126): Terminating (SIGTERM) 21:20:28.924286 run iperf3-srv_10.42.42.10(pid=29127): Terminating (SIGTERM) 21:20:28.967556 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29130): Terminating (SIGTERM) 21:20:29.011282 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29133): Terminating (SIGTERM) 21:20:29.054850 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29136): Terminating (SIGTERM) 21:20:29.098569 --- ParallelTerminationStrategy: PID 29120 died... 21:20:29.119157 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29120): Terminated: ok {rc=0} 21:20:29.167237 --- ParallelTerminationStrategy: PID 29121 died... 21:20:29.187292 run iperf3-srv_10.42.42.10(pid=29121): Terminated {rc=256} 21:20:29.234978 --- ParallelTerminationStrategy: PID 29122 died... 21:20:29.255153 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29122): Terminated: ok {rc=0} 21:20:29.302905 --- ParallelTerminationStrategy: PID 29123 died... 21:20:29.322831 run iperf3-srv_10.42.42.10(pid=29123): Terminated {rc=256} 21:20:29.370589 --- ParallelTerminationStrategy: PID 29124 died... 21:20:29.390624 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29124): Terminated: ok {rc=0} 21:20:29.438963 --- ParallelTerminationStrategy: PID 29125 died... 21:20:29.459049 run iperf3-srv_10.42.42.10(pid=29125): Terminated {rc=256} 21:20:29.506992 --- ParallelTerminationStrategy: PID 29126 died... 21:20:29.527077 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29126): Terminated: ok {rc=0} 21:20:29.575043 --- ParallelTerminationStrategy: PID 29127 died... 21:20:29.595112 run iperf3-srv_10.42.42.10(pid=29127): Terminated {rc=256} 21:20:29.642808 --- ParallelTerminationStrategy: PID 29130 died... 21:20:29.662869 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29130): Terminated: ok {rc=0} 21:20:29.710548 --- ParallelTerminationStrategy: PID 29133 died... 21:20:29.730604 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29133): Terminated: ok {rc=0} 21:20:29.778275 --- ParallelTerminationStrategy: PID 29136 died... 21:20:29.798485 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29136): Terminated: ok {rc=0} 21:20:29.888876 bus /gobi_4: Setting Powered False 21:20:30.994515 bus /gobi_4: Setting Powered False 21:20:32.129841 bus /gobi_1: Setting Powered False 21:20:33.232998 bus /gobi_1: Setting Powered False 21:20:34.351728 bus /gobi_0: Setting Powered False 21:20:35.450939 bus /gobi_0: Setting Powered False 21:20:36.570364 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:trx-umtrx+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 21:20:37.676071 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:20:37.688381 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 21:20:37.761991 tst ping.py: using LAC 31576 21:20:37.889920 tst ping.py: using RAC 211 21:20:38.017420 tst ping.py: using CellId 31576 21:20:38.146171 tst ping.py: using BVCI 31577 21:20:38.266282 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:20:38.277799 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:20:38.288887 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:20:38.300446 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:20:38.311959 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:20:38.323540 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:20:38.335316 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:20:38.346901 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 21:20:38.466002 tst ping.py:19: start network... 21:20:38.669242 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:20:39.141325 run create_hlr_db(pid=29138): Launched 21:20:39.266520 bus /gobi_6: Setting Powered False 21:20:40.327503 run create_hlr_db(pid=29138): Terminated: ok {rc=0} 21:20:40.772690 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29140): Launched 21:20:41.098014 run osmo-hlr_10.42.42.2(pid=29141): Launched 21:20:41.221378 run osmo-stp_10.42.42.5: Starting osmo-stp 21:20:41.785105 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29143): Launched 21:20:42.111587 run osmo-stp_10.42.42.5(pid=29144): Launched 21:20:42.234920 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:20:42.795370 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29146): Launched 21:20:42.920858 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:20:43.196012 run patchelf(pid=29147): Launched 21:20:43.377082 run osmo-stp_10.42.42.5(pid=29144): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29144)] 21:20:43.515522 run osmo-stp_10.42.42.5(pid=29144): stdout: | (launched: 2022-12-12_21:20:42.052403) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:20:43.655547 run osmo-stp_10.42.42.5(pid=29144): stderr: | 20221212212042241 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212042241 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212042241 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212042242 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212042242 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212042242 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212042242 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:20:43.795991 run osmo-stp_10.42.42.5(pid=29144): stdout: | (launched: 2022-12-12_21:20:42.052403) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:20:43.930048 run osmo-stp_10.42.42.5(pid=29144): stderr: | 20221212212042241 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212042241 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212042241 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212042242 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212042242 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212042242 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212042242 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:20:44.089245 run patchelf(pid=29147): Terminating (SIGINT) 21:20:44.272088 run patchelf(pid=29147): Terminated: ok {rc=0} 21:20:44.404401 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=29144): Process ended prematurely: osmo-stp_10.42.42.5(pid=29144) [trial-2382↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29144)] [trial-2382↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22] 21:20:44.414187 tst ping.py:22: Test FAILED (6.7 sec) 21:20:44.443345 run osmo-hlr_10.42.42.2(pid=29141): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29141)] 21:20:44.494991 run osmo-hlr_10.42.42.2(pid=29141): stdout: | (launched: 2022-12-12_21:20:41.039170) 21:20:44.548378 run osmo-hlr_10.42.42.2(pid=29141): stderr: | 20221212212041234 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212212041234 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212212041234 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212212041234 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212212041234 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212212041234 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212212041250 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212212041260 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212212041260 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212212041260 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:20:44.603004 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29140): Terminating (SIGTERM) 21:20:44.645941 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29143): Terminating (SIGTERM) 21:20:44.689087 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29146): Terminating (SIGTERM) 21:20:44.732422 --- ParallelTerminationStrategy: PID 29140 died... 21:20:44.753151 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29140): Terminated: ok {rc=0} 21:20:44.801499 --- ParallelTerminationStrategy: PID 29143 died... 21:20:44.821728 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29143): Terminated: ok {rc=0} 21:20:44.869720 --- ParallelTerminationStrategy: PID 29146 died... 21:20:44.889642 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29146): Terminated: ok {rc=0} 21:20:44.979958 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:trx-umtrx+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 21:20:46.072430 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:20:46.088192 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 21:20:46.178778 tst ping_idle_ping.py: using LAC 31577 21:20:46.330822 tst ping_idle_ping.py: using RAC 212 21:20:46.464927 tst ping_idle_ping.py: using CellId 31577 21:20:46.633425 tst ping_idle_ping.py: using BVCI 31578 21:20:46.748629 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:20:46.759874 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:20:46.771349 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:20:46.782779 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:20:46.794213 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:20:46.806499 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:20:46.818794 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:20:46.830489 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 21:20:46.953550 tst ping_idle_ping.py:24: start network... 21:20:47.222548 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:20:47.698436 run create_hlr_db(pid=29148): Launched 21:20:47.822906 bus /gobi_6: Setting Powered False 21:20:48.883868 run create_hlr_db(pid=29148): Terminated: ok {rc=0} 21:20:49.329694 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29150): Launched 21:20:49.658221 run osmo-hlr_10.42.42.2(pid=29151): Launched 21:20:49.781854 run osmo-stp_10.42.42.5: Starting osmo-stp 21:20:50.349654 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29153): Launched 21:20:50.677633 run osmo-stp_10.42.42.5(pid=29154): Launched 21:20:50.803411 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:20:51.369788 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29156): Launched 21:20:51.496790 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:20:51.773674 run patchelf(pid=29157): Launched 21:20:51.955753 run osmo-stp_10.42.42.5(pid=29154): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29154)] 21:20:52.095880 run osmo-stp_10.42.42.5(pid=29154): stdout: | (launched: 2022-12-12_21:20:50.618356) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:20:52.236801 run osmo-stp_10.42.42.5(pid=29154): stderr: | 20221212212050807 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212050807 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212050808 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212050808 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212050809 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212050809 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212050809 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:20:52.377685 run osmo-stp_10.42.42.5(pid=29154): stdout: | (launched: 2022-12-12_21:20:50.618356) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:20:52.512635 run osmo-stp_10.42.42.5(pid=29154): stderr: | 20221212212050807 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212050807 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212050808 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212050808 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212050809 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212050809 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212050809 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:20:52.672378 run patchelf(pid=29157): Terminating (SIGINT) 21:20:52.857269 run patchelf(pid=29157): Terminated: ok {rc=0} 21:20:52.990766 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=29154): Process ended prematurely: osmo-stp_10.42.42.5(pid=29154) [trial-2382↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29154)] [trial-2382↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 21:20:53.000934 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 21:20:53.030364 run osmo-hlr_10.42.42.2(pid=29151): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29151)] 21:20:53.082155 run osmo-hlr_10.42.42.2(pid=29151): stdout: | (launched: 2022-12-12_21:20:49.599026) 21:20:53.135782 run osmo-hlr_10.42.42.2(pid=29151): stderr: | 20221212212049794 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212212049794 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212212049794 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212212049794 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212212049794 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212212049794 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212212049807 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212212049817 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212212049817 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212212049817 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:20:53.189952 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29150): Terminating (SIGTERM) 21:20:53.233262 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29153): Terminating (SIGTERM) 21:20:53.276678 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29156): Terminating (SIGTERM) 21:20:53.320219 --- ParallelTerminationStrategy: PID 29150 died... 21:20:53.341072 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29150): Terminated: ok {rc=0} 21:20:53.389449 --- ParallelTerminationStrategy: PID 29153 died... 21:20:53.409680 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29153): Terminated: ok {rc=0} 21:20:53.457611 --- ParallelTerminationStrategy: PID 29156 died... 21:20:53.477751 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29156): Terminated: ok {rc=0} 21:20:53.568694 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2382 gprs:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 21:20:54.878652 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:20:54.885859 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 21:20:54.920077 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 21:20:54.960108 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 21:20:55.050233 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 21:20:55.083655 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 21:20:55.123395 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 21:20:55.731850 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2382 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 21:20:55.785873 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:20:55.798055 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 21:20:55.850736 tst cs_paging_gprs_active.py: using LAC 31578 21:20:55.981049 tst cs_paging_gprs_active.py: using RAC 213 21:20:56.104468 tst cs_paging_gprs_active.py: using CellId 31578 21:20:56.229067 tst cs_paging_gprs_active.py: using BVCI 31579 21:20:56.343318 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:20:56.355057 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:20:56.366137 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:20:56.377170 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:20:56.388110 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:20:56.399067 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:20:56.410163 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:20:56.421178 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:20:56.432378 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 21:20:56.553691 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 21:20:56.677190 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 21:20:56.902445 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:20:57.236422 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29162): Launched 21:20:57.525161 run iperf3-srv_10.42.42.10(pid=29163): Launched 21:20:57.651227 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 21:20:57.876284 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:20:58.211039 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29164): Launched 21:20:58.501148 run iperf3-srv_10.42.42.10(pid=29165): Launched 21:20:58.627334 tst cs_paging_gprs_active.py:38: start network... 21:20:58.852502 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:20:59.370141 run create_hlr_db(pid=29166): Launched 21:20:59.498119 bus /gobi_6: Setting Powered False 21:21:00.563680 run create_hlr_db(pid=29166): Terminated: ok {rc=0} 21:21:01.041031 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29168): Launched 21:21:01.409108 run osmo-hlr_10.42.42.2(pid=29169): Launched 21:21:01.648091 run osmo-stp_10.42.42.5: Starting osmo-stp 21:21:02.376464 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29171): Launched 21:21:02.707667 run osmo-stp_10.42.42.5(pid=29172): Launched 21:21:02.834054 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:21:03.406341 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29174): Launched 21:21:03.532615 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:21:03.813976 run patchelf(pid=29175): Launched 21:21:03.998732 run osmo-stp_10.42.42.5(pid=29172): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29172)] 21:21:04.139296 run osmo-stp_10.42.42.5(pid=29172): stdout: | (launched: 2022-12-12_21:21:02.647696) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:21:04.281501 run osmo-stp_10.42.42.5(pid=29172): stderr: | 20221212212102837 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212102837 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212102837 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212102837 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212102838 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212102838 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212102838 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:21:04.423315 run osmo-stp_10.42.42.5(pid=29172): stdout: | (launched: 2022-12-12_21:21:02.647696) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:21:04.559667 run osmo-stp_10.42.42.5(pid=29172): stderr: | 20221212212102837 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212102837 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212102837 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212102837 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212102838 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212102838 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212102838 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:21:04.720649 run patchelf(pid=29175): Terminating (SIGINT) 21:21:04.907052 run patchelf(pid=29175): Terminated: ok {rc=0} 21:21:05.042106 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=29172): Process ended prematurely: osmo-stp_10.42.42.5(pid=29172) [trial-2382↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29172)] [trial-2382↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 21:21:05.052708 tst cs_paging_gprs_active.py:38: Test FAILED (9.3 sec) 21:21:05.082340 run osmo-hlr_10.42.42.2(pid=29169): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29169)] 21:21:05.133931 run osmo-hlr_10.42.42.2(pid=29169): stdout: | (launched: 2022-12-12_21:21:01.331854) 21:21:05.187234 run osmo-hlr_10.42.42.2(pid=29169): stderr: | 20221212212101636 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212212101636 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212212101636 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212212101636 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212212101636 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212212101636 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212212101655 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212212101668 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212212101668 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212212101668 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:21:05.241372 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29162): Terminating (SIGTERM) 21:21:05.284413 run iperf3-srv_10.42.42.10(pid=29163): Terminating (SIGTERM) 21:21:05.327543 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29164): Terminating (SIGTERM) 21:21:05.370698 run iperf3-srv_10.42.42.10(pid=29165): Terminating (SIGTERM) 21:21:05.413661 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29168): Terminating (SIGTERM) 21:21:05.456718 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29171): Terminating (SIGTERM) 21:21:05.499765 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29174): Terminating (SIGTERM) 21:21:05.543137 --- ParallelTerminationStrategy: PID 29162 died... 21:21:05.563523 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29162): Terminated: ok {rc=0} 21:21:05.611367 --- ParallelTerminationStrategy: PID 29163 died... 21:21:05.631144 run iperf3-srv_10.42.42.10(pid=29163): Terminated {rc=256} 21:21:05.678475 --- ParallelTerminationStrategy: PID 29164 died... 21:21:05.698322 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29164): Terminated: ok {rc=0} 21:21:05.745731 --- ParallelTerminationStrategy: PID 29165 died... 21:21:05.765490 run iperf3-srv_10.42.42.10(pid=29165): Terminated {rc=256} 21:21:05.812754 --- ParallelTerminationStrategy: PID 29168 died... 21:21:05.832638 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29168): Terminated: ok {rc=0} 21:21:05.880110 --- ParallelTerminationStrategy: PID 29171 died... 21:21:05.900079 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29171): Terminated: ok {rc=0} 21:21:05.947787 --- ParallelTerminationStrategy: PID 29174 died... 21:21:05.967721 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29174): Terminated: ok {rc=0} 21:21:06.058093 bus /gobi_0: Setting Powered False 21:21:07.157688 bus /gobi_0: Setting Powered False 21:21:08.275049 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 21:21:09.425266 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:21:09.436904 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 21:21:09.491543 tst iperf3.py: using LAC 31579 21:21:09.620431 tst iperf3.py: using RAC 214 21:21:09.741420 tst iperf3.py: using CellId 31579 21:21:09.863380 tst iperf3.py: using BVCI 31580 21:21:09.975914 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:21:09.987343 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:21:09.998550 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:21:10.009779 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:21:10.020932 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:21:10.032167 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:21:10.043465 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:21:10.054587 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:21:10.065934 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 21:21:10.187389 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 21:21:10.413286 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:21:10.746656 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29176): Launched 21:21:11.037320 run iperf3-srv_10.42.42.10(pid=29177): Launched 21:21:11.163637 tst iperf3.py:8: start network... 21:21:11.388154 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:21:11.902246 run create_hlr_db(pid=29178): Launched 21:21:12.030063 bus /gobi_6: Setting Powered False 21:21:13.095650 run create_hlr_db(pid=29178): Terminated: ok {rc=0} 21:21:13.537746 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29180): Launched 21:21:13.846669 run osmo-hlr_10.42.42.2(pid=29181): Launched 21:21:13.963410 run osmo-stp_10.42.42.5: Starting osmo-stp 21:21:14.496192 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29183): Launched 21:21:14.805119 run osmo-stp_10.42.42.5(pid=29184): Launched 21:21:14.923050 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:21:15.455690 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29186): Launched 21:21:15.573504 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:21:15.834695 run patchelf(pid=29187): Launched 21:21:16.071852 run osmo-stp_10.42.42.5(pid=29184): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29184)] 21:21:16.216256 run osmo-stp_10.42.42.5(pid=29184): stdout: | (launched: 2022-12-12_21:21:14.748000) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:21:16.364623 run osmo-stp_10.42.42.5(pid=29184): stderr: | 20221212212114914 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212114915 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212114915 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212114915 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212114916 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212114916 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212114916 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:21:16.510980 run osmo-stp_10.42.42.5(pid=29184): stdout: | (launched: 2022-12-12_21:21:14.748000) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:21:16.652577 run osmo-stp_10.42.42.5(pid=29184): stderr: | 20221212212114914 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212114915 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212114915 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212114915 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212114916 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212114916 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212114916 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:21:16.822362 run patchelf(pid=29187): Terminating (SIGINT) 21:21:17.015681 run patchelf(pid=29187): Terminated: ok {rc=0} 21:21:17.154704 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29184): Process ended prematurely: osmo-stp_10.42.42.5(pid=29184) [trial-2382↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29184)] [trial-2382↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 21:21:17.165318 tst iperf3.py:8: Test FAILED (7.8 sec) 21:21:17.195870 run osmo-hlr_10.42.42.2(pid=29181): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29181)] 21:21:17.249184 run osmo-hlr_10.42.42.2(pid=29181): stdout: | (launched: 2022-12-12_21:21:13.790511) 21:21:17.305301 run osmo-hlr_10.42.42.2(pid=29181): stderr: | 20221212212113965 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212212113965 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212212113965 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212212113965 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212212113965 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212212113965 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212212113978 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212212113988 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212212113989 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212212113989 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:21:17.360197 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29176): Terminating (SIGTERM) 21:21:17.403615 run iperf3-srv_10.42.42.10(pid=29177): Terminating (SIGTERM) 21:21:17.447045 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29180): Terminating (SIGTERM) 21:21:17.490806 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29183): Terminating (SIGTERM) 21:21:17.534411 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29186): Terminating (SIGTERM) 21:21:17.578028 --- ParallelTerminationStrategy: PID 29176 died... 21:21:17.598608 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29176): Terminated: ok {rc=0} 21:21:17.646789 --- ParallelTerminationStrategy: PID 29177 died... 21:21:17.666884 run iperf3-srv_10.42.42.10(pid=29177): Terminated {rc=256} 21:21:17.714851 --- ParallelTerminationStrategy: PID 29180 died... 21:21:17.735033 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29180): Terminated: ok {rc=0} 21:21:17.783109 --- ParallelTerminationStrategy: PID 29183 died... 21:21:17.803232 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29183): Terminated: ok {rc=0} 21:21:17.851324 --- ParallelTerminationStrategy: PID 29186 died... 21:21:17.871615 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29186): Terminated: ok {rc=0} 21:21:17.962006 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 21:21:19.116072 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:21:19.128633 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 21:21:19.183751 tst iperf3m4.py: using LAC 31580 21:21:19.316212 tst iperf3m4.py: using RAC 215 21:21:19.447091 tst iperf3m4.py: using CellId 31580 21:21:19.579348 tst iperf3m4.py: using BVCI 31581 21:21:19.701196 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:21:19.713063 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:21:19.724663 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:21:19.736407 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:21:19.749281 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:21:19.761618 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:21:19.774098 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:21:19.786695 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:21:19.799531 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 21:21:19.923951 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 21:21:20.048056 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 21:21:20.169958 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 21:21:20.291351 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 21:21:20.517309 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:21:20.852485 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29188): Launched 21:21:21.142013 run iperf3-srv_10.42.42.10(pid=29189): Launched 21:21:21.267265 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 21:21:21.492327 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:21:21.826235 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29190): Launched 21:21:22.116130 run iperf3-srv_10.42.42.10(pid=29191): Launched 21:21:22.241106 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 21:21:22.465870 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:21:22.799222 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29192): Launched 21:21:23.087303 run iperf3-srv_10.42.42.10(pid=29193): Launched 21:21:23.211983 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 21:21:23.436485 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:21:23.770865 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29194): Launched 21:21:24.059237 run iperf3-srv_10.42.42.10(pid=29195): Launched 21:21:24.185359 tst iperf3m4.py:8: start network... 21:21:24.409787 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:21:24.924765 run create_hlr_db(pid=29196): Launched 21:21:25.051558 bus /gobi_6: Setting Powered False 21:21:26.117788 run create_hlr_db(pid=29196): Terminated: ok {rc=0} 21:21:26.559536 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29198): Launched 21:21:26.870310 run osmo-hlr_10.42.42.2(pid=29199): Launched 21:21:26.987950 run osmo-stp_10.42.42.5: Starting osmo-stp 21:21:27.521461 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29201): Launched 21:21:27.831512 run osmo-stp_10.42.42.5(pid=29202): Launched 21:21:27.950783 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:21:28.498628 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29204): Launched 21:21:28.616398 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:21:28.878364 run patchelf(pid=29205): Launched 21:21:29.050445 run osmo-stp_10.42.42.5(pid=29202): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29202)] 21:21:29.180862 run osmo-stp_10.42.42.5(pid=29202): stdout: | (launched: 2022-12-12_21:21:27.774605) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:21:29.313307 run osmo-stp_10.42.42.5(pid=29202): stderr: | 20221212212127945 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212127945 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212127945 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212127946 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212127946 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212127946 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212127946 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:21:29.445348 run osmo-stp_10.42.42.5(pid=29202): stdout: | (launched: 2022-12-12_21:21:27.774605) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:21:29.571757 run osmo-stp_10.42.42.5(pid=29202): stderr: | 20221212212127945 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212127945 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212127945 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212127946 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212127946 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212127946 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212127946 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:21:29.721826 run patchelf(pid=29205): Terminating (SIGINT) 21:21:29.895315 run patchelf(pid=29205): Terminated: ok {rc=0} 21:21:30.021186 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29202): Process ended prematurely: osmo-stp_10.42.42.5(pid=29202) [trial-2382↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29202)] [trial-2382↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 21:21:30.030889 tst iperf3m4.py:8: Test FAILED (11.0 sec) 21:21:30.058952 run osmo-hlr_10.42.42.2(pid=29199): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29199)] 21:21:30.107939 run osmo-hlr_10.42.42.2(pid=29199): stdout: | (launched: 2022-12-12_21:21:26.813949) 21:21:30.158374 run osmo-hlr_10.42.42.2(pid=29199): stderr: | 20221212212126988 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212212126988 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212212126988 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212212126988 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212212126988 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212212126988 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212212127000 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212212127009 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212212127009 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212212127009 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:21:30.209295 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29188): Terminating (SIGTERM) 21:21:30.249863 run iperf3-srv_10.42.42.10(pid=29189): Terminating (SIGTERM) 21:21:30.290294 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29190): Terminating (SIGTERM) 21:21:30.330784 run iperf3-srv_10.42.42.10(pid=29191): Terminating (SIGTERM) 21:21:30.371157 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29192): Terminating (SIGTERM) 21:21:30.411599 run iperf3-srv_10.42.42.10(pid=29193): Terminating (SIGTERM) 21:21:30.452270 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29194): Terminating (SIGTERM) 21:21:30.492720 run iperf3-srv_10.42.42.10(pid=29195): Terminating (SIGTERM) 21:21:30.532918 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29198): Terminating (SIGTERM) 21:21:30.573959 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29201): Terminating (SIGTERM) 21:21:30.614124 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29204): Terminating (SIGTERM) 21:21:30.654664 --- ParallelTerminationStrategy: PID 29188 died... 21:21:30.674064 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29188): Terminated: ok {rc=0} 21:21:30.718946 --- ParallelTerminationStrategy: PID 29189 died... 21:21:30.737693 run iperf3-srv_10.42.42.10(pid=29189): Terminated {rc=256} 21:21:30.782015 --- ParallelTerminationStrategy: PID 29190 died... 21:21:30.800988 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29190): Terminated: ok {rc=0} 21:21:30.859582 --- ParallelTerminationStrategy: PID 29191 died... 21:21:30.881236 run iperf3-srv_10.42.42.10(pid=29191): Terminated {rc=256} 21:21:30.939136 --- ParallelTerminationStrategy: PID 29192 died... 21:21:30.958772 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29192): Terminated: ok {rc=0} 21:21:31.004517 --- ParallelTerminationStrategy: PID 29193 died... 21:21:31.024168 run iperf3-srv_10.42.42.10(pid=29193): Terminated {rc=256} 21:21:31.078675 --- ParallelTerminationStrategy: PID 29194 died... 21:21:31.103067 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29194): Terminated: ok {rc=0} 21:21:31.157536 --- ParallelTerminationStrategy: PID 29195 died... 21:21:31.181772 run iperf3-srv_10.42.42.10(pid=29195): Terminated {rc=256} 21:21:31.237519 --- ParallelTerminationStrategy: PID 29198 died... 21:21:31.261325 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29198): Terminated: ok {rc=0} 21:21:31.317099 --- ParallelTerminationStrategy: PID 29201 died... 21:21:31.341532 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29201): Terminated: ok {rc=0} 21:21:31.397708 --- ParallelTerminationStrategy: PID 29204 died... 21:21:31.421756 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29204): Terminated: ok {rc=0} 21:21:31.525957 bus /gobi_4: Setting Powered False 21:21:32.633373 bus /gobi_4: Setting Powered False 21:21:33.750016 bus /gobi_1: Setting Powered False 21:21:34.850354 bus /gobi_1: Setting Powered False 21:21:35.968691 bus /gobi_0: Setting Powered False 21:21:37.066916 bus /gobi_0: Setting Powered False 21:21:38.184269 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 21:21:39.290810 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:21:39.302667 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 21:21:39.354718 tst ping.py: using LAC 31581 21:21:39.479325 tst ping.py: using RAC 216 21:21:39.598969 tst ping.py: using CellId 31581 21:21:39.716882 tst ping.py: using BVCI 31582 21:21:39.827383 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:21:39.838847 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:21:39.849976 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:21:39.861136 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:21:39.872241 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:21:39.883351 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:21:39.894544 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:21:39.905670 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 21:21:40.025096 tst ping.py:19: start network... 21:21:40.245643 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:21:40.749784 run create_hlr_db(pid=29206): Launched 21:21:40.876600 bus /gobi_6: Setting Powered False 21:21:41.941460 run create_hlr_db(pid=29206): Terminated: ok {rc=0} 21:21:42.376721 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29208): Launched 21:21:42.680747 run osmo-hlr_10.42.42.2(pid=29209): Launched 21:21:42.796551 run osmo-stp_10.42.42.5: Starting osmo-stp 21:21:43.322633 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29211): Launched 21:21:43.625686 run osmo-stp_10.42.42.5(pid=29212): Launched 21:21:43.741477 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:21:44.268650 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29214): Launched 21:21:44.384649 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:21:44.642155 run patchelf(pid=29215): Launched 21:21:44.811115 run osmo-stp_10.42.42.5(pid=29212): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29212)] 21:21:44.939811 run osmo-stp_10.42.42.5(pid=29212): stdout: | (launched: 2022-12-12_21:21:43.570257) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:21:45.070554 run osmo-stp_10.42.42.5(pid=29212): stderr: | 20221212212143737 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212143737 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212143737 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212143737 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212143738 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212143738 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212143738 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:21:45.200558 run osmo-stp_10.42.42.5(pid=29212): stdout: | (launched: 2022-12-12_21:21:43.570257) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:21:45.325814 run osmo-stp_10.42.42.5(pid=29212): stderr: | 20221212212143737 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212143737 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212143737 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212143737 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212143738 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212143738 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212143738 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:21:45.473319 run patchelf(pid=29215): Terminating (SIGINT) 21:21:45.643954 run patchelf(pid=29215): Terminated: ok {rc=0} 21:21:45.766995 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=29212): Process ended prematurely: osmo-stp_10.42.42.5(pid=29212) [trial-2382↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29212)] [trial-2382↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 21:21:45.775947 tst ping.py:22: Test FAILED (6.5 sec) 21:21:45.803091 run osmo-hlr_10.42.42.2(pid=29209): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29209)] 21:21:45.859971 run osmo-hlr_10.42.42.2(pid=29209): stdout: | (launched: 2022-12-12_21:21:42.625497) 21:21:45.926649 run osmo-hlr_10.42.42.2(pid=29209): stderr: | 20221212212142798 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212212142798 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212212142798 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212212142798 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212212142798 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212212142798 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212212142811 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212212142821 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212212142821 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212212142821 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:21:45.978958 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29208): Terminating (SIGTERM) 21:21:46.022298 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29211): Terminating (SIGTERM) 21:21:46.066082 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29214): Terminating (SIGTERM) 21:21:46.109375 --- ParallelTerminationStrategy: PID 29208 died... 21:21:46.129767 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29208): Terminated: ok {rc=0} 21:21:46.177513 --- ParallelTerminationStrategy: PID 29211 died... 21:21:46.197134 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29211): Terminated: ok {rc=0} 21:21:46.243322 --- ParallelTerminationStrategy: PID 29214 died... 21:21:46.263118 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29214): Terminated: ok {rc=0} 21:21:46.349291 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 21:21:47.437082 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:21:47.449709 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 21:21:47.506181 tst ping_idle_ping.py: using LAC 31582 21:21:47.636621 tst ping_idle_ping.py: using RAC 217 21:21:47.765403 tst ping_idle_ping.py: using CellId 31582 21:21:47.893778 tst ping_idle_ping.py: using BVCI 31583 21:21:48.015486 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:21:48.028011 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:21:48.039816 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:21:48.052149 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:21:48.064361 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:21:48.076660 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:21:48.088843 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:21:48.101143 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 21:21:48.219961 tst ping_idle_ping.py:24: start network... 21:21:48.426321 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:21:48.902835 run create_hlr_db(pid=29216): Launched 21:21:49.028491 bus /gobi_6: Setting Powered False 21:21:50.089887 run create_hlr_db(pid=29216): Terminated: ok {rc=0} 21:21:50.535557 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29218): Launched 21:21:50.864518 run osmo-hlr_10.42.42.2(pid=29219): Launched 21:21:50.989654 run osmo-stp_10.42.42.5: Starting osmo-stp 21:21:51.559058 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29221): Launched 21:21:51.887032 run osmo-stp_10.42.42.5(pid=29222): Launched 21:21:52.011637 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:21:52.577340 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29224): Launched 21:21:52.703780 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:21:52.980920 run patchelf(pid=29225): Launched 21:21:53.163977 run osmo-stp_10.42.42.5(pid=29222): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29222)] 21:21:53.303685 run osmo-stp_10.42.42.5(pid=29222): stdout: | (launched: 2022-12-12_21:21:51.827255) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:21:53.444546 run osmo-stp_10.42.42.5(pid=29222): stderr: | 20221212212152016 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212152016 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212152017 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212152017 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212152018 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212152018 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212152018 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:21:53.586065 run osmo-stp_10.42.42.5(pid=29222): stdout: | (launched: 2022-12-12_21:21:51.827255) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:21:53.721099 run osmo-stp_10.42.42.5(pid=29222): stderr: | 20221212212152016 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212152016 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212152017 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212152017 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212152018 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212152018 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212152018 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:21:53.881201 run patchelf(pid=29225): Terminating (SIGINT) 21:21:54.065675 run patchelf(pid=29225): Terminated: ok {rc=0} 21:21:54.198654 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=29222): Process ended prematurely: osmo-stp_10.42.42.5(pid=29222) [trial-2382↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29222)] [trial-2382↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 21:21:54.208539 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 21:21:54.237923 run osmo-hlr_10.42.42.2(pid=29219): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29219)] 21:21:54.290776 run osmo-hlr_10.42.42.2(pid=29219): stdout: | (launched: 2022-12-12_21:21:50.805415) 21:21:54.344716 run osmo-hlr_10.42.42.2(pid=29219): stderr: | 20221212212150999 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212212150999 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212212151000 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212212151000 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212212151000 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212212151000 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212212151012 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212212151021 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212212151021 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212212151021 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:21:54.398819 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29218): Terminating (SIGTERM) 21:21:54.442130 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29221): Terminating (SIGTERM) 21:21:54.485410 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29224): Terminating (SIGTERM) 21:21:54.528727 --- ParallelTerminationStrategy: PID 29218 died... 21:21:54.549363 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29218): Terminated: ok {rc=0} 21:21:54.597656 --- ParallelTerminationStrategy: PID 29221 died... 21:21:54.617838 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29221): Terminated: ok {rc=0} 21:21:54.665772 --- ParallelTerminationStrategy: PID 29224 died... 21:21:54.685993 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29224): Terminated: ok {rc=0} 21:21:54.776319 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2382 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 21:21:56.088188 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:21:56.097253 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 21:21:56.132077 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 21:21:56.168032 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 21:21:56.223935 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 21:21:56.256311 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 21:21:56.290575 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 21:21:56.858244 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2382 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 21:21:56.863853 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:21:56.875675 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 21:21:56.947002 tst switch_tch_pdch.py: using LAC 31583 21:21:57.076625 tst switch_tch_pdch.py: using RAC 218 21:21:57.205892 tst switch_tch_pdch.py: using CellId 31583 21:21:57.333164 tst switch_tch_pdch.py: using BVCI 31584 21:21:57.453534 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:21:57.465379 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:21:57.477004 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:21:57.489301 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:21:57.501336 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:21:57.513287 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:21:57.525472 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:21:57.537761 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:21:57.656376 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:21:57.777515 tst switch_tch_pdch.py:51: start network... 21:21:57.996592 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:21:58.502493 run create_hlr_db(pid=29229): Launched 21:21:58.628657 bus /gobi_6: Setting Powered False 21:21:59.693756 run create_hlr_db(pid=29229): Terminated: ok {rc=0} 21:22:00.147491 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29231): Launched 21:22:00.473666 run osmo-hlr_10.42.42.2(pid=29232): Launched 21:22:00.599748 run osmo-stp_10.42.42.5: Starting osmo-stp 21:22:01.182440 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29234): Launched 21:22:01.505807 run osmo-stp_10.42.42.5(pid=29235): Launched 21:22:01.709860 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:22:02.367545 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29237): Launched 21:22:02.483974 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:22:02.741559 run patchelf(pid=29238): Launched 21:22:02.911398 run osmo-stp_10.42.42.5(pid=29235): ERR: Terminated: ERROR {rc=1} [trial-2382↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29235)] 21:22:03.040744 run osmo-stp_10.42.42.5(pid=29235): stdout: | (launched: 2022-12-12_21:22:01.449678) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:22:03.171967 run osmo-stp_10.42.42.5(pid=29235): stderr: | 20221212212201783 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212201783 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212201783 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212201784 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212201784 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212201784 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212201784 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:22:03.303361 run osmo-stp_10.42.42.5(pid=29235): stdout: | (launched: 2022-12-12_21:22:01.449678) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:22:03.428225 run osmo-stp_10.42.42.5(pid=29235): stderr: | 20221212212201783 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212201783 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212201783 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212201784 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212201784 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212201784 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212201784 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:22:03.576315 run patchelf(pid=29238): Terminating (SIGINT) 21:22:03.749136 run patchelf(pid=29238): Terminated: ok {rc=0} 21:22:03.873444 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=29235): Process ended prematurely: osmo-stp_10.42.42.5(pid=29235) [trial-2382↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29235)] [trial-2382↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 21:22:03.882493 tst switch_tch_pdch.py:54: Test FAILED (7.0 sec) 21:22:03.909492 run osmo-hlr_10.42.42.2(pid=29232): ERR: Terminated: ERROR {rc=237} [trial-2382↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29232)] 21:22:03.958378 run osmo-hlr_10.42.42.2(pid=29232): stdout: | (launched: 2022-12-12_21:22:00.414883) 21:22:04.008677 run osmo-hlr_10.42.42.2(pid=29232): stderr: | 20221212212200608 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212212200608 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212212200608 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212212200608 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212212200608 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212212200608 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212212200620 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212212200629 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212212200629 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212212200629 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:22:04.059989 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29231): Terminating (SIGTERM) 21:22:04.100816 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29234): Terminating (SIGTERM) 21:22:04.141839 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29237): Terminating (SIGTERM) 21:22:04.182842 --- ParallelTerminationStrategy: PID 29231 died... 21:22:04.202439 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29231): Terminated: ok {rc=0} 21:22:04.247832 --- ParallelTerminationStrategy: PID 29234 died... 21:22:04.266893 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29234): Terminated: ok {rc=0} 21:22:04.311920 --- ParallelTerminationStrategy: PID 29237 died... 21:22:04.331065 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29237): Terminated: ok {rc=0} 21:22:04.419037 bus /gobi_0: Setting Powered False 21:22:05.523679 bus /gobi_0: Setting Powered False 21:22:06.640507 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2382 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 dynts:trx-umtrx+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 21:22:07.894877 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:22:07.900736 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 21:22:07.932921 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 21:22:07.967281 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 21:22:08.019409 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 21:22:08.051455 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 21:22:08.085445 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 21:22:08.644610 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2382 dynts:trx-umtrx+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 21:22:08.649731 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 21:22:08.660474 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 21:22:08.727823 tst switch_tch_pdch.py: using LAC 31584 21:22:08.845744 tst switch_tch_pdch.py: using RAC 219 21:22:08.963874 tst switch_tch_pdch.py: using CellId 31584 21:22:09.085149 tst switch_tch_pdch.py: using BVCI 31585 21:22:09.204530 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 21:22:09.216356 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 21:22:09.227939 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 21:22:09.240027 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 21:22:09.252080 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 21:22:09.264276 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 21:22:09.276463 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 21:22:09.288083 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 21:22:09.407250 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 21:22:09.521300 tst switch_tch_pdch.py:51: start network... 21:22:09.723756 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:22:10.166945 run create_hlr_db(pid=29242): Launched 21:22:10.291074 bus /gobi_6: Setting Powered False 21:22:11.352352 run create_hlr_db(pid=29242): Terminated: ok {rc=0} 21:22:11.769208 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29244): Launched 21:22:12.094659 run osmo-hlr_10.42.42.2(pid=29245): Launched 21:22:12.220071 run osmo-stp_10.42.42.5: Starting osmo-stp 21:22:12.755449 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29247): Launched 21:22:13.080921 run osmo-stp_10.42.42.5(pid=29248): Launched 21:22:13.206182 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:22:13.739467 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29250): Launched 21:22:13.865729 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:22:14.141562 run patchelf(pid=29251): Launched 21:22:14.323434 run osmo-stp_10.42.42.5(pid=29248): ERR: Terminated: ERROR {rc=1} [trial-2382↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29248)] 21:22:14.462803 run osmo-stp_10.42.42.5(pid=29248): stdout: | (launched: 2022-12-12_21:22:13.021799) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:22:14.603775 run osmo-stp_10.42.42.5(pid=29248): stderr: | 20221212212213210 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212213210 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212213211 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212213211 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212213212 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212213212 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212213212 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:22:14.744752 run osmo-stp_10.42.42.5(pid=29248): stdout: | (launched: 2022-12-12_21:22:13.021799) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:22:14.879993 run osmo-stp_10.42.42.5(pid=29248): stderr: | 20221212212213210 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212213210 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212213211 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212213211 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212213212 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212213212 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212213212 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:22:15.040168 run patchelf(pid=29251): Terminating (SIGINT) 21:22:15.225128 run patchelf(pid=29251): Terminated: ok {rc=0} 21:22:15.358556 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=29248): Process ended prematurely: osmo-stp_10.42.42.5(pid=29248) [trial-2382↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29248)] [trial-2382↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 21:22:15.368348 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 21:22:15.397491 run osmo-hlr_10.42.42.2(pid=29245): ERR: Terminated: ERROR {rc=237} [trial-2382↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29245)] 21:22:15.449217 run osmo-hlr_10.42.42.2(pid=29245): stdout: | (launched: 2022-12-12_21:22:12.035767) 21:22:15.502997 run osmo-hlr_10.42.42.2(pid=29245): stderr: | 20221212212212230 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212212212230 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212212212230 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212212212230 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212212212230 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212212212230 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212212212242 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/dynts:trx-umtrx+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212212212251 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212212212252 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212212212252 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:22:15.557417 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29244): Terminating (SIGTERM) 21:22:15.600623 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29247): Terminating (SIGTERM) 21:22:15.644029 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29250): Terminating (SIGTERM) 21:22:15.687546 --- ParallelTerminationStrategy: PID 29244 died... 21:22:15.708227 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29244): Terminated: ok {rc=0} 21:22:15.756174 --- ParallelTerminationStrategy: PID 29247 died... 21:22:15.776282 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29247): Terminated: ok {rc=0} 21:22:15.824019 --- ParallelTerminationStrategy: PID 29250 died... 21:22:15.848546 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29250): Terminated: ok {rc=0} 21:22:15.960824 bus /gobi_0: Setting Powered False 21:22:17.073756 bus /gobi_0: Setting Powered False 21:22:18.200526 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2382 dynts:trx-umtrx+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 nitb_sms:trx-lms --------------------------------------------------------------------- 21:22:19.453860 tst nitb_sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:22:19.458194 tst nitb_sms:trx-lms: Verifying 1 x bts (candidates: 11) 21:22:19.493138 tst nitb_sms:trx-lms: Verifying 1 x ip_address (candidates: 9) 21:22:19.500130 tst nitb_sms:trx-lms: Verifying 2 x modem (candidates: 12) 21:22:19.551535 tst nitb_sms:trx-lms: Reserving 1 x bts (candidates: 11) 21:22:19.585653 tst nitb_sms:trx-lms: Reserving 1 x ip_address (candidates: 9) 21:22:19.592615 tst nitb_sms:trx-lms: Reserving 2 x modem (candidates: 12) 21:22:20.133972 tst nitb_sms:trx-lms: RESERVED RESOURCES for nitb_sms: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 nitb_sms:trx-lms mo_mt_sms.py ---------------------------------------------- 21:22:20.139632 tst nitb_sms:trx-lms: Using 1 x ip_address (candidates: 1) 21:22:20.150829 tst nitb_sms:trx-lms: Using 1 x bts (candidates: 1) 21:22:20.199346 tst mo_mt_sms.py: using LAC 31585 21:22:20.326066 tst mo_mt_sms.py: using RAC 220 21:22:20.451953 tst mo_mt_sms.py: using CellId 31585 21:22:20.578664 tst mo_mt_sms.py: using BVCI 31586 21:22:20.696822 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 21:22:20.818165 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 21:22:20.939462 tst mo_mt_sms.py:9: start nitb and bts... 21:22:21.160862 run osmo-nitb_10.42.42.2: Starting osmo-nitb 21:22:21.822517 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29255): Launched 21:22:22.149663 run osmo-nitb_10.42.42.2(pid=29256): Launched 21:22:22.330799 run osmo-nitb_10.42.42.2(pid=29256): ERR: Terminated: ERROR {rc=2} [trial-2382↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29256)] 21:22:22.477845 run osmo-nitb_10.42.42.2(pid=29256): stdout: | (launched: 2022-12-12_21:22:22.090807) 21:22:22.625924 run osmo-nitb_10.42.42.2(pid=29256): stderr: | (launched: 2022-12-12_21:22:22.139359) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 21:22:22.774470 run osmo-nitb_10.42.42.2(pid=29256): stdout: | (launched: 2022-12-12_21:22:22.090807) 21:22:22.917696 run osmo-nitb_10.42.42.2(pid=29256): stderr: | (launched: 2022-12-12_21:22:22.139359) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7ff6b86c2268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=29256): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29256) [trial-2382↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29256)] 21:22:23.273741 tst osmo-nitb_10.42.42.2(pid=29256): stdout: | (launched: 2022-12-12_21:22:22.090807) 21:22:23.405442 tst osmo-nitb_10.42.42.2(pid=29256): stderr: | (launched: 2022-12-12_21:22:22.139359) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 21:22:23.560750 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=29256): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29256) [trial-2382↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29256)] [trial-2382↪nitb_sms:trx-lms↪mo_mt_sms.py:11] 21:22:23.570075 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 21:22:23.577327 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29255): Terminating (SIGTERM) 21:22:23.789709 --- ParallelTerminationStrategy: PID 29255 died... 21:22:23.811977 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29255): Terminated: ok {rc=0} 21:22:23.902631 bus /sierra_3: Setting Powered False 21:22:25.002970 bus /sierra_3: Setting Powered False 21:22:26.125866 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 nitb_sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 sms:trx-lms --------------------------------------------------------------------- 21:22:27.324762 tst sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:22:27.329115 tst sms:trx-lms: Verifying 1 x bts (candidates: 11) 21:22:27.362502 tst sms:trx-lms: Verifying 6 x ip_address (candidates: 9) 21:22:27.389166 tst sms:trx-lms: Verifying 2 x modem (candidates: 12) 21:22:27.440862 tst sms:trx-lms: Reserving 1 x bts (candidates: 11) 21:22:27.474130 tst sms:trx-lms: Reserving 6 x ip_address (candidates: 9) 21:22:27.500838 tst sms:trx-lms: Reserving 2 x modem (candidates: 12) 21:22:28.046002 tst sms:trx-lms: RESERVED RESOURCES for sms: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 sms:trx-lms mo_mt_sms.py ---------------------------------------------- 21:22:28.050855 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 21:22:28.061478 tst sms:trx-lms: Using 1 x bts (candidates: 1) 21:22:28.108533 tst mo_mt_sms.py: using LAC 31586 21:22:28.227478 tst mo_mt_sms.py: using RAC 221 21:22:28.348088 tst mo_mt_sms.py: using CellId 31586 21:22:28.479737 tst mo_mt_sms.py: using BVCI 31587 21:22:28.600513 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 21:22:28.611805 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 21:22:28.622976 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 21:22:28.634697 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 21:22:28.646321 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 21:22:28.658123 tst sms:trx-lms: Using 1 x modem (candidates: 2) 21:22:28.781623 tst sms:trx-lms: Using 1 x modem (candidates: 2) 21:22:28.901381 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:22:29.374769 run create_hlr_db(pid=29260): Launched 21:22:29.499311 bus /sierra_2: Setting Powered False 21:22:30.560113 run create_hlr_db(pid=29260): Terminated: ok {rc=0} 21:22:31.025691 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29262): Launched 21:22:31.451572 run osmo-hlr_10.42.42.2(pid=29263): Launched 21:22:31.645066 run osmo-stp_10.42.42.5: Starting osmo-stp 21:22:32.305087 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29265): Launched 21:22:32.622065 run osmo-stp_10.42.42.5(pid=29266): Launched 21:22:32.738861 run osmo-msc_10.42.42.6: Starting osmo-msc 21:22:33.289372 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29268): Launched 21:22:33.593245 run osmo-msc_10.42.42.6(pid=29269): Launched 21:22:33.762786 run osmo-stp_10.42.42.5(pid=29266): ERR: Terminated: ERROR {rc=1} [trial-2382↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29266)] 21:22:33.892018 run osmo-stp_10.42.42.5(pid=29266): stdout: | (launched: 2022-12-12_21:22:32.566699) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:22:34.021586 run osmo-stp_10.42.42.5(pid=29266): stderr: | 20221212212232733 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212232733 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212232733 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212232733 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212232734 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212232734 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212232734 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:22:34.149326 run osmo-stp_10.42.42.5(pid=29266): stdout: | (launched: 2022-12-12_21:22:32.566699) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:22:34.270364 run osmo-stp_10.42.42.5(pid=29266): stderr: | 20221212212232733 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212232733 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212232733 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212232733 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212232734 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212232734 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212232734 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:22:34.415721 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=29266): Process ended prematurely: osmo-stp_10.42.42.5(pid=29266) [trial-2382↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29266)] [trial-2382↪sms:trx-lms↪mo_mt_sms.py:16] 21:22:34.424570 tst mo_mt_sms.py:16: Test FAILED (6.4 sec) 21:22:34.451011 run osmo-hlr_10.42.42.2(pid=29263): ERR: Terminated: ERROR {rc=237} [trial-2382↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29263)] 21:22:34.499870 run osmo-hlr_10.42.42.2(pid=29263): stdout: | (launched: 2022-12-12_21:22:31.381789) 21:22:34.550645 run osmo-hlr_10.42.42.2(pid=29263): stderr: | 20221212212231717 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212212231717 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212212231717 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212212231717 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212212231717 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212212231717 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212212231730 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/sms:trx-lms/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212212231746 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212212231746 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212212231746 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:22:34.621356 run osmo-msc_10.42.42.6(pid=29269): ERR: Terminated: ERROR {rc=2} [trial-2382↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29269)] 21:22:34.670239 run osmo-msc_10.42.42.6(pid=29269): stdout: | (launched: 2022-12-12_21:22:33.537720) 21:22:34.720882 run osmo-msc_10.42.42.6(pid=29269): stderr: | 20221212212233807 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212212233807 DLGLOBAL DEBUG validating counter group 0x7fd4114e7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212212233807 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212212233807 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212212233807 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212212233807 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212212233809 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212212233809 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212212233810 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212212233810 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:22:34.772038 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29262): Terminating (SIGTERM) 21:22:34.812540 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29265): Terminating (SIGTERM) 21:22:34.853294 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29268): Terminating (SIGTERM) 21:22:34.894034 --- ParallelTerminationStrategy: PID 29262 died... 21:22:34.913663 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29262): Terminated: ok {rc=0} 21:22:34.959136 --- ParallelTerminationStrategy: PID 29265 died... 21:22:34.978429 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29265): Terminated: ok {rc=0} 21:22:35.023266 --- ParallelTerminationStrategy: PID 29268 died... 21:22:35.042381 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29268): Terminated: ok {rc=0} 21:22:35.130421 bus /sierra_3: Setting Powered False 21:22:36.232077 bus /sierra_3: Setting Powered False 21:22:37.348656 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 nitb_ussd:trx-lms --------------------------------------------------------------------- 21:22:38.579353 tst nitb_ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:22:38.583154 tst nitb_ussd:trx-lms: Verifying 1 x bts (candidates: 11) 21:22:38.616161 tst nitb_ussd:trx-lms: Verifying 1 x ip_address (candidates: 9) 21:22:38.622934 tst nitb_ussd:trx-lms: Verifying 1 x modem (candidates: 12) 21:22:38.659008 tst nitb_ussd:trx-lms: Reserving 1 x bts (candidates: 11) 21:22:38.692825 tst nitb_ussd:trx-lms: Reserving 1 x ip_address (candidates: 9) 21:22:38.699544 tst nitb_ussd:trx-lms: Reserving 1 x modem (candidates: 12) 21:22:39.217673 tst nitb_ussd:trx-lms: RESERVED RESOURCES for nitb_ussd: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2382 nitb_ussd:trx-lms assert_extension.py ---------------------------------------------- 21:22:39.222617 tst nitb_ussd:trx-lms: Using 1 x ip_address (candidates: 1) 21:22:39.233524 tst nitb_ussd:trx-lms: Using 1 x bts (candidates: 1) 21:22:39.281657 tst assert_extension.py: using LAC 31587 21:22:39.402372 tst assert_extension.py: using RAC 222 21:22:39.523547 tst assert_extension.py: using CellId 31587 21:22:39.644047 tst assert_extension.py: using BVCI 31588 21:22:39.756096 tst nitb_ussd:trx-lms: Using 1 x modem (candidates: 1) 21:22:39.875844 tst assert_extension.py:10: start nitb and bts... 21:22:40.097967 run osmo-nitb_10.42.42.2: Starting osmo-nitb 21:22:40.764390 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29274): Launched 21:22:41.090611 run osmo-nitb_10.42.42.2(pid=29275): Launched 21:22:41.272835 run osmo-nitb_10.42.42.2(pid=29275): ERR: Terminated: ERROR {rc=2} [trial-2382↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29275)] 21:22:41.419155 run osmo-nitb_10.42.42.2(pid=29275): stdout: | (launched: 2022-12-12_21:22:41.031193) 21:22:41.566856 run osmo-nitb_10.42.42.2(pid=29275): stderr: | (launched: 2022-12-12_21:22:41.080410) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 21:22:41.714545 run osmo-nitb_10.42.42.2(pid=29275): stdout: | (launched: 2022-12-12_21:22:41.031193) 21:22:41.856597 run osmo-nitb_10.42.42.2(pid=29275): stderr: | (launched: 2022-12-12_21:22:41.080410) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7ff6b86c2268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=29275): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29275) [trial-2382↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29275)] 21:22:42.214889 tst osmo-nitb_10.42.42.2(pid=29275): stdout: | (launched: 2022-12-12_21:22:41.031193) 21:22:42.347299 tst osmo-nitb_10.42.42.2(pid=29275): stderr: | (launched: 2022-12-12_21:22:41.080410) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 21:22:42.503864 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=29275): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29275) [trial-2382↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29275)] [trial-2382↪nitb_ussd:trx-lms↪assert_extension.py:12] 21:22:42.513358 tst assert_extension.py:12: Test FAILED (3.3 sec) 21:22:42.520632 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29274): Terminating (SIGTERM) 21:22:42.733209 --- ParallelTerminationStrategy: PID 29274 died... 21:22:42.754905 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29274): Terminated: ok {rc=0} 21:22:42.845096 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 nitb_ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 ussd:trx-lms --------------------------------------------------------------------- 21:22:44.030963 tst ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:22:44.035940 tst ussd:trx-lms: Verifying 1 x bts (candidates: 11) 21:22:44.071403 tst ussd:trx-lms: Verifying 6 x ip_address (candidates: 9) 21:22:44.098768 tst ussd:trx-lms: Verifying 1 x modem (candidates: 12) 21:22:44.134296 tst ussd:trx-lms: Reserving 1 x bts (candidates: 11) 21:22:44.168076 tst ussd:trx-lms: Reserving 6 x ip_address (candidates: 9) 21:22:44.194560 tst ussd:trx-lms: Reserving 1 x modem (candidates: 12) 21:22:44.723072 tst ussd:trx-lms: RESERVED RESOURCES for ussd: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2382 ussd:trx-lms assert_extension.py ---------------------------------------------- 21:22:44.727983 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 21:22:44.738552 tst ussd:trx-lms: Using 1 x bts (candidates: 1) 21:22:44.785376 tst assert_extension.py: using LAC 31588 21:22:44.903152 tst assert_extension.py: using RAC 223 21:22:45.021998 tst assert_extension.py: using CellId 31588 21:22:45.140164 tst assert_extension.py: using BVCI 31589 21:22:45.250208 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 21:22:45.260737 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 21:22:45.271222 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 21:22:45.281623 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 21:22:45.292096 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 21:22:45.302478 tst ussd:trx-lms: Using 1 x modem (candidates: 1) 21:22:45.421450 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:22:45.935132 run create_hlr_db(pid=29280): Launched 21:22:46.109302 bus /sierra_2: Setting Powered False 21:22:47.167943 run create_hlr_db(pid=29280): Terminated: ok {rc=0} 21:22:47.594801 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29282): Launched 21:22:47.898729 run osmo-hlr_10.42.42.2(pid=29283): Launched 21:22:48.013137 run osmo-stp_10.42.42.5: Starting osmo-stp 21:22:48.547757 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29285): Launched 21:22:48.851321 run osmo-stp_10.42.42.5(pid=29286): Launched 21:22:48.966360 run osmo-msc_10.42.42.6: Starting osmo-msc 21:22:49.516929 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29288): Launched 21:22:49.821349 run osmo-msc_10.42.42.6(pid=29289): Launched 21:22:49.992347 run osmo-stp_10.42.42.5(pid=29286): ERR: Terminated: ERROR {rc=1} [trial-2382↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29286)] 21:22:50.121548 run osmo-stp_10.42.42.5(pid=29286): stdout: | (launched: 2022-12-12_21:22:48.795744) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:22:50.251013 run osmo-stp_10.42.42.5(pid=29286): stderr: | 20221212212248964 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212248964 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212248965 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212248965 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212248966 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212248966 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212248966 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:22:50.379207 run osmo-stp_10.42.42.5(pid=29286): stdout: | (launched: 2022-12-12_21:22:48.795744) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:22:50.500158 run osmo-stp_10.42.42.5(pid=29286): stderr: | 20221212212248964 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212248964 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212248965 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212248965 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212248966 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212248966 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212248966 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:22:50.644891 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=29286): Process ended prematurely: osmo-stp_10.42.42.5(pid=29286) [trial-2382↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29286)] [trial-2382↪ussd:trx-lms↪assert_extension.py:17] 21:22:50.653403 tst assert_extension.py:17: Test FAILED (5.9 sec) 21:22:50.679808 run osmo-hlr_10.42.42.2(pid=29283): ERR: Terminated: ERROR {rc=237} [trial-2382↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29283)] 21:22:50.728593 run osmo-hlr_10.42.42.2(pid=29283): stdout: | (launched: 2022-12-12_21:22:47.843453) 21:22:50.779387 run osmo-hlr_10.42.42.2(pid=29283): stderr: | 20221212212248015 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212212248015 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212212248015 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212212248015 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212212248015 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212212248015 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212212248026 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/ussd:trx-lms/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212212248035 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212212248035 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212212248035 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:22:50.850003 run osmo-msc_10.42.42.6(pid=29289): ERR: Terminated: ERROR {rc=2} [trial-2382↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29289)] 21:22:50.898969 run osmo-msc_10.42.42.6(pid=29289): stdout: | (launched: 2022-12-12_21:22:49.765623) 21:22:50.949360 run osmo-msc_10.42.42.6(pid=29289): stderr: | 20221212212250034 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212212250034 DLGLOBAL DEBUG validating counter group 0x7ff6f1267c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212212250034 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212212250034 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212212250034 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212212250035 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212212250036 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212212250037 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212212250037 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212212250037 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:22:51.000387 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29282): Terminating (SIGTERM) 21:22:51.040914 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29285): Terminating (SIGTERM) 21:22:51.081700 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29288): Terminating (SIGTERM) 21:22:51.122830 --- ParallelTerminationStrategy: PID 29282 died... 21:22:51.142402 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29282): Terminated: ok {rc=0} 21:22:51.187483 --- ParallelTerminationStrategy: PID 29285 died... 21:22:51.206526 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29285): Terminated: ok {rc=0} 21:22:51.251359 --- ParallelTerminationStrategy: PID 29288 died... 21:22:51.270385 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29288): Terminated: ok {rc=0} 21:22:51.359374 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 21:22:52.572110 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:22:52.579094 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 21:22:52.612122 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 21:22:52.638489 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 21:22:52.690714 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 21:22:52.724198 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 21:22:52.750850 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 21:22:53.301056 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 21:22:53.351136 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:22:53.362404 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 21:22:53.431256 tst mo_mt_call.py: using LAC 31589 21:22:53.553025 tst mo_mt_call.py: using RAC 224 21:22:53.673735 tst mo_mt_call.py: using CellId 31589 21:22:53.795641 tst mo_mt_call.py: using BVCI 31590 21:22:53.909472 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:22:53.920559 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:22:53.931560 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:22:53.942662 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:22:53.953732 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:22:53.964645 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 21:22:54.087293 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 21:22:54.210443 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:22:54.691829 run create_hlr_db(pid=29295): Launched 21:22:54.818396 bus /sierra_2: Setting Powered False 21:22:55.880066 run create_hlr_db(pid=29295): Terminated: ok {rc=0} 21:22:56.309916 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29297): Launched 21:22:56.618289 run osmo-hlr_10.42.42.2(pid=29298): Launched 21:22:56.734895 run osmo-stp_10.42.42.5: Starting osmo-stp 21:22:57.269965 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29300): Launched 21:22:57.578912 run osmo-stp_10.42.42.5(pid=29301): Launched 21:22:57.696168 run osmo-msc_10.42.42.6: Starting osmo-msc 21:22:58.253291 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29303): Launched 21:22:58.561217 run osmo-msc_10.42.42.6(pid=29304): Launched 21:22:58.732766 run osmo-stp_10.42.42.5(pid=29301): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29301)] 21:22:58.862727 run osmo-stp_10.42.42.5(pid=29301): stdout: | (launched: 2022-12-12_21:22:57.522805) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:22:58.992761 run osmo-stp_10.42.42.5(pid=29301): stderr: | 20221212212257689 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212257689 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212257689 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212257690 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212257690 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212257690 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212257690 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:22:59.121872 run osmo-stp_10.42.42.5(pid=29301): stdout: | (launched: 2022-12-12_21:22:57.522805) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:22:59.246121 run osmo-stp_10.42.42.5(pid=29301): stderr: | 20221212212257689 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212257689 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212257689 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212257690 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212257690 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212257690 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212257690 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:22:59.393694 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29301): Process ended prematurely: osmo-stp_10.42.42.5(pid=29301) [trial-2382↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29301)] [trial-2382↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 21:22:59.402834 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 21:22:59.429729 run osmo-hlr_10.42.42.2(pid=29298): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29298)] 21:22:59.478460 run osmo-hlr_10.42.42.2(pid=29298): stdout: | (launched: 2022-12-12_21:22:56.562154) 21:22:59.529334 run osmo-hlr_10.42.42.2(pid=29298): stderr: | 20221212212256737 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212212256738 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212212256738 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212212256738 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212212256738 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212212256738 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212212256750 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212212256761 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212212256761 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212212256761 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:22:59.600347 run osmo-msc_10.42.42.6(pid=29304): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29304)] 21:22:59.649299 run osmo-msc_10.42.42.6(pid=29304): stdout: | (launched: 2022-12-12_21:22:58.504797) 21:22:59.700155 run osmo-msc_10.42.42.6(pid=29304): stderr: | 20221212212258775 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212212258775 DLGLOBAL DEBUG validating counter group 0x7f2d53f68c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212212258775 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212212258775 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212212258775 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212212258775 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212212258777 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212212258778 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212212258778 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212212258778 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:22:59.751325 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29297): Terminating (SIGTERM) 21:22:59.791892 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29300): Terminating (SIGTERM) 21:22:59.832399 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29303): Terminating (SIGTERM) 21:22:59.873251 --- ParallelTerminationStrategy: PID 29297 died... 21:22:59.892705 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29297): Terminated: ok {rc=0} 21:22:59.938508 --- ParallelTerminationStrategy: PID 29300 died... 21:22:59.957553 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29300): Terminated: ok {rc=0} 21:23:00.002558 --- ParallelTerminationStrategy: PID 29303 died... 21:23:00.022902 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29303): Terminated: ok {rc=0} 21:23:00.109204 bus /sierra_3: Setting Powered False 21:23:01.214152 bus /sierra_3: Setting Powered False 21:23:02.333481 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2382 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 21:23:03.478654 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:23:03.490694 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 21:23:03.559607 tst mo_mt_call_osmux.py: using LAC 31590 21:23:03.681360 tst mo_mt_call_osmux.py: using RAC 225 21:23:03.803024 tst mo_mt_call_osmux.py: using CellId 31590 21:23:03.925743 tst mo_mt_call_osmux.py: using BVCI 31591 21:23:04.039478 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:23:04.050641 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:23:04.061554 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:23:04.072474 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:23:04.083523 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:23:04.094459 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 21:23:04.209988 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 21:23:04.330981 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:23:04.808489 run create_hlr_db(pid=29306): Launched 21:23:04.936105 bus /sierra_2: Setting Powered False 21:23:05.998907 run create_hlr_db(pid=29306): Terminated: ok {rc=0} 21:23:06.429862 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29308): Launched 21:23:06.739886 run osmo-hlr_10.42.42.2(pid=29309): Launched 21:23:06.858118 run osmo-stp_10.42.42.5: Starting osmo-stp 21:23:07.408795 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29311): Launched 21:23:07.717970 run osmo-stp_10.42.42.5(pid=29312): Launched 21:23:07.837783 run osmo-msc_10.42.42.6: Starting osmo-msc 21:23:08.394931 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29314): Launched 21:23:08.704140 run osmo-msc_10.42.42.6(pid=29315): Launched 21:23:08.876858 run osmo-stp_10.42.42.5(pid=29312): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29312)] 21:23:09.007735 run osmo-stp_10.42.42.5(pid=29312): stdout: | (launched: 2022-12-12_21:23:07.661826) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:23:09.138411 run osmo-stp_10.42.42.5(pid=29312): stderr: | 20221212212307831 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212307831 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212307831 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212307832 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212307832 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212307832 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212307832 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:23:09.267838 run osmo-stp_10.42.42.5(pid=29312): stdout: | (launched: 2022-12-12_21:23:07.661826) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:23:09.390594 run osmo-stp_10.42.42.5(pid=29312): stderr: | 20221212212307831 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212307831 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212307831 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212307832 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212307832 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212307832 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212307832 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:23:09.538282 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29312): Process ended prematurely: osmo-stp_10.42.42.5(pid=29312) [trial-2382↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29312)] [trial-2382↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 21:23:09.547313 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 21:23:09.574052 run osmo-hlr_10.42.42.2(pid=29309): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29309)] 21:23:09.622671 run osmo-hlr_10.42.42.2(pid=29309): stdout: | (launched: 2022-12-12_21:23:06.683390) 21:23:09.673227 run osmo-hlr_10.42.42.2(pid=29309): stderr: | 20221212212306858 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212212306858 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212212306858 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212212306858 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212212306858 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212212306858 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212212306870 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212212306879 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212212306879 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212212306879 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:23:09.743664 run osmo-msc_10.42.42.6(pid=29315): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29315)] 21:23:09.792434 run osmo-msc_10.42.42.6(pid=29315): stdout: | (launched: 2022-12-12_21:23:08.647369) 21:23:09.842935 run osmo-msc_10.42.42.6(pid=29315): stderr: | 20221212212308918 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212212308918 DLGLOBAL DEBUG validating counter group 0x7f1c1741dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212212308919 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212212308919 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212212308919 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212212308919 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212212308921 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212212308921 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212212308921 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212212308921 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:23:09.893835 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29308): Terminating (SIGTERM) 21:23:09.934225 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29311): Terminating (SIGTERM) 21:23:09.974779 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29314): Terminating (SIGTERM) 21:23:10.015337 --- ParallelTerminationStrategy: PID 29308 died... 21:23:10.034843 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29308): Terminated: ok {rc=0} 21:23:10.079619 --- ParallelTerminationStrategy: PID 29311 died... 21:23:10.098588 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29311): Terminated: ok {rc=0} 21:23:10.143128 --- ParallelTerminationStrategy: PID 29314 died... 21:23:10.162069 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29314): Terminated: ok {rc=0} 21:23:10.249048 bus /sierra_3: Setting Powered False 21:23:11.349768 bus /sierra_3: Setting Powered False 21:23:12.466250 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 21:23:13.718816 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:23:13.725294 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 21:23:13.758372 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 21:23:13.784915 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 21:23:13.836663 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 21:23:13.869741 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 21:23:13.896183 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 21:23:14.447544 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 21:23:14.496754 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:23:14.507945 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 21:23:14.576890 tst mo_mt_call.py: using LAC 31591 21:23:14.700524 tst mo_mt_call.py: using RAC 226 21:23:14.824138 tst mo_mt_call.py: using CellId 31591 21:23:14.947720 tst mo_mt_call.py: using BVCI 31592 21:23:15.060607 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:23:15.071819 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:23:15.082849 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:23:15.093763 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:23:15.104683 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:23:15.115727 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 21:23:15.230213 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 21:23:15.351760 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:23:15.885641 run create_hlr_db(pid=29320): Launched 21:23:16.042512 bus /sierra_2: Setting Powered False 21:23:17.124157 run create_hlr_db(pid=29320): Terminated: ok {rc=0} 21:23:17.567012 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29322): Launched 21:23:17.879365 run osmo-hlr_10.42.42.2(pid=29323): Launched 21:23:17.997241 run osmo-stp_10.42.42.5: Starting osmo-stp 21:23:18.544126 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29325): Launched 21:23:18.853175 run osmo-stp_10.42.42.5(pid=29326): Launched 21:23:18.970419 run osmo-msc_10.42.42.6: Starting osmo-msc 21:23:19.529167 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29328): Launched 21:23:19.838423 run osmo-msc_10.42.42.6(pid=29329): Launched 21:23:20.013366 run osmo-stp_10.42.42.5(pid=29326): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29326)] 21:23:20.144322 run osmo-stp_10.42.42.5(pid=29326): stdout: | (launched: 2022-12-12_21:23:18.796230) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:23:20.274855 run osmo-stp_10.42.42.5(pid=29326): stderr: | 20221212212318965 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212318966 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212318966 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212318966 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212318967 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212318967 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212318967 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:23:20.403546 run osmo-stp_10.42.42.5(pid=29326): stdout: | (launched: 2022-12-12_21:23:18.796230) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:23:20.527345 run osmo-stp_10.42.42.5(pid=29326): stderr: | 20221212212318965 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212318966 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212318966 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212318966 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212318967 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212318967 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212318967 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:23:20.674506 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29326): Process ended prematurely: osmo-stp_10.42.42.5(pid=29326) [trial-2382↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29326)] [trial-2382↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 21:23:20.683694 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 21:23:20.710453 run osmo-hlr_10.42.42.2(pid=29323): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29323)] 21:23:20.759417 run osmo-hlr_10.42.42.2(pid=29323): stdout: | (launched: 2022-12-12_21:23:17.823259) 21:23:20.810096 run osmo-hlr_10.42.42.2(pid=29323): stderr: | 20221212212317996 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212212317996 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212212317996 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212212317997 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212212317997 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212212317997 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212212318009 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212212318017 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212212318017 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212212318017 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:23:20.880477 run osmo-msc_10.42.42.6(pid=29329): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29329)] 21:23:20.929152 run osmo-msc_10.42.42.6(pid=29329): stdout: | (launched: 2022-12-12_21:23:19.782022) 21:23:20.979524 run osmo-msc_10.42.42.6(pid=29329): stderr: | 20221212212320050 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212212320050 DLGLOBAL DEBUG validating counter group 0x7f0f26472c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212212320050 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212212320050 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212212320050 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212212320051 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212212320052 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212212320053 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212212320053 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212212320053 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:23:21.030473 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29322): Terminating (SIGTERM) 21:23:21.071169 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29325): Terminating (SIGTERM) 21:23:21.111715 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29328): Terminating (SIGTERM) 21:23:21.152731 --- ParallelTerminationStrategy: PID 29322 died... 21:23:21.172420 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29322): Terminated: ok {rc=0} 21:23:21.217714 --- ParallelTerminationStrategy: PID 29325 died... 21:23:21.236624 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29325): Terminated: ok {rc=0} 21:23:21.281722 --- ParallelTerminationStrategy: PID 29328 died... 21:23:21.300863 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29328): Terminated: ok {rc=0} 21:23:21.387563 bus /sierra_3: Setting Powered False 21:23:22.488910 bus /sierra_3: Setting Powered False 21:23:23.609642 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2382 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 21:23:24.762629 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:23:24.774995 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 21:23:24.847002 tst mo_mt_call_osmux.py: using LAC 31592 21:23:24.977261 tst mo_mt_call_osmux.py: using RAC 227 21:23:25.109361 tst mo_mt_call_osmux.py: using CellId 31592 21:23:25.241171 tst mo_mt_call_osmux.py: using BVCI 31593 21:23:25.362212 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:23:25.374075 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:23:25.385747 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:23:25.398145 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:23:25.410064 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:23:25.421873 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 21:23:25.543674 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 21:23:25.663167 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:23:26.142855 run create_hlr_db(pid=29331): Launched 21:23:26.274658 bus /sierra_2: Setting Powered False 21:23:27.340420 run create_hlr_db(pid=29331): Terminated: ok {rc=0} 21:23:27.801930 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29333): Launched 21:23:28.136430 run osmo-hlr_10.42.42.2(pid=29334): Launched 21:23:28.279017 run osmo-stp_10.42.42.5: Starting osmo-stp 21:23:28.811316 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29336): Launched 21:23:29.123017 run osmo-stp_10.42.42.5(pid=29337): Launched 21:23:29.243477 run osmo-msc_10.42.42.6: Starting osmo-msc 21:23:29.804059 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29339): Launched 21:23:30.113606 run osmo-msc_10.42.42.6(pid=29340): Launched 21:23:30.287713 run osmo-stp_10.42.42.5(pid=29337): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29337)] 21:23:30.420333 run osmo-stp_10.42.42.5(pid=29337): stdout: | (launched: 2022-12-12_21:23:29.066178) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:23:30.552548 run osmo-stp_10.42.42.5(pid=29337): stderr: | 20221212212329234 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212329234 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212329235 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212329235 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212329236 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212329236 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212329236 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:23:30.682668 run osmo-stp_10.42.42.5(pid=29337): stdout: | (launched: 2022-12-12_21:23:29.066178) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:23:30.807521 run osmo-stp_10.42.42.5(pid=29337): stderr: | 20221212212329234 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212329234 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212329235 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212329235 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212329236 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212329236 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212329236 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:23:30.973963 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29337): Process ended prematurely: osmo-stp_10.42.42.5(pid=29337) [trial-2382↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29337)] [trial-2382↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 21:23:30.983427 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 21:23:31.011418 run osmo-hlr_10.42.42.2(pid=29334): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29334)] 21:23:31.068008 run osmo-hlr_10.42.42.2(pid=29334): stdout: | (launched: 2022-12-12_21:23:28.076110) 21:23:31.120455 run osmo-hlr_10.42.42.2(pid=29334): stderr: | 20221212212328252 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212212328252 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212212328252 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212212328252 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212212328252 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212212328252 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212212328265 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212212328275 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212212328275 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212212328275 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:23:31.193000 run osmo-msc_10.42.42.6(pid=29340): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29340)] 21:23:31.243285 run osmo-msc_10.42.42.6(pid=29340): stdout: | (launched: 2022-12-12_21:23:30.056724) 21:23:31.295350 run osmo-msc_10.42.42.6(pid=29340): stderr: | 20221212212330326 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212212330326 DLGLOBAL DEBUG validating counter group 0x7f88c7c9fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212212330326 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212212330326 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212212330326 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212212330326 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212212330328 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212212330329 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212212330329 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212212330329 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:23:31.347678 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29333): Terminating (SIGTERM) 21:23:31.390349 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29336): Terminating (SIGTERM) 21:23:31.435083 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29339): Terminating (SIGTERM) 21:23:31.479326 --- ParallelTerminationStrategy: PID 29333 died... 21:23:31.499482 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29333): Terminated: ok {rc=0} 21:23:31.546178 --- ParallelTerminationStrategy: PID 29336 died... 21:23:31.566109 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29336): Terminated: ok {rc=0} 21:23:31.612600 --- ParallelTerminationStrategy: PID 29339 died... 21:23:31.632575 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29339): Terminated: ok {rc=0} 21:23:31.721183 bus /sierra_3: Setting Powered False 21:23:32.819294 bus /sierra_3: Setting Powered False 21:23:33.938193 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 21:23:35.191274 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:23:35.197939 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 21:23:35.231079 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 21:23:35.257834 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 21:23:35.310943 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 21:23:35.344889 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 21:23:35.371439 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 21:23:35.921866 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 21:23:35.971498 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:23:35.982952 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 21:23:36.052488 tst mo_mt_call.py: using LAC 31593 21:23:36.175531 tst mo_mt_call.py: using RAC 228 21:23:36.297556 tst mo_mt_call.py: using CellId 31593 21:23:36.429633 tst mo_mt_call.py: using BVCI 31594 21:23:36.552130 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:23:36.563844 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:23:36.575186 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:23:36.587079 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:23:36.598950 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:23:36.610667 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 21:23:36.728143 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 21:23:36.848805 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:23:37.331325 run create_hlr_db(pid=29345): Launched 21:23:37.460808 bus /sierra_2: Setting Powered False 21:23:38.523467 run create_hlr_db(pid=29345): Terminated: ok {rc=0} 21:23:38.978667 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29347): Launched 21:23:39.316722 run osmo-hlr_10.42.42.2(pid=29348): Launched 21:23:39.446179 run osmo-stp_10.42.42.5: Starting osmo-stp 21:23:40.023413 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29350): Launched 21:23:40.356439 run osmo-stp_10.42.42.5(pid=29351): Launched 21:23:40.483259 run osmo-msc_10.42.42.6: Starting osmo-msc 21:23:41.084697 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29353): Launched 21:23:41.417536 run osmo-msc_10.42.42.6(pid=29354): Launched 21:23:41.605115 run osmo-stp_10.42.42.5(pid=29351): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29351)] 21:23:41.745738 run osmo-stp_10.42.42.5(pid=29351): stdout: | (launched: 2022-12-12_21:23:40.296242) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:23:41.886394 run osmo-stp_10.42.42.5(pid=29351): stderr: | 20221212212340485 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212340485 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212340485 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212340486 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212340486 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212340486 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212340487 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:23:42.025394 run osmo-stp_10.42.42.5(pid=29351): stdout: | (launched: 2022-12-12_21:23:40.296242) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:23:42.159407 run osmo-stp_10.42.42.5(pid=29351): stderr: | 20221212212340485 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212340485 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212340485 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212340486 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212340486 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212340486 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212340487 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:23:42.319083 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29351): Process ended prematurely: osmo-stp_10.42.42.5(pid=29351) [trial-2382↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29351)] [trial-2382↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 21:23:42.328617 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 21:23:42.357914 run osmo-hlr_10.42.42.2(pid=29348): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29348)] 21:23:42.410045 run osmo-hlr_10.42.42.2(pid=29348): stdout: | (launched: 2022-12-12_21:23:39.256230) 21:23:42.463460 run osmo-hlr_10.42.42.2(pid=29348): stderr: | 20221212212339454 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212212339454 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212212339454 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212212339454 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212212339454 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212212339454 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212212339466 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212212339475 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212212339475 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212212339475 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:23:42.537871 run osmo-msc_10.42.42.6(pid=29354): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29354)] 21:23:42.589537 run osmo-msc_10.42.42.6(pid=29354): stdout: | (launched: 2022-12-12_21:23:41.357291) 21:23:42.642735 run osmo-msc_10.42.42.6(pid=29354): stderr: | 20221212212341679 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212212341679 DLGLOBAL DEBUG validating counter group 0x7ff86f3f7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212212341679 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212212341679 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212212341680 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212212341680 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212212341682 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212212341682 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212212341682 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212212341682 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:23:42.696697 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29347): Terminating (SIGTERM) 21:23:42.739847 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29350): Terminating (SIGTERM) 21:23:42.783059 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29353): Terminating (SIGTERM) 21:23:42.826421 --- ParallelTerminationStrategy: PID 29347 died... 21:23:42.846589 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29347): Terminated: ok {rc=0} 21:23:42.894610 --- ParallelTerminationStrategy: PID 29350 died... 21:23:42.914677 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29350): Terminated: ok {rc=0} 21:23:42.962618 --- ParallelTerminationStrategy: PID 29353 died... 21:23:42.982704 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29353): Terminated: ok {rc=0} 21:23:43.074518 bus /sierra_3: Setting Powered False 21:23:44.177119 bus /sierra_3: Setting Powered False 21:23:45.297371 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2382 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 21:23:46.494380 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:23:46.511538 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 21:23:46.613360 tst mo_mt_call_osmux.py: using LAC 31594 21:23:46.759770 tst mo_mt_call_osmux.py: using RAC 229 21:23:46.893522 tst mo_mt_call_osmux.py: using CellId 31594 21:23:47.044708 tst mo_mt_call_osmux.py: using BVCI 31595 21:23:47.176371 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:23:47.193447 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:23:47.209787 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:23:47.226077 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:23:47.242214 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:23:47.254000 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 21:23:47.392857 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 21:23:47.532298 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:23:48.177355 run create_hlr_db(pid=29438): Launched 21:23:48.371206 bus /sierra_2: Setting Powered False 21:23:49.438791 run create_hlr_db(pid=29438): Terminated: ok {rc=0} 21:23:49.935542 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29628): Launched 21:23:50.289652 run osmo-hlr_10.42.42.2(pid=29629): Launched 21:23:50.544593 run osmo-stp_10.42.42.5: Starting osmo-stp 21:23:51.225312 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29632): Launched 21:23:51.552631 run osmo-stp_10.42.42.5(pid=29634): Launched 21:23:51.804066 run osmo-msc_10.42.42.6: Starting osmo-msc 21:23:52.490440 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29636): Launched 21:23:52.841465 run osmo-msc_10.42.42.6(pid=29637): Launched 21:23:53.215286 run osmo-stp_10.42.42.5(pid=29634): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29634)] 21:23:53.507278 run osmo-stp_10.42.42.5(pid=29634): stdout: | (launched: 2022-12-12_21:23:51.495360) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:23:53.672504 run osmo-stp_10.42.42.5(pid=29634): stderr: | 20221212212351784 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212351784 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212351785 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212351785 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212351786 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212351786 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212351786 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:23:53.815625 run osmo-stp_10.42.42.5(pid=29634): stdout: | (launched: 2022-12-12_21:23:51.495360) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:23:53.952579 run osmo-stp_10.42.42.5(pid=29634): stderr: | 20221212212351784 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212351784 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212351785 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212351785 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212351786 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212351786 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212351786 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:23:54.116756 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29634): Process ended prematurely: osmo-stp_10.42.42.5(pid=29634) [trial-2382↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29634)] [trial-2382↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 21:23:54.127576 tst mo_mt_call_osmux.py:8: Test FAILED (7.7 sec) 21:23:54.161328 run osmo-hlr_10.42.42.2(pid=29629): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29629)] 21:23:54.215891 run osmo-hlr_10.42.42.2(pid=29629): stdout: | (launched: 2022-12-12_21:23:50.229182) 21:23:54.272637 run osmo-hlr_10.42.42.2(pid=29629): stderr: | 20221212212350533 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212212350533 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212212350533 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212212350534 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212212350534 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212212350534 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212212350551 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212212350564 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212212350564 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212212350564 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:23:54.351919 run osmo-msc_10.42.42.6(pid=29637): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29637)] 21:23:54.406539 run osmo-msc_10.42.42.6(pid=29637): stdout: | (launched: 2022-12-12_21:23:52.781423) 21:23:54.462937 run osmo-msc_10.42.42.6(pid=29637): stderr: | 20221212212353272 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212212353272 DLGLOBAL DEBUG validating counter group 0x7fbcd6f57c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212212353272 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212212353272 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212212353272 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212212353289 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212212353291 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212212353291 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212212353291 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212212353291 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:23:54.519863 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29628): Terminating (SIGTERM) 21:23:54.567142 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29632): Terminating (SIGTERM) 21:23:54.615231 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29636): Terminating (SIGTERM) 21:23:54.663252 --- ParallelTerminationStrategy: PID 29628 died... 21:23:54.685090 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29628): Terminated: ok {rc=0} 21:23:54.737900 --- ParallelTerminationStrategy: PID 29632 died... 21:23:54.760687 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29632): Terminated: ok {rc=0} 21:23:54.812126 --- ParallelTerminationStrategy: PID 29636 died... 21:23:54.833448 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29636): Terminated: ok {rc=0} 21:23:54.927818 bus /sierra_3: Setting Powered False 21:23:56.030027 bus /sierra_3: Setting Powered False 21:23:57.151144 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 21:23:58.424558 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:23:58.433146 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 21:23:58.472934 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 21:23:58.503328 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 21:23:58.557662 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 21:23:58.594927 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 21:23:58.624658 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 21:23:59.175778 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 21:23:59.233757 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:23:59.246666 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 21:23:59.319259 tst mo_mt_call.py: using LAC 31595 21:23:59.456861 tst mo_mt_call.py: using RAC 230 21:23:59.589506 tst mo_mt_call.py: using CellId 31595 21:23:59.722042 tst mo_mt_call.py: using BVCI 31596 21:23:59.848309 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:23:59.861583 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:23:59.875428 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:23:59.889540 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:23:59.903347 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:23:59.915949 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 21:24:00.045760 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 21:24:00.174818 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:24:00.709594 run create_hlr_db(pid=29642): Launched 21:24:00.902239 bus /sierra_2: Setting Powered False 21:24:01.992777 run create_hlr_db(pid=29642): Terminated: ok {rc=0} 21:24:02.580515 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29644): Launched 21:24:02.933651 run osmo-hlr_10.42.42.2(pid=29645): Launched 21:24:03.185549 run osmo-stp_10.42.42.5: Starting osmo-stp 21:24:03.833395 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29647): Launched 21:24:04.186456 run osmo-stp_10.42.42.5(pid=29648): Launched 21:24:04.445533 run osmo-msc_10.42.42.6: Starting osmo-msc 21:24:05.135699 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29650): Launched 21:24:05.490047 run osmo-msc_10.42.42.6(pid=29651): Launched 21:24:05.849987 run osmo-stp_10.42.42.5(pid=29648): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29648)] 21:24:06.126764 run osmo-stp_10.42.42.5(pid=29648): stdout: | (launched: 2022-12-12_21:24:04.124157) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:24:06.421531 run osmo-stp_10.42.42.5(pid=29648): stderr: | 20221212212404413 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212404413 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212404414 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212404414 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212404414 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212404415 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212404415 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:24:06.560076 run osmo-stp_10.42.42.5(pid=29648): stdout: | (launched: 2022-12-12_21:24:04.124157) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:24:06.692422 run osmo-stp_10.42.42.5(pid=29648): stderr: | 20221212212404413 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212404413 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212404414 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212404414 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212404414 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212404415 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212404415 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:24:06.845840 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29648): Process ended prematurely: osmo-stp_10.42.42.5(pid=29648) [trial-2382↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29648)] [trial-2382↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 21:24:06.855914 tst mo_mt_call.py:8: Test FAILED (7.7 sec) 21:24:06.885220 run osmo-hlr_10.42.42.2(pid=29645): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29645)] 21:24:06.937142 run osmo-hlr_10.42.42.2(pid=29645): stdout: | (launched: 2022-12-12_21:24:02.870040) 21:24:06.990517 run osmo-hlr_10.42.42.2(pid=29645): stderr: | 20221212212403141 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212212403141 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212212403141 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212212403141 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212212403141 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212212403141 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212212403156 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212212403164 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212212403164 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212212403164 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:24:07.064330 run osmo-msc_10.42.42.6(pid=29651): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29651)] 21:24:07.116488 run osmo-msc_10.42.42.6(pid=29651): stdout: | (launched: 2022-12-12_21:24:05.428441) 21:24:07.169694 run osmo-msc_10.42.42.6(pid=29651): stderr: | 20221212212406014 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212212406014 DLGLOBAL DEBUG validating counter group 0x7f351af1ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212212406014 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212212406014 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212212406014 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212212406015 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212212406016 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212212406021 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212212406021 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212212406021 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:24:07.223549 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29644): Terminating (SIGTERM) 21:24:07.266354 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29647): Terminating (SIGTERM) 21:24:07.311319 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29650): Terminating (SIGTERM) 21:24:07.356722 --- ParallelTerminationStrategy: PID 29644 died... 21:24:07.377808 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29644): Terminated: ok {rc=0} 21:24:07.426838 --- ParallelTerminationStrategy: PID 29647 died... 21:24:07.447409 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29647): Terminated: ok {rc=0} 21:24:07.494863 --- ParallelTerminationStrategy: PID 29650 died... 21:24:07.515357 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29650): Terminated: ok {rc=0} 21:24:07.606199 bus /sierra_3: Setting Powered False 21:24:08.707409 bus /sierra_3: Setting Powered False 21:24:09.831390 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2382 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 21:24:10.989203 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:24:11.001870 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 21:24:11.074456 tst mo_mt_call_osmux.py: using LAC 31596 21:24:11.207602 tst mo_mt_call_osmux.py: using RAC 231 21:24:11.345313 tst mo_mt_call_osmux.py: using CellId 31596 21:24:11.476556 tst mo_mt_call_osmux.py: using BVCI 31597 21:24:11.598710 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:24:11.610537 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:24:11.622314 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:24:11.634196 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:24:11.646153 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:24:11.657853 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 21:24:11.777662 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 21:24:11.898968 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:24:12.383918 run create_hlr_db(pid=29654): Launched 21:24:12.511043 bus /sierra_2: Setting Powered False 21:24:13.573079 run create_hlr_db(pid=29654): Terminated: ok {rc=0} 21:24:14.007032 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29656): Launched 21:24:14.320352 run osmo-hlr_10.42.42.2(pid=29657): Launched 21:24:14.439038 run osmo-stp_10.42.42.5: Starting osmo-stp 21:24:14.978522 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29659): Launched 21:24:15.292324 run osmo-stp_10.42.42.5(pid=29660): Launched 21:24:15.411216 run osmo-msc_10.42.42.6: Starting osmo-msc 21:24:16.009723 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29662): Launched 21:24:16.366864 run osmo-msc_10.42.42.6(pid=29663): Launched 21:24:16.723612 run osmo-stp_10.42.42.5(pid=29660): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29660)] 21:24:16.890265 run osmo-stp_10.42.42.5(pid=29660): stdout: | (launched: 2022-12-12_21:24:15.235098) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:24:17.126421 run osmo-stp_10.42.42.5(pid=29660): stderr: | 20221212212415408 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212415408 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212415408 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212415409 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212415409 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212415409 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212415409 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:24:17.292505 run osmo-stp_10.42.42.5(pid=29660): stdout: | (launched: 2022-12-12_21:24:15.235098) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:24:17.433052 run osmo-stp_10.42.42.5(pid=29660): stderr: | 20221212212415408 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212415408 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212415408 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212415409 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212415409 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212415409 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212415409 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:24:17.588146 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29660): Process ended prematurely: osmo-stp_10.42.42.5(pid=29660) [trial-2382↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29660)] [trial-2382↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 21:24:17.597434 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 21:24:17.625200 run osmo-hlr_10.42.42.2(pid=29657): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29657)] 21:24:17.675414 run osmo-hlr_10.42.42.2(pid=29657): stdout: | (launched: 2022-12-12_21:24:14.262973) 21:24:17.727211 run osmo-hlr_10.42.42.2(pid=29657): stderr: | 20221212212414442 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212212414442 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212212414442 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212212414442 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212212414442 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212212414442 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212212414454 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212212414465 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212212414465 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212212414465 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:24:17.800302 run osmo-msc_10.42.42.6(pid=29663): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29663)] 21:24:17.850602 run osmo-msc_10.42.42.6(pid=29663): stdout: | (launched: 2022-12-12_21:24:16.302777) 21:24:17.902420 run osmo-msc_10.42.42.6(pid=29663): stderr: | 20221212212416750 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212212416750 DLGLOBAL DEBUG validating counter group 0x7f2e632a0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212212416750 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212212416751 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212212416751 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212212416751 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212212416753 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212212416754 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212212416754 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212212416754 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:24:17.954631 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29656): Terminating (SIGTERM) 21:24:17.996059 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29659): Terminating (SIGTERM) 21:24:18.037725 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29662): Terminating (SIGTERM) 21:24:18.079460 --- ParallelTerminationStrategy: PID 29656 died... 21:24:18.099690 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29656): Terminated: ok {rc=0} 21:24:18.146093 --- ParallelTerminationStrategy: PID 29659 died... 21:24:18.165458 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29659): Terminated: ok {rc=0} 21:24:18.211657 --- ParallelTerminationStrategy: PID 29662 died... 21:24:18.231275 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29662): Terminated: ok {rc=0} 21:24:18.320126 bus /sierra_3: Setting Powered False 21:24:19.424140 bus /sierra_3: Setting Powered False 21:24:20.540847 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 21:24:21.803274 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:24:21.810673 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 21:24:21.845869 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 21:24:21.873367 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 21:24:21.927696 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 21:24:21.962927 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 21:24:21.990319 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 21:24:22.540906 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 21:24:22.595275 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:24:22.606964 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 21:24:22.677952 tst mo_mt_call.py: using LAC 31597 21:24:22.814042 tst mo_mt_call.py: using RAC 232 21:24:22.945288 tst mo_mt_call.py: using CellId 31597 21:24:23.076047 tst mo_mt_call.py: using BVCI 31598 21:24:23.198940 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:24:23.210603 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:24:23.222004 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:24:23.233759 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:24:23.245616 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:24:23.257286 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 21:24:23.376463 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 21:24:23.496923 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:24:23.981083 run create_hlr_db(pid=29668): Launched 21:24:24.108890 bus /sierra_2: Setting Powered False 21:24:25.170086 run create_hlr_db(pid=29668): Terminated: ok {rc=0} 21:24:25.624635 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29670): Launched 21:24:25.959843 run osmo-hlr_10.42.42.2(pid=29671): Launched 21:24:26.086771 run osmo-stp_10.42.42.5: Starting osmo-stp 21:24:26.670050 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29673): Launched 21:24:27.003757 run osmo-stp_10.42.42.5(pid=29674): Launched 21:24:27.132148 run osmo-msc_10.42.42.6: Starting osmo-msc 21:24:27.735349 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29676): Launched 21:24:28.069580 run osmo-msc_10.42.42.6(pid=29677): Launched 21:24:28.257496 run osmo-stp_10.42.42.5(pid=29674): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29674)] 21:24:28.398618 run osmo-stp_10.42.42.5(pid=29674): stdout: | (launched: 2022-12-12_21:24:26.942989) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:24:28.540058 run osmo-stp_10.42.42.5(pid=29674): stderr: | 20221212212427134 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212427134 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212427134 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212427135 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212427135 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212427135 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212427135 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:24:28.679461 run osmo-stp_10.42.42.5(pid=29674): stdout: | (launched: 2022-12-12_21:24:26.942989) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:24:28.813172 run osmo-stp_10.42.42.5(pid=29674): stderr: | 20221212212427134 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212427134 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212427134 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212427135 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212427135 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212427135 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212427135 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:24:28.972653 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29674): Process ended prematurely: osmo-stp_10.42.42.5(pid=29674) [trial-2382↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29674)] [trial-2382↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 21:24:28.982444 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 21:24:29.011243 run osmo-hlr_10.42.42.2(pid=29671): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29671)] 21:24:29.062886 run osmo-hlr_10.42.42.2(pid=29671): stdout: | (launched: 2022-12-12_21:24:25.899045) 21:24:29.116496 run osmo-hlr_10.42.42.2(pid=29671): stderr: | 20221212212426097 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212212426097 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212212426097 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212212426097 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212212426097 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212212426097 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212212426111 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212212426122 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212212426122 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212212426122 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:24:29.190702 run osmo-msc_10.42.42.6(pid=29677): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29677)] 21:24:29.242349 run osmo-msc_10.42.42.6(pid=29677): stdout: | (launched: 2022-12-12_21:24:28.008797) 21:24:29.295589 run osmo-msc_10.42.42.6(pid=29677): stderr: | 20221212212428329 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212212428330 DLGLOBAL DEBUG validating counter group 0x7f773b7abc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212212428330 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212212428330 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212212428330 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212212428330 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212212428332 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212212428332 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212212428332 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212212428332 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:24:29.349486 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29670): Terminating (SIGTERM) 21:24:29.392486 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29673): Terminating (SIGTERM) 21:24:29.435437 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29676): Terminating (SIGTERM) 21:24:29.478564 --- ParallelTerminationStrategy: PID 29670 died... 21:24:29.498995 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29670): Terminated: ok {rc=0} 21:24:29.546737 --- ParallelTerminationStrategy: PID 29673 died... 21:24:29.566713 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29673): Terminated: ok {rc=0} 21:24:29.614381 --- ParallelTerminationStrategy: PID 29676 died... 21:24:29.634243 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29676): Terminated: ok {rc=0} 21:24:29.723842 bus /sierra_3: Setting Powered False 21:24:30.824188 bus /sierra_3: Setting Powered False 21:24:31.958514 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2382 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 21:24:33.125771 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:24:33.138032 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 21:24:33.210500 tst mo_mt_call_osmux.py: using LAC 31598 21:24:33.332371 tst mo_mt_call_osmux.py: using RAC 233 21:24:33.453637 tst mo_mt_call_osmux.py: using CellId 31598 21:24:33.575397 tst mo_mt_call_osmux.py: using BVCI 31599 21:24:33.698770 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:24:33.710588 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:24:33.722300 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:24:33.734582 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:24:33.747093 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:24:33.759413 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 21:24:33.881543 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 21:24:34.000682 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:24:34.490700 run create_hlr_db(pid=29680): Launched 21:24:34.620352 bus /sierra_2: Setting Powered False 21:24:35.686771 run create_hlr_db(pid=29680): Terminated: ok {rc=0} 21:24:36.150169 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29682): Launched 21:24:36.485379 run osmo-hlr_10.42.42.2(pid=29683): Launched 21:24:36.614170 run osmo-stp_10.42.42.5: Starting osmo-stp 21:24:37.190058 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29685): Launched 21:24:37.523726 run osmo-stp_10.42.42.5(pid=29686): Launched 21:24:37.651491 run osmo-msc_10.42.42.6: Starting osmo-msc 21:24:38.254712 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29688): Launched 21:24:38.588293 run osmo-msc_10.42.42.6(pid=29689): Launched 21:24:38.774607 run osmo-stp_10.42.42.5(pid=29686): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29686)] 21:24:38.915221 run osmo-stp_10.42.42.5(pid=29686): stdout: | (launched: 2022-12-12_21:24:37.463040) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:24:39.055910 run osmo-stp_10.42.42.5(pid=29686): stderr: | 20221212212437654 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212437654 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212437654 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212437655 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212437655 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212437655 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212437655 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:24:39.195579 run osmo-stp_10.42.42.5(pid=29686): stdout: | (launched: 2022-12-12_21:24:37.463040) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:24:39.328635 run osmo-stp_10.42.42.5(pid=29686): stderr: | 20221212212437654 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212437654 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212437654 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212437655 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212437655 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212437655 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212437655 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:24:39.487556 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29686): Process ended prematurely: osmo-stp_10.42.42.5(pid=29686) [trial-2382↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29686)] [trial-2382↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 21:24:39.497364 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 21:24:39.526107 run osmo-hlr_10.42.42.2(pid=29683): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29683)] 21:24:39.578444 run osmo-hlr_10.42.42.2(pid=29683): stdout: | (launched: 2022-12-12_21:24:36.424166) 21:24:39.632126 run osmo-hlr_10.42.42.2(pid=29683): stderr: | 20221212212436623 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212212436623 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212212436623 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212212436623 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212212436623 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212212436623 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212212436639 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212212436648 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212212436648 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212212436649 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:24:39.706813 run osmo-msc_10.42.42.6(pid=29689): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29689)] 21:24:39.758848 run osmo-msc_10.42.42.6(pid=29689): stdout: | (launched: 2022-12-12_21:24:38.527467) 21:24:39.812707 run osmo-msc_10.42.42.6(pid=29689): stderr: | 20221212212438849 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212212438850 DLGLOBAL DEBUG validating counter group 0x7fca9f32cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212212438850 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212212438850 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212212438850 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212212438850 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212212438852 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212212438852 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212212438852 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212212438852 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:24:39.867388 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29682): Terminating (SIGTERM) 21:24:39.910683 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29685): Terminating (SIGTERM) 21:24:39.953772 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29688): Terminating (SIGTERM) 21:24:39.997324 --- ParallelTerminationStrategy: PID 29682 died... 21:24:40.017937 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29682): Terminated: ok {rc=0} 21:24:40.066185 --- ParallelTerminationStrategy: PID 29685 died... 21:24:40.086408 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29685): Terminated: ok {rc=0} 21:24:40.134805 --- ParallelTerminationStrategy: PID 29688 died... 21:24:40.155063 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29688): Terminated: ok {rc=0} 21:24:40.246468 bus /sierra_3: Setting Powered False 21:24:41.347306 bus /sierra_3: Setting Powered False 21:24:42.467298 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 21:24:43.722091 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:24:43.728460 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 21:24:43.761370 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 21:24:43.788028 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 21:24:43.839929 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 21:24:43.872775 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 21:24:43.899136 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 21:24:44.450668 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 21:24:44.500212 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:24:44.511445 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 21:24:44.583614 tst mo_mt_call.py: using LAC 31599 21:24:44.704709 tst mo_mt_call.py: using RAC 234 21:24:44.824749 tst mo_mt_call.py: using CellId 31599 21:24:44.944452 tst mo_mt_call.py: using BVCI 31600 21:24:45.056367 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:24:45.067734 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:24:45.078718 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:24:45.089795 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:24:45.100897 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:24:45.111999 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:24:45.232692 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:24:45.349855 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:24:45.831828 run create_hlr_db(pid=29695): Launched 21:24:45.980388 bus /sierra_2: Setting Powered False 21:24:47.045700 run create_hlr_db(pid=29695): Terminated: ok {rc=0} 21:24:47.516131 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29697): Launched 21:24:47.851833 run osmo-hlr_10.42.42.2(pid=29698): Launched 21:24:47.979198 run osmo-stp_10.42.42.5: Starting osmo-stp 21:24:48.553495 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29700): Launched 21:24:48.889119 run osmo-stp_10.42.42.5(pid=29701): Launched 21:24:49.015930 run osmo-msc_10.42.42.6: Starting osmo-msc 21:24:49.619008 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29703): Launched 21:24:49.954160 run osmo-msc_10.42.42.6(pid=29704): Launched 21:24:50.142544 run osmo-stp_10.42.42.5(pid=29701): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29701)] 21:24:50.284014 run osmo-stp_10.42.42.5(pid=29701): stdout: | (launched: 2022-12-12_21:24:48.827850) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:24:50.425764 run osmo-stp_10.42.42.5(pid=29701): stderr: | 20221212212449020 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212449020 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212449021 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212449021 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212449021 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212449022 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212449022 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:24:50.565734 run osmo-stp_10.42.42.5(pid=29701): stdout: | (launched: 2022-12-12_21:24:48.827850) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:24:50.699187 run osmo-stp_10.42.42.5(pid=29701): stderr: | 20221212212449020 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212449020 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212449021 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212449021 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212449021 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212449022 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212449022 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:24:50.858720 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29701): Process ended prematurely: osmo-stp_10.42.42.5(pid=29701) [trial-2382↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29701)] [trial-2382↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 21:24:50.868698 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 21:24:50.898004 run osmo-hlr_10.42.42.2(pid=29698): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29698)] 21:24:50.949869 run osmo-hlr_10.42.42.2(pid=29698): stdout: | (launched: 2022-12-12_21:24:47.791077) 21:24:51.003587 run osmo-hlr_10.42.42.2(pid=29698): stderr: | 20221212212447989 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212212447989 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212212447989 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212212447989 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212212447989 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212212447989 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212212448002 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212212448011 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212212448011 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212212448011 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:24:51.078411 run osmo-msc_10.42.42.6(pid=29704): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29704)] 21:24:51.130872 run osmo-msc_10.42.42.6(pid=29704): stdout: | (launched: 2022-12-12_21:24:49.892760) 21:24:51.184518 run osmo-msc_10.42.42.6(pid=29704): stderr: | 20221212212450214 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212212450214 DLGLOBAL DEBUG validating counter group 0x7fb28c3c5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212212450214 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212212450214 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212212450214 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212212450215 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212212450216 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212212450217 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212212450217 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212212450217 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:24:51.238551 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29697): Terminating (SIGTERM) 21:24:51.281787 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29700): Terminating (SIGTERM) 21:24:51.325157 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29703): Terminating (SIGTERM) 21:24:51.368554 --- ParallelTerminationStrategy: PID 29697 died... 21:24:51.389224 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29697): Terminated: ok {rc=0} 21:24:51.437543 --- ParallelTerminationStrategy: PID 29700 died... 21:24:51.457683 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29700): Terminated: ok {rc=0} 21:24:51.505529 --- ParallelTerminationStrategy: PID 29703 died... 21:24:51.525600 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29703): Terminated: ok {rc=0} 21:24:51.616052 bus /sierra_3: Setting Powered False 21:24:52.714521 bus /sierra_3: Setting Powered False 21:24:53.832479 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2382 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 21:24:54.982884 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:24:54.994627 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 21:24:55.064888 tst mo_mt_call_osmux.py: using LAC 31600 21:24:55.189448 tst mo_mt_call_osmux.py: using RAC 235 21:24:55.311298 tst mo_mt_call_osmux.py: using CellId 31600 21:24:55.435484 tst mo_mt_call_osmux.py: using BVCI 31601 21:24:55.550884 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:24:55.562360 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:24:55.573553 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:24:55.584638 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:24:55.595891 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:24:55.606918 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:24:55.728455 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:24:55.847877 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:24:56.332464 run create_hlr_db(pid=29706): Launched 21:24:56.459131 bus /sierra_2: Setting Powered False 21:24:57.521628 run create_hlr_db(pid=29706): Terminated: ok {rc=0} 21:24:57.978086 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29708): Launched 21:24:58.314671 run osmo-hlr_10.42.42.2(pid=29709): Launched 21:24:58.444275 run osmo-stp_10.42.42.5: Starting osmo-stp 21:24:59.027142 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29711): Launched 21:24:59.361851 run osmo-stp_10.42.42.5(pid=29712): Launched 21:24:59.489669 run osmo-msc_10.42.42.6: Starting osmo-msc 21:25:00.099341 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29714): Launched 21:25:00.437695 run osmo-msc_10.42.42.6(pid=29715): Launched 21:25:00.627807 run osmo-stp_10.42.42.5(pid=29712): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29712)] 21:25:00.770368 run osmo-stp_10.42.42.5(pid=29712): stdout: | (launched: 2022-12-12_21:24:59.300659) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:25:00.948246 run osmo-stp_10.42.42.5(pid=29712): stderr: | 20221212212459495 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212459495 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212459496 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212459496 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212459496 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212459497 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212459497 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:25:01.101716 run osmo-stp_10.42.42.5(pid=29712): stdout: | (launched: 2022-12-12_21:24:59.300659) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:25:01.232673 run osmo-stp_10.42.42.5(pid=29712): stderr: | 20221212212459495 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212459495 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212459496 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212459496 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212459496 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212459497 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212459497 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:25:01.402509 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29712): Process ended prematurely: osmo-stp_10.42.42.5(pid=29712) [trial-2382↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29712)] [trial-2382↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 21:25:01.416661 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 21:25:01.444923 run osmo-hlr_10.42.42.2(pid=29709): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29709)] 21:25:01.496547 run osmo-hlr_10.42.42.2(pid=29709): stdout: | (launched: 2022-12-12_21:24:58.253839) 21:25:01.557181 run osmo-hlr_10.42.42.2(pid=29709): stderr: | 20221212212458451 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212212458451 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212212458451 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212212458451 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212212458451 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212212458451 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212212458463 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212212458471 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212212458471 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212212458471 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:25:01.630219 run osmo-msc_10.42.42.6(pid=29715): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29715)] 21:25:01.684820 run osmo-msc_10.42.42.6(pid=29715): stdout: | (launched: 2022-12-12_21:25:00.376276) 21:25:01.736635 run osmo-msc_10.42.42.6(pid=29715): stderr: | 20221212212500699 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212212500699 DLGLOBAL DEBUG validating counter group 0x7fe8b16f7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212212500699 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212212500699 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212212500699 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212212500700 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212212500701 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212212500702 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212212500702 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212212500702 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:25:01.789900 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29708): Terminating (SIGTERM) 21:25:01.832521 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29711): Terminating (SIGTERM) 21:25:01.877395 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29714): Terminating (SIGTERM) 21:25:01.922924 --- ParallelTerminationStrategy: PID 29708 died... 21:25:01.943017 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29708): Terminated: ok {rc=0} 21:25:01.991751 --- ParallelTerminationStrategy: PID 29711 died... 21:25:02.011502 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29711): Terminated: ok {rc=0} 21:25:02.057468 --- ParallelTerminationStrategy: PID 29714 died... 21:25:02.077250 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29714): Terminated: ok {rc=0} 21:25:02.171845 bus /sierra_3: Setting Powered False 21:25:03.270589 bus /sierra_3: Setting Powered False 21:25:04.384603 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 voice:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 21:25:05.632913 tst voice:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:25:05.638763 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 21:25:05.671469 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 21:25:05.697979 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 21:25:05.750698 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 21:25:05.783713 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 21:25:05.809948 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 21:25:06.358288 tst voice:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 21:25:06.408216 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:25:06.419232 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 21:25:06.502190 tst mo_mt_call.py: using LAC 31601 21:25:06.629043 tst mo_mt_call.py: using RAC 236 21:25:06.753049 tst mo_mt_call.py: using CellId 31601 21:25:06.877190 tst mo_mt_call.py: using BVCI 31602 21:25:06.990600 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:25:07.001617 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:25:07.012242 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:25:07.022885 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:25:07.033770 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:25:07.044425 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 21:25:07.166016 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 21:25:07.283629 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:25:07.767771 run create_hlr_db(pid=29801): Launched 21:25:07.895507 bus /sierra_2: Setting Powered False 21:25:08.957954 run create_hlr_db(pid=29801): Terminated: ok {rc=0} 21:25:09.393666 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29825): Launched 21:25:09.706142 run osmo-hlr_10.42.42.2(pid=29826): Launched 21:25:09.823533 run osmo-stp_10.42.42.5: Starting osmo-stp 21:25:10.363418 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29828): Launched 21:25:10.675998 run osmo-stp_10.42.42.5(pid=29829): Launched 21:25:10.794329 run osmo-msc_10.42.42.6: Starting osmo-msc 21:25:11.356831 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29831): Launched 21:25:11.671799 run osmo-msc_10.42.42.6(pid=29832): Launched 21:25:11.846773 run osmo-stp_10.42.42.5(pid=29829): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29829)] 21:25:11.979332 run osmo-stp_10.42.42.5(pid=29829): stdout: | (launched: 2022-12-12_21:25:10.618829) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:25:12.111373 run osmo-stp_10.42.42.5(pid=29829): stderr: | 20221212212510791 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212510791 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212510791 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212510792 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212510792 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212510792 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212510792 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:25:12.243034 run osmo-stp_10.42.42.5(pid=29829): stdout: | (launched: 2022-12-12_21:25:10.618829) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:25:12.368242 run osmo-stp_10.42.42.5(pid=29829): stderr: | 20221212212510791 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212510791 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212510791 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212510792 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212510792 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212510792 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212510792 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:25:12.518102 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29829): Process ended prematurely: osmo-stp_10.42.42.5(pid=29829) [trial-2382↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29829)] [trial-2382↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 21:25:12.527115 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 21:25:12.553919 run osmo-hlr_10.42.42.2(pid=29826): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29826)] 21:25:12.602448 run osmo-hlr_10.42.42.2(pid=29826): stdout: | (launched: 2022-12-12_21:25:09.648762) 21:25:12.652787 run osmo-hlr_10.42.42.2(pid=29826): stderr: | 20221212212509826 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212212509826 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212212509826 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212212509826 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212212509826 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212212509826 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212212509839 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212212509848 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212212509849 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212212509849 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:25:12.723468 run osmo-msc_10.42.42.6(pid=29832): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29832)] 21:25:12.772136 run osmo-msc_10.42.42.6(pid=29832): stdout: | (launched: 2022-12-12_21:25:11.613930) 21:25:12.822497 run osmo-msc_10.42.42.6(pid=29832): stderr: | 20221212212511885 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212212511885 DLGLOBAL DEBUG validating counter group 0x7f930b40dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212212511885 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212212511885 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212212511886 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212212511886 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212212511888 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212212511888 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212212511888 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212212511888 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:25:12.872881 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29825): Terminating (SIGTERM) 21:25:12.913404 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29828): Terminating (SIGTERM) 21:25:12.953937 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29831): Terminating (SIGTERM) 21:25:12.994587 --- ParallelTerminationStrategy: PID 29825 died... 21:25:13.014075 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29825): Terminated: ok {rc=0} 21:25:13.058857 --- ParallelTerminationStrategy: PID 29828 died... 21:25:13.077756 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29828): Terminated: ok {rc=0} 21:25:13.122615 --- ParallelTerminationStrategy: PID 29831 died... 21:25:13.142072 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29831): Terminated: ok {rc=0} 21:25:13.227400 bus /sierra_3: Setting Powered False 21:25:14.324530 bus /sierra_3: Setting Powered False 21:25:15.460416 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2382 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 21:25:16.692897 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:25:16.708871 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 21:25:16.804075 tst mo_mt_call_osmux.py: using LAC 31602 21:25:16.943118 tst mo_mt_call_osmux.py: using RAC 237 21:25:17.103169 tst mo_mt_call_osmux.py: using CellId 31602 21:25:17.270854 tst mo_mt_call_osmux.py: using BVCI 31603 21:25:17.418159 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:25:17.430877 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:25:17.444663 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:25:17.458318 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:25:17.470914 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:25:17.485376 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 21:25:17.632593 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 21:25:17.767340 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:25:18.294550 run create_hlr_db(pid=29838): Launched 21:25:18.461440 bus /sierra_2: Setting Powered False 21:25:19.560680 run create_hlr_db(pid=29838): Terminated: ok {rc=0} 21:25:20.038903 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29840): Launched 21:25:20.392489 run osmo-hlr_10.42.42.2(pid=29841): Launched 21:25:20.662158 run osmo-stp_10.42.42.5: Starting osmo-stp 21:25:21.387369 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29843): Launched 21:25:21.745645 run osmo-stp_10.42.42.5(pid=29844): Launched 21:25:21.875255 run osmo-msc_10.42.42.6: Starting osmo-msc 21:25:22.621598 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29846): Launched 21:25:22.975592 run osmo-msc_10.42.42.6(pid=29847): Launched 21:25:23.392881 run osmo-stp_10.42.42.5(pid=29844): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29844)] 21:25:23.699430 run osmo-stp_10.42.42.5(pid=29844): stdout: | (launched: 2022-12-12_21:25:21.681325) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:25:23.854220 run osmo-stp_10.42.42.5(pid=29844): stderr: | 20221212212522049 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212522049 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212522050 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212522050 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212522050 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212522051 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212522051 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:25:23.998344 run osmo-stp_10.42.42.5(pid=29844): stdout: | (launched: 2022-12-12_21:25:21.681325) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:25:24.137016 run osmo-stp_10.42.42.5(pid=29844): stderr: | 20221212212522049 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212522049 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212522050 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212522050 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212522050 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212522051 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212522051 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:25:24.302667 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29844): Process ended prematurely: osmo-stp_10.42.42.5(pid=29844) [trial-2382↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29844)] [trial-2382↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 21:25:24.313587 tst mo_mt_call_osmux.py:8: Test FAILED (7.7 sec) 21:25:24.346563 run osmo-hlr_10.42.42.2(pid=29841): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29841)] 21:25:24.401238 run osmo-hlr_10.42.42.2(pid=29841): stdout: | (launched: 2022-12-12_21:25:20.330535) 21:25:24.457611 run osmo-hlr_10.42.42.2(pid=29841): stderr: | 20221212212520628 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212212520628 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212212520628 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212212520628 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212212520628 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212212520628 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212212520642 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212212520655 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212212520655 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212212520655 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:25:24.536034 run osmo-msc_10.42.42.6(pid=29847): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29847)] 21:25:24.590978 run osmo-msc_10.42.42.6(pid=29847): stdout: | (launched: 2022-12-12_21:25:22.913629) 21:25:24.647080 run osmo-msc_10.42.42.6(pid=29847): stderr: | 20221212212523448 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212212523448 DLGLOBAL DEBUG validating counter group 0x7feac52b8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212212523448 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212212523448 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212212523453 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212212523453 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212212523455 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212212523455 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212212523456 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212212523456 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:25:24.703834 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29840): Terminating (SIGTERM) 21:25:24.749973 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29843): Terminating (SIGTERM) 21:25:24.797411 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29846): Terminating (SIGTERM) 21:25:24.846122 --- ParallelTerminationStrategy: PID 29840 died... 21:25:24.867584 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29840): Terminated: ok {rc=0} 21:25:24.920372 --- ParallelTerminationStrategy: PID 29843 died... 21:25:24.941904 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29843): Terminated: ok {rc=0} 21:25:24.992578 --- ParallelTerminationStrategy: PID 29846 died... 21:25:25.013772 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29846): Terminated: ok {rc=0} 21:25:25.109231 bus /sierra_3: Setting Powered False 21:25:26.231089 bus /sierra_3: Setting Powered False 21:25:27.380188 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 voice:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 emergency:trx-lms --------------------------------------------------------------------- 21:25:28.700276 tst emergency:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:25:28.706776 tst emergency:trx-lms: Verifying 1 x bts (candidates: 11) 21:25:28.744796 tst emergency:trx-lms: Verifying 6 x ip_address (candidates: 9) 21:25:28.775207 tst emergency:trx-lms: Verifying 4 x modem (candidates: 12) 21:25:28.866958 tst emergency:trx-lms: Reserving 1 x bts (candidates: 11) 21:25:28.912149 tst emergency:trx-lms: Reserving 6 x ip_address (candidates: 9) 21:25:28.942268 tst emergency:trx-lms: Reserving 4 x modem (candidates: 12) 21:25:29.554041 tst emergency:trx-lms: RESERVED RESOURCES for emergency: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2382 emergency:trx-lms emergency_mo_mt_call.py ---------------------------------------------- 21:25:29.564890 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 21:25:29.579624 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 21:25:29.644606 tst emergency_mo_mt_call.py: using LAC 31603 21:25:29.784681 tst emergency_mo_mt_call.py: using RAC 238 21:25:29.932814 tst emergency_mo_mt_call.py: using CellId 31603 21:25:30.073099 tst emergency_mo_mt_call.py: using BVCI 31604 21:25:30.241330 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 21:25:30.254759 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 21:25:30.269522 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 21:25:30.281944 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 21:25:30.295031 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 21:25:30.307522 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 21:25:30.451609 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 21:25:30.580150 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:25:31.195826 run create_hlr_db(pid=29852): Launched 21:25:31.393127 bus /sierra_2: Setting Powered False 21:25:32.479920 run create_hlr_db(pid=29852): Terminated: ok {rc=0} 21:25:32.992605 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29854): Launched 21:25:33.341244 run osmo-hlr_10.42.42.2(pid=29855): Launched 21:25:33.619681 run osmo-stp_10.42.42.5: Starting osmo-stp 21:25:34.323739 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29857): Launched 21:25:34.672541 run osmo-stp_10.42.42.5(pid=29858): Launched 21:25:34.934127 tst emergency_mo_mt_call.py: using MSISDN 7975 21:25:35.157381 run osmo-msc_10.42.42.6: Starting osmo-msc 21:25:35.753476 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29860): Launched 21:25:36.130997 run osmo-msc_10.42.42.6(pid=29861): Launched 21:25:36.530817 run osmo-stp_10.42.42.5(pid=29858): ERR: Terminated: ERROR {rc=1} [trial-2382↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29858)] 21:25:36.815759 run osmo-stp_10.42.42.5(pid=29858): stdout: | (launched: 2022-12-12_21:25:34.611019) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:25:37.042642 run osmo-stp_10.42.42.5(pid=29858): stderr: | 20221212212534867 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212534867 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212534867 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212534868 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212534868 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212534868 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212534868 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:25:37.187596 run osmo-stp_10.42.42.5(pid=29858): stdout: | (launched: 2022-12-12_21:25:34.611019) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:25:37.322605 run osmo-stp_10.42.42.5(pid=29858): stderr: | 20221212212534867 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212534867 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212534867 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212534868 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212534868 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212534868 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212534868 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:25:37.484543 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=29858): Process ended prematurely: osmo-stp_10.42.42.5(pid=29858) [trial-2382↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29858)] [trial-2382↪emergency:trx-lms↪emergency_mo_mt_call.py:19] 21:25:37.493871 tst emergency_mo_mt_call.py:19: Test FAILED (7.9 sec) 21:25:37.525655 run osmo-hlr_10.42.42.2(pid=29855): ERR: Terminated: ERROR {rc=237} [trial-2382↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29855)] 21:25:37.579665 run osmo-hlr_10.42.42.2(pid=29855): stdout: | (launched: 2022-12-12_21:25:33.278190) 21:25:37.635769 run osmo-hlr_10.42.42.2(pid=29855): stderr: | 20221212212533577 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212212533577 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212212533577 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212212533577 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212212533577 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212212533577 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212212533600 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/emergency:trx-lms/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212212533626 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212212533626 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212212533626 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:25:37.713298 run osmo-msc_10.42.42.6(pid=29861): ERR: Terminated: ERROR {rc=2} [trial-2382↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29861)] 21:25:37.767020 run osmo-msc_10.42.42.6(pid=29861): stdout: | (launched: 2022-12-12_21:25:36.068114) 21:25:37.822662 run osmo-msc_10.42.42.6(pid=29861): stderr: | 20221212212536622 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212212536622 DLGLOBAL DEBUG validating counter group 0x7f908099ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212212536622 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212212536622 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212212536622 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212212536623 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212212536624 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212212536625 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212212536625 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212212536625 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:25:37.878478 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29854): Terminating (SIGTERM) 21:25:37.924629 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29857): Terminating (SIGTERM) 21:25:37.971749 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29860): Terminating (SIGTERM) 21:25:38.019317 --- ParallelTerminationStrategy: PID 29854 died... 21:25:38.040448 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29854): Terminated: ok {rc=0} 21:25:38.092538 --- ParallelTerminationStrategy: PID 29857 died... 21:25:38.113393 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29857): Terminated: ok {rc=0} 21:25:38.164333 --- ParallelTerminationStrategy: PID 29860 died... 21:25:38.185386 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29860): Terminated: ok {rc=0} 21:25:38.280675 bus /sierra_3: Setting Powered False 21:25:39.390211 bus /sierra_3: Setting Powered False 21:25:40.533036 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2382 emergency:trx-lms emergency_preemptive_call.py ---------------------------------------------- 21:25:41.630606 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 21:25:41.643485 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 21:25:41.701946 tst emergency_preemptive_call.py: using LAC 31604 21:25:41.834481 tst emergency_preemptive_call.py: using RAC 239 21:25:41.975846 tst emergency_preemptive_call.py: using CellId 31604 21:25:42.119527 tst emergency_preemptive_call.py: using BVCI 31605 21:25:42.246441 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 21:25:42.258517 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 21:25:42.270456 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 21:25:42.282238 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 21:25:42.294862 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 21:25:42.307018 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 21:25:42.435049 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 21:25:42.565797 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 21:25:42.705726 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 21:25:42.840616 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:25:43.359136 run create_hlr_db(pid=29863): Launched 21:25:43.560041 bus /sierra_2: Setting Powered False 21:25:44.643138 run create_hlr_db(pid=29863): Terminated: ok {rc=0} 21:25:45.126446 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29865): Launched 21:25:45.530142 run osmo-hlr_10.42.42.2(pid=29866): Launched 21:25:45.788669 run osmo-stp_10.42.42.5: Starting osmo-stp 21:25:46.568167 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29868): Launched 21:25:46.932419 run osmo-stp_10.42.42.5(pid=29869): Launched 21:25:47.137810 tst emergency_preemptive_call.py: using MSISDN 7976 21:25:47.419485 run osmo-msc_10.42.42.6: Starting osmo-msc 21:25:48.044628 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29871): Launched 21:25:48.425301 run osmo-msc_10.42.42.6(pid=29872): Launched 21:25:48.817619 run osmo-stp_10.42.42.5(pid=29869): ERR: Terminated: ERROR {rc=1} [trial-2382↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29869)] 21:25:49.151479 run osmo-stp_10.42.42.5(pid=29869): stdout: | (launched: 2022-12-12_21:25:46.872186) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:25:49.413736 run osmo-stp_10.42.42.5(pid=29869): stderr: | 20221212212547219 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212547220 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212547220 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212547220 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212547221 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212547221 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212547221 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:25:49.554060 run osmo-stp_10.42.42.5(pid=29869): stdout: | (launched: 2022-12-12_21:25:46.872186) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:25:49.689193 run osmo-stp_10.42.42.5(pid=29869): stderr: | 20221212212547219 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212547220 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212547220 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212547220 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212547221 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212547221 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212547221 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:25:49.846378 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=29869): Process ended prematurely: osmo-stp_10.42.42.5(pid=29869) [trial-2382↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29869)] [trial-2382↪emergency:trx-lms↪emergency_preemptive_call.py:32] 21:25:49.856196 tst emergency_preemptive_call.py:32: Test FAILED (8.2 sec) 21:25:49.884461 run osmo-hlr_10.42.42.2(pid=29866): ERR: Terminated: ERROR {rc=237} [trial-2382↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29866)] 21:25:49.935311 run osmo-hlr_10.42.42.2(pid=29866): stdout: | (launched: 2022-12-12_21:25:45.468558) 21:25:49.991292 run osmo-hlr_10.42.42.2(pid=29866): stderr: | 20221212212545816 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212212545816 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212212545816 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212212545816 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212212545816 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212212545816 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212212545845 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/emergency:trx-lms/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212212545866 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212212545867 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212212545867 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:25:50.067441 run osmo-msc_10.42.42.6(pid=29872): ERR: Terminated: ERROR {rc=2} [trial-2382↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29872)] 21:25:50.120032 run osmo-msc_10.42.42.6(pid=29872): stdout: | (launched: 2022-12-12_21:25:48.357424) 21:25:50.173861 run osmo-msc_10.42.42.6(pid=29872): stderr: | 20221212212548902 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212212548903 DLGLOBAL DEBUG validating counter group 0x7f721a9c2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212212548903 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212212548903 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212212548903 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212212548903 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212212548917 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212212548918 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212212548918 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212212548918 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:25:50.229343 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29865): Terminating (SIGTERM) 21:25:50.272771 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29868): Terminating (SIGTERM) 21:25:50.317819 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29871): Terminating (SIGTERM) 21:25:50.363411 --- ParallelTerminationStrategy: PID 29865 died... 21:25:50.384588 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29865): Terminated: ok {rc=0} 21:25:50.435790 --- ParallelTerminationStrategy: PID 29868 died... 21:25:50.457826 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29868): Terminated: ok {rc=0} 21:25:50.506812 --- ParallelTerminationStrategy: PID 29871 died... 21:25:50.528112 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29871): Terminated: ok {rc=0} 21:25:50.620843 bus /sierra_9: Setting Powered False 21:25:51.741284 bus /sierra_9: Setting Powered False 21:25:52.873953 bus /sierra_8: Setting Powered False 21:25:53.981809 bus /sierra_8: Setting Powered False 21:25:55.135289 bus /sierra_3: Setting Powered False 21:25:56.271817 bus /sierra_3: Setting Powered False 21:25:57.409452 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 emergency:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 gprs:trx-lms --------------------------------------------------------------------- 21:25:58.726924 tst gprs:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:25:58.731782 tst gprs:trx-lms: Verifying 1 x bts (candidates: 11) 21:25:58.770613 tst gprs:trx-lms: Verifying 9 x ip_address (candidates: 9) 21:25:58.813755 tst gprs:trx-lms: Verifying 4 x modem (candidates: 12) 21:25:58.907617 tst gprs:trx-lms: Reserving 1 x bts (candidates: 11) 21:25:58.944678 tst gprs:trx-lms: Reserving 9 x ip_address (candidates: 9) 21:25:58.988438 tst gprs:trx-lms: Reserving 4 x modem (candidates: 12) 21:25:59.585486 tst gprs:trx-lms: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2382 gprs:trx-lms cs_paging_gprs_active.py ---------------------------------------------- 21:25:59.649895 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 21:25:59.662338 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 21:25:59.717296 tst cs_paging_gprs_active.py: using LAC 31605 21:25:59.853261 tst cs_paging_gprs_active.py: using RAC 240 21:26:00.004560 tst cs_paging_gprs_active.py: using CellId 31605 21:26:00.142109 tst cs_paging_gprs_active.py: using BVCI 31606 21:26:00.278724 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 21:26:00.290714 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 21:26:00.302462 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 21:26:00.315249 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 21:26:00.328031 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 21:26:00.340925 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 21:26:00.354933 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 21:26:00.366541 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 21:26:00.379944 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 21:26:00.507786 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 21:26:00.633271 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 21:26:00.894262 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:26:01.260098 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29877): Launched 21:26:01.567637 run iperf3-srv_10.42.42.10(pid=29878): Launched 21:26:01.707235 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 21:26:01.929031 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:26:02.262775 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29879): Launched 21:26:02.569653 run iperf3-srv_10.42.42.10(pid=29880): Launched 21:26:02.727281 tst cs_paging_gprs_active.py:38: start network... 21:26:02.956665 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:26:03.493729 run create_hlr_db(pid=29881): Launched 21:26:03.666745 bus /sierra_2: Setting Powered False 21:26:04.755909 run create_hlr_db(pid=29881): Terminated: ok {rc=0} 21:26:05.219003 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29883): Launched 21:26:05.602729 run osmo-hlr_10.42.42.2(pid=29884): Launched 21:26:05.867700 run osmo-stp_10.42.42.5: Starting osmo-stp 21:26:06.591771 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29886): Launched 21:26:06.967865 run osmo-stp_10.42.42.5(pid=29887): Launched 21:26:07.220674 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:26:07.889674 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29889): Launched 21:26:08.101900 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:26:08.384531 run patchelf(pid=29890): Launched 21:26:08.588309 run osmo-stp_10.42.42.5(pid=29887): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29887)] 21:26:08.728175 run osmo-stp_10.42.42.5(pid=29887): stdout: | (launched: 2022-12-12_21:26:06.906549) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:26:08.864521 run osmo-stp_10.42.42.5(pid=29887): stderr: | 20221212212607234 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212607234 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212607234 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212607235 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212607235 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212607235 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212607235 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:26:09.001724 run osmo-stp_10.42.42.5(pid=29887): stdout: | (launched: 2022-12-12_21:26:06.906549) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:26:09.139414 run osmo-stp_10.42.42.5(pid=29887): stderr: | 20221212212607234 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212607234 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212607234 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212607235 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212607235 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212607235 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212607235 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:26:09.300805 run patchelf(pid=29890): Terminating (SIGINT) 21:26:09.485987 run patchelf(pid=29890): Terminated: ok {rc=0} 21:26:09.618822 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=29887): Process ended prematurely: osmo-stp_10.42.42.5(pid=29887) [trial-2382↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29887)] [trial-2382↪gprs:trx-lms↪cs_paging_gprs_active.py:38] 21:26:09.629163 tst cs_paging_gprs_active.py:38: Test FAILED (10.0 sec) 21:26:09.657804 run osmo-hlr_10.42.42.2(pid=29884): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-lms↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29884)] 21:26:09.707887 run osmo-hlr_10.42.42.2(pid=29884): stdout: | (launched: 2022-12-12_21:26:05.538341) 21:26:09.760059 run osmo-hlr_10.42.42.2(pid=29884): stderr: | 20221212212605840 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212212605840 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212212605849 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212212605849 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212212605849 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212212605849 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212212605874 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-lms/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212212605890 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212212605890 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212212605890 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:26:09.812399 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29877): Terminating (SIGTERM) 21:26:09.854644 run iperf3-srv_10.42.42.10(pid=29878): Terminating (SIGTERM) 21:26:09.898297 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29879): Terminating (SIGTERM) 21:26:09.940916 run iperf3-srv_10.42.42.10(pid=29880): Terminating (SIGTERM) 21:26:09.983930 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29883): Terminating (SIGTERM) 21:26:10.026296 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29886): Terminating (SIGTERM) 21:26:10.070542 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29889): Terminating (SIGTERM) 21:26:10.114737 --- ParallelTerminationStrategy: PID 29877 died... 21:26:10.134823 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29877): Terminated: ok {rc=0} 21:26:10.182427 --- ParallelTerminationStrategy: PID 29878 died... 21:26:10.202462 run iperf3-srv_10.42.42.10(pid=29878): Terminated {rc=256} 21:26:10.248810 --- ParallelTerminationStrategy: PID 29879 died... 21:26:10.268720 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29879): Terminated: ok {rc=0} 21:26:10.315186 --- ParallelTerminationStrategy: PID 29880 died... 21:26:10.334847 run iperf3-srv_10.42.42.10(pid=29880): Terminated {rc=256} 21:26:10.380929 --- ParallelTerminationStrategy: PID 29883 died... 21:26:10.401116 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29883): Terminated: ok {rc=0} 21:26:10.447508 --- ParallelTerminationStrategy: PID 29886 died... 21:26:10.467232 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29886): Terminated: ok {rc=0} 21:26:10.513601 --- ParallelTerminationStrategy: PID 29889 died... 21:26:10.533694 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29889): Terminated: ok {rc=0} 21:26:10.622663 bus /gobi_0: Setting Powered False 21:26:11.745700 bus /gobi_0: Setting Powered False 21:26:12.872330 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:trx-lms iperf3.py ---------------------------------------------- 21:26:14.030510 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 21:26:14.043583 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 21:26:14.129901 tst iperf3.py: using LAC 31606 21:26:14.280307 tst iperf3.py: using RAC 241 21:26:14.424816 tst iperf3.py: using CellId 31606 21:26:14.580657 tst iperf3.py: using BVCI 31607 21:26:14.706267 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 21:26:14.718002 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 21:26:14.729636 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 21:26:14.741716 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 21:26:14.753083 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 21:26:14.764548 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 21:26:14.776617 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 21:26:14.789272 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 21:26:14.800690 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 21:26:14.925007 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 21:26:15.149185 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:26:15.493768 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29891): Launched 21:26:15.856528 run iperf3-srv_10.42.42.10(pid=29892): Launched 21:26:16.019682 tst iperf3.py:8: start network... 21:26:16.252321 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:26:16.766608 run create_hlr_db(pid=29893): Launched 21:26:16.948670 bus /gobi_6: Setting Powered False 21:26:18.026868 run create_hlr_db(pid=29893): Terminated: ok {rc=0} 21:26:18.499335 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29895): Launched 21:26:18.932301 run osmo-hlr_10.42.42.2(pid=29896): Launched 21:26:19.191354 run osmo-stp_10.42.42.5: Starting osmo-stp 21:26:19.918826 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29898): Launched 21:26:20.294245 run osmo-stp_10.42.42.5(pid=29899): Launched 21:26:20.511213 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:26:21.206933 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29901): Launched 21:26:21.430650 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:26:21.726426 run patchelf(pid=29902): Launched 21:26:21.931859 run osmo-stp_10.42.42.5(pid=29899): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29899)] 21:26:22.079104 run osmo-stp_10.42.42.5(pid=29899): stdout: | (launched: 2022-12-12_21:26:20.230531) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:26:22.228162 run osmo-stp_10.42.42.5(pid=29899): stderr: | 20221212212620544 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212620546 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212620546 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212620547 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212620548 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212620548 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212620548 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:26:22.377237 run osmo-stp_10.42.42.5(pid=29899): stdout: | (launched: 2022-12-12_21:26:20.230531) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:26:22.520115 run osmo-stp_10.42.42.5(pid=29899): stderr: | 20221212212620544 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212620546 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212620546 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212620547 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212620548 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212620548 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212620548 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:26:22.690979 run patchelf(pid=29902): Terminating (SIGINT) 21:26:22.886878 run patchelf(pid=29902): Terminated: ok {rc=0} 21:26:23.026842 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29899): Process ended prematurely: osmo-stp_10.42.42.5(pid=29899) [trial-2382↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29899)] [trial-2382↪gprs:trx-lms↪iperf3.py:8] 21:26:23.037479 tst iperf3.py:8: Test FAILED (9.0 sec) 21:26:23.069897 run osmo-hlr_10.42.42.2(pid=29896): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-lms↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29896)] 21:26:23.124905 run osmo-hlr_10.42.42.2(pid=29896): stdout: | (launched: 2022-12-12_21:26:18.869717) 21:26:23.181699 run osmo-hlr_10.42.42.2(pid=29896): stderr: | 20221212212619180 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212212619180 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212212619180 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212212619180 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212212619180 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212212619180 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212212619201 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-lms/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212212619218 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212212619218 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212212619218 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:26:23.239304 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29891): Terminating (SIGTERM) 21:26:23.285519 run iperf3-srv_10.42.42.10(pid=29892): Terminating (SIGTERM) 21:26:23.331343 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29895): Terminating (SIGTERM) 21:26:23.378218 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29898): Terminating (SIGTERM) 21:26:23.426083 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29901): Terminating (SIGTERM) 21:26:23.474315 --- ParallelTerminationStrategy: PID 29891 died... 21:26:23.496476 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29891): Terminated: ok {rc=0} 21:26:23.550218 --- ParallelTerminationStrategy: PID 29892 died... 21:26:23.571484 run iperf3-srv_10.42.42.10(pid=29892): Terminated {rc=256} 21:26:23.623388 --- ParallelTerminationStrategy: PID 29895 died... 21:26:23.644572 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29895): Terminated: ok {rc=0} 21:26:23.696920 --- ParallelTerminationStrategy: PID 29898 died... 21:26:23.718319 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29898): Terminated: ok {rc=0} 21:26:23.769868 --- ParallelTerminationStrategy: PID 29901 died... 21:26:23.791351 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29901): Terminated: ok {rc=0} 21:26:23.888303 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:trx-lms iperf3m4.py ---------------------------------------------- 21:26:25.052550 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 21:26:25.065804 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 21:26:25.123072 tst iperf3m4.py: using LAC 31607 21:26:25.269120 tst iperf3m4.py: using RAC 242 21:26:25.410789 tst iperf3m4.py: using CellId 31607 21:26:25.546709 tst iperf3m4.py: using BVCI 31608 21:26:25.677636 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 21:26:25.690497 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 21:26:25.702796 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 21:26:25.715861 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 21:26:25.729127 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 21:26:25.743284 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 21:26:25.756799 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 21:26:25.768861 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 21:26:25.782422 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 21:26:25.912345 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 21:26:26.049646 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 21:26:26.209585 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 21:26:26.340448 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 21:26:26.578111 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:26:26.928022 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29903): Launched 21:26:27.322868 run iperf3-srv_10.42.42.10(pid=29904): Launched 21:26:27.463706 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 21:26:27.688493 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:26:28.028699 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29905): Launched 21:26:28.336833 run iperf3-srv_10.42.42.10(pid=29906): Launched 21:26:28.479710 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 21:26:28.709259 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:26:29.052314 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29907): Launched 21:26:29.355013 run iperf3-srv_10.42.42.10(pid=29908): Launched 21:26:29.495612 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 21:26:29.726986 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:26:30.073615 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29909): Launched 21:26:30.375566 run iperf3-srv_10.42.42.10(pid=29910): Launched 21:26:30.514332 tst iperf3m4.py:8: start network... 21:26:30.742355 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:26:31.286850 run create_hlr_db(pid=29911): Launched 21:26:31.450817 bus /gobi_6: Setting Powered False 21:26:32.539372 run create_hlr_db(pid=29911): Terminated: ok {rc=0} 21:26:33.057265 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29913): Launched 21:26:33.473742 run osmo-hlr_10.42.42.2(pid=29914): Launched 21:26:33.708896 run osmo-stp_10.42.42.5: Starting osmo-stp 21:26:34.428248 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29916): Launched 21:26:34.781614 run osmo-stp_10.42.42.5(pid=29917): Launched 21:26:35.050623 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:26:35.743243 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29919): Launched 21:26:35.887047 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:26:36.181319 run patchelf(pid=29920): Launched 21:26:36.386058 run osmo-stp_10.42.42.5(pid=29917): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29917)] 21:26:36.533359 run osmo-stp_10.42.42.5(pid=29917): stdout: | (launched: 2022-12-12_21:26:34.717797) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:26:36.683657 run osmo-stp_10.42.42.5(pid=29917): stderr: | 20221212212635060 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212635060 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212635060 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212635061 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212635062 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212635062 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212635062 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:26:36.833497 run osmo-stp_10.42.42.5(pid=29917): stdout: | (launched: 2022-12-12_21:26:34.717797) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:26:36.977903 run osmo-stp_10.42.42.5(pid=29917): stderr: | 20221212212635060 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212635060 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212635060 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212635061 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212635062 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212635062 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212635062 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:26:37.147494 run patchelf(pid=29920): Terminating (SIGINT) 21:26:37.342807 run patchelf(pid=29920): Terminated: ok {rc=0} 21:26:37.485448 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29917): Process ended prematurely: osmo-stp_10.42.42.5(pid=29917) [trial-2382↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29917)] [trial-2382↪gprs:trx-lms↪iperf3m4.py:8] 21:26:37.497121 tst iperf3m4.py:8: Test FAILED (12.5 sec) 21:26:37.530974 run osmo-hlr_10.42.42.2(pid=29914): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-lms↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29914)] 21:26:37.586487 run osmo-hlr_10.42.42.2(pid=29914): stdout: | (launched: 2022-12-12_21:26:33.408736) 21:26:37.642683 run osmo-hlr_10.42.42.2(pid=29914): stderr: | 20221212212633726 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212212633726 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212212633726 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212212633726 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212212633726 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212212633726 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212212633752 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-lms/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212212633763 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212212633763 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212212633764 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:26:37.699962 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29903): Terminating (SIGTERM) 21:26:37.746490 run iperf3-srv_10.42.42.10(pid=29904): Terminating (SIGTERM) 21:26:37.793425 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29905): Terminating (SIGTERM) 21:26:37.839123 run iperf3-srv_10.42.42.10(pid=29906): Terminating (SIGTERM) 21:26:37.887124 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29907): Terminating (SIGTERM) 21:26:37.933265 run iperf3-srv_10.42.42.10(pid=29908): Terminating (SIGTERM) 21:26:37.978812 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29909): Terminating (SIGTERM) 21:26:38.024610 run iperf3-srv_10.42.42.10(pid=29910): Terminating (SIGTERM) 21:26:38.069944 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29913): Terminating (SIGTERM) 21:26:38.115588 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29916): Terminating (SIGTERM) 21:26:38.161636 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29919): Terminating (SIGTERM) 21:26:38.208078 --- ParallelTerminationStrategy: PID 29903 died... 21:26:38.229580 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29903): Terminated: ok {rc=0} 21:26:38.281925 --- ParallelTerminationStrategy: PID 29904 died... 21:26:38.303127 run iperf3-srv_10.42.42.10(pid=29904): Terminated {rc=256} 21:26:38.354447 --- ParallelTerminationStrategy: PID 29905 died... 21:26:38.375743 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29905): Terminated: ok {rc=0} 21:26:38.427597 --- ParallelTerminationStrategy: PID 29906 died... 21:26:38.448737 run iperf3-srv_10.42.42.10(pid=29906): Terminated {rc=256} 21:26:38.499851 --- ParallelTerminationStrategy: PID 29907 died... 21:26:38.521285 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29907): Terminated: ok {rc=0} 21:26:38.573651 --- ParallelTerminationStrategy: PID 29908 died... 21:26:38.594888 run iperf3-srv_10.42.42.10(pid=29908): Terminated {rc=256} 21:26:38.646037 --- ParallelTerminationStrategy: PID 29909 died... 21:26:38.667855 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29909): Terminated: ok {rc=0} 21:26:38.720100 --- ParallelTerminationStrategy: PID 29910 died... 21:26:38.741494 run iperf3-srv_10.42.42.10(pid=29910): Terminated {rc=256} 21:26:38.804906 --- ParallelTerminationStrategy: PID 29913 died... 21:26:38.826400 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29913): Terminated: ok {rc=0} 21:26:38.878657 --- ParallelTerminationStrategy: PID 29916 died... 21:26:38.899979 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29916): Terminated: ok {rc=0} 21:26:38.951732 --- ParallelTerminationStrategy: PID 29919 died... 21:26:38.973279 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29919): Terminated: ok {rc=0} 21:26:39.068522 bus /gobi_4: Setting Powered False 21:26:40.180776 bus /gobi_4: Setting Powered False 21:26:41.319312 bus /gobi_1: Setting Powered False 21:26:42.433824 bus /gobi_1: Setting Powered False 21:26:43.581688 bus /gobi_0: Setting Powered False 21:26:44.692120 bus /gobi_0: Setting Powered False 21:26:45.815690 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:trx-lms ping.py ---------------------------------------------- 21:26:46.941853 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 21:26:46.953628 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 21:26:47.006093 tst ping.py: using LAC 31608 21:26:47.171728 tst ping.py: using RAC 243 21:26:47.328909 tst ping.py: using CellId 31608 21:26:47.483712 tst ping.py: using BVCI 31609 21:26:47.633293 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 21:26:47.646602 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 21:26:47.659713 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 21:26:47.672010 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 21:26:47.686481 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 21:26:47.699214 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 21:26:47.712631 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 21:26:47.724666 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 21:26:47.845202 tst ping.py:19: start network... 21:26:48.059100 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:26:48.552151 run create_hlr_db(pid=29921): Launched 21:26:48.715715 bus /gobi_6: Setting Powered False 21:26:49.787265 run create_hlr_db(pid=29921): Terminated: ok {rc=0} 21:26:50.232037 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29923): Launched 21:26:50.562600 run osmo-hlr_10.42.42.2(pid=29924): Launched 21:26:50.807187 run osmo-stp_10.42.42.5: Starting osmo-stp 21:26:51.531818 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29926): Launched 21:26:51.861275 run osmo-stp_10.42.42.5(pid=29927): Launched 21:26:52.103417 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:26:52.792220 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29929): Launched 21:26:53.003625 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:26:53.292373 run patchelf(pid=29930): Launched 21:26:53.497989 run osmo-stp_10.42.42.5(pid=29927): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29927)] 21:26:53.632025 run osmo-stp_10.42.42.5(pid=29927): stdout: | (launched: 2022-12-12_21:26:51.801190) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:26:53.767465 run osmo-stp_10.42.42.5(pid=29927): stderr: | 20221212212652123 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212652123 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212652124 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212652124 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212652124 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212652129 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212652129 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:26:53.904241 run osmo-stp_10.42.42.5(pid=29927): stdout: | (launched: 2022-12-12_21:26:51.801190) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:26:54.033400 run osmo-stp_10.42.42.5(pid=29927): stderr: | 20221212212652123 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212652123 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212652124 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212652124 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212652124 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212652129 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212652129 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:26:54.186748 run patchelf(pid=29930): Terminating (SIGINT) 21:26:54.365114 run patchelf(pid=29930): Terminated: ok {rc=0} 21:26:54.493738 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=29927): Process ended prematurely: osmo-stp_10.42.42.5(pid=29927) [trial-2382↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29927)] [trial-2382↪gprs:trx-lms↪ping.py:22] 21:26:54.503079 tst ping.py:22: Test FAILED (7.6 sec) 21:26:54.531137 run osmo-hlr_10.42.42.2(pid=29924): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-lms↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29924)] 21:26:54.581290 run osmo-hlr_10.42.42.2(pid=29924): stdout: | (launched: 2022-12-12_21:26:50.502484) 21:26:54.633398 run osmo-hlr_10.42.42.2(pid=29924): stderr: | 20221212212650841 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212212650841 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212212650841 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212212650841 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212212650841 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212212650841 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212212650860 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-lms/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212212650868 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212212650868 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212212650868 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:26:54.685478 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29923): Terminating (SIGTERM) 21:26:54.727680 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29926): Terminating (SIGTERM) 21:26:54.771564 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29929): Terminating (SIGTERM) 21:26:54.816519 --- ParallelTerminationStrategy: PID 29923 died... 21:26:54.836759 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29923): Terminated: ok {rc=0} 21:26:54.884683 --- ParallelTerminationStrategy: PID 29926 died... 21:26:54.904316 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29926): Terminated: ok {rc=0} 21:26:54.950099 --- ParallelTerminationStrategy: PID 29929 died... 21:26:54.970180 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29929): Terminated: ok {rc=0} 21:26:55.059855 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:trx-lms ping_idle_ping.py ---------------------------------------------- 21:26:56.163478 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 21:26:56.177653 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 21:26:56.227638 tst ping_idle_ping.py: using LAC 31609 21:26:56.352348 tst ping_idle_ping.py: using RAC 244 21:26:56.500113 tst ping_idle_ping.py: using CellId 31609 21:26:56.633107 tst ping_idle_ping.py: using BVCI 31610 21:26:56.759518 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 21:26:56.771499 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 21:26:56.783287 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 21:26:56.796055 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 21:26:56.808881 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 21:26:56.821758 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 21:26:56.836554 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 21:26:56.850131 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 21:26:56.986789 tst ping_idle_ping.py:24: start network... 21:26:57.216792 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:26:57.750883 run create_hlr_db(pid=29931): Launched 21:26:57.920391 bus /gobi_6: Setting Powered False 21:26:58.991545 run create_hlr_db(pid=29931): Terminated: ok {rc=0} 21:26:59.471712 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29933): Launched 21:26:59.830396 run osmo-hlr_10.42.42.2(pid=29934): Launched 21:27:00.091929 run osmo-stp_10.42.42.5: Starting osmo-stp 21:27:00.757819 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29936): Launched 21:27:01.113457 run osmo-stp_10.42.42.5(pid=29937): Launched 21:27:01.359190 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:27:02.034702 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29939): Launched 21:27:02.166892 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:27:02.439641 run patchelf(pid=29940): Launched 21:27:02.664211 run osmo-stp_10.42.42.5(pid=29937): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29937)] 21:27:02.799308 run osmo-stp_10.42.42.5(pid=29937): stdout: | (launched: 2022-12-12_21:27:01.048732) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:27:02.935394 run osmo-stp_10.42.42.5(pid=29937): stderr: | 20221212212701375 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212701375 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212701376 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212701376 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212701376 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212701377 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212701377 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:27:03.071323 run osmo-stp_10.42.42.5(pid=29937): stdout: | (launched: 2022-12-12_21:27:01.048732) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:27:03.202191 run osmo-stp_10.42.42.5(pid=29937): stderr: | 20221212212701375 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212701375 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212701376 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212701376 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212701376 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212701377 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212701377 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:27:03.355289 run patchelf(pid=29940): Terminating (SIGINT) 21:27:03.532715 run patchelf(pid=29940): Terminated: ok {rc=0} 21:27:03.661852 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=29937): Process ended prematurely: osmo-stp_10.42.42.5(pid=29937) [trial-2382↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29937)] [trial-2382↪gprs:trx-lms↪ping_idle_ping.py:27] 21:27:03.672451 tst ping_idle_ping.py:27: Test FAILED (7.5 sec) 21:27:03.701434 run osmo-hlr_10.42.42.2(pid=29934): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-lms↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29934)] 21:27:03.752584 run osmo-hlr_10.42.42.2(pid=29934): stdout: | (launched: 2022-12-12_21:26:59.763547) 21:27:03.805416 run osmo-hlr_10.42.42.2(pid=29934): stderr: | 20221212212700039 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212212700039 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212212700039 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212212700039 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212212700039 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212212700039 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212212700057 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-lms/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212212700078 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212212700078 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212212700079 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:27:03.858289 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29933): Terminating (SIGTERM) 21:27:03.901159 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29936): Terminating (SIGTERM) 21:27:03.945338 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29939): Terminating (SIGTERM) 21:27:03.990097 --- ParallelTerminationStrategy: PID 29933 died... 21:27:04.010190 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29933): Terminated: ok {rc=0} 21:27:04.058551 --- ParallelTerminationStrategy: PID 29936 died... 21:27:04.078674 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29936): Terminated: ok {rc=0} 21:27:04.125279 --- ParallelTerminationStrategy: PID 29939 died... 21:27:04.145200 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29939): Terminated: ok {rc=0} 21:27:04.243739 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2382 gprs:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 gprs:trx-lms+mod-bts0-egprs --------------------------------------------------------------------- 21:27:05.619421 tst gprs:trx-lms+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:27:05.626863 tst gprs:trx-lms+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 21:27:05.665700 tst gprs:trx-lms+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 21:27:05.707797 tst gprs:trx-lms+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 21:27:05.800142 tst gprs:trx-lms+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 21:27:05.836099 tst gprs:trx-lms+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 21:27:05.877661 tst gprs:trx-lms+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 21:27:06.483612 tst gprs:trx-lms+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2382 gprs:trx-lms+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 21:27:06.565335 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:27:06.584808 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:27:06.648135 tst cs_paging_gprs_active.py: using LAC 31610 21:27:06.779576 tst cs_paging_gprs_active.py: using RAC 245 21:27:06.908392 tst cs_paging_gprs_active.py: using CellId 31610 21:27:07.038545 tst cs_paging_gprs_active.py: using BVCI 31611 21:27:07.168383 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:27:07.180483 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:27:07.191937 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:27:07.205279 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:27:07.217223 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:27:07.229251 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:27:07.241594 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:27:07.253709 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:27:07.266191 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:27:07.389160 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:27:07.522853 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 21:27:07.773311 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:27:08.136193 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29944): Launched 21:27:08.464510 run iperf3-srv_10.42.42.10(pid=29945): Launched 21:27:08.608120 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 21:27:08.843163 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:27:09.192551 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29946): Launched 21:27:09.494446 run iperf3-srv_10.42.42.10(pid=29947): Launched 21:27:09.639237 tst cs_paging_gprs_active.py:38: start network... 21:27:09.875320 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:27:10.417779 run create_hlr_db(pid=29948): Launched 21:27:10.602329 bus /gobi_6: Setting Powered False 21:27:11.684938 run create_hlr_db(pid=29948): Terminated: ok {rc=0} 21:27:12.151151 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29950): Launched 21:27:12.493720 run osmo-hlr_10.42.42.2(pid=29951): Launched 21:27:12.755010 run osmo-stp_10.42.42.5: Starting osmo-stp 21:27:13.421099 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29953): Launched 21:27:13.813849 run osmo-stp_10.42.42.5(pid=29954): Launched 21:27:14.080459 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:27:14.648585 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29956): Launched 21:27:14.795967 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:27:15.092435 run patchelf(pid=29957): Launched 21:27:15.296690 run osmo-stp_10.42.42.5(pid=29954): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29954)] 21:27:15.441958 run osmo-stp_10.42.42.5(pid=29954): stdout: | (launched: 2022-12-12_21:27:13.750490) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:27:15.589715 run osmo-stp_10.42.42.5(pid=29954): stderr: | 20221212212713935 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212713936 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212713936 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212713936 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212713937 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212713937 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212713937 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:27:15.737717 run osmo-stp_10.42.42.5(pid=29954): stdout: | (launched: 2022-12-12_21:27:13.750490) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:27:15.911951 run osmo-stp_10.42.42.5(pid=29954): stderr: | 20221212212713935 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212713936 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212713936 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212713936 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212713937 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212713937 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212713937 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:27:16.102526 run patchelf(pid=29957): Terminating (SIGINT) 21:27:16.308716 run patchelf(pid=29957): Terminated: ok {rc=0} 21:27:16.449067 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=29954): Process ended prematurely: osmo-stp_10.42.42.5(pid=29954) [trial-2382↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29954)] [trial-2382↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 21:27:16.459899 tst cs_paging_gprs_active.py:38: Test FAILED (10.0 sec) 21:27:16.491294 run osmo-hlr_10.42.42.2(pid=29951): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29951)] 21:27:16.544742 run osmo-hlr_10.42.42.2(pid=29951): stdout: | (launched: 2022-12-12_21:27:12.433275) 21:27:16.599972 run osmo-hlr_10.42.42.2(pid=29951): stderr: | 20221212212712776 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212212712776 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212212712776 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212212712785 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212212712785 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212212712785 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212212712802 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-lms+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212212712815 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212212712815 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212212712815 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:27:16.655372 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29944): Terminating (SIGTERM) 21:27:16.701282 run iperf3-srv_10.42.42.10(pid=29945): Terminating (SIGTERM) 21:27:16.748138 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29946): Terminating (SIGTERM) 21:27:16.793946 run iperf3-srv_10.42.42.10(pid=29947): Terminating (SIGTERM) 21:27:16.840851 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29950): Terminating (SIGTERM) 21:27:16.887160 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29953): Terminating (SIGTERM) 21:27:16.934730 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29956): Terminating (SIGTERM) 21:27:16.982684 --- ParallelTerminationStrategy: PID 29944 died... 21:27:17.004181 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29944): Terminated: ok {rc=0} 21:27:17.057208 --- ParallelTerminationStrategy: PID 29945 died... 21:27:17.078365 run iperf3-srv_10.42.42.10(pid=29945): Terminated {rc=256} 21:27:17.129995 --- ParallelTerminationStrategy: PID 29946 died... 21:27:17.151817 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29946): Terminated: ok {rc=0} 21:27:17.203702 --- ParallelTerminationStrategy: PID 29947 died... 21:27:17.225132 run iperf3-srv_10.42.42.10(pid=29947): Terminated {rc=256} 21:27:17.276466 --- ParallelTerminationStrategy: PID 29950 died... 21:27:17.298106 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29950): Terminated: ok {rc=0} 21:27:17.349937 --- ParallelTerminationStrategy: PID 29953 died... 21:27:17.371382 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29953): Terminated: ok {rc=0} 21:27:17.423113 --- ParallelTerminationStrategy: PID 29956 died... 21:27:17.444468 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29956): Terminated: ok {rc=0} 21:27:17.553258 bus /gobi_0: Setting Powered False 21:27:18.662741 bus /gobi_0: Setting Powered False 21:27:19.812256 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:trx-lms+mod-bts0-egprs iperf3.py ---------------------------------------------- 21:27:21.011311 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:27:21.024706 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:27:21.085247 tst iperf3.py: using LAC 31611 21:27:21.222290 tst iperf3.py: using RAC 246 21:27:21.357216 tst iperf3.py: using CellId 31611 21:27:21.498877 tst iperf3.py: using BVCI 31612 21:27:21.629284 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:27:21.641995 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:27:21.654383 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:27:21.667490 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:27:21.682061 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:27:21.694417 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:27:21.707675 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:27:21.720793 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:27:21.734452 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:27:21.866809 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 21:27:22.126657 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:27:22.474295 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29958): Launched 21:27:22.792246 run iperf3-srv_10.42.42.10(pid=29959): Launched 21:27:22.930506 tst iperf3.py:8: start network... 21:27:23.163838 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:27:23.699507 run create_hlr_db(pid=29960): Launched 21:27:23.867904 bus /gobi_6: Setting Powered False 21:27:24.934026 run create_hlr_db(pid=29960): Terminated: ok {rc=0} 21:27:25.410869 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29962): Launched 21:27:25.754690 run osmo-hlr_10.42.42.2(pid=29963): Launched 21:27:25.983234 run osmo-stp_10.42.42.5: Starting osmo-stp 21:27:26.667797 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29965): Launched 21:27:27.011417 run osmo-stp_10.42.42.5(pid=29966): Launched 21:27:27.240411 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:27:27.861680 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29968): Launched 21:27:27.995944 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:27:28.293745 run patchelf(pid=29969): Launched 21:27:28.487910 run osmo-stp_10.42.42.5(pid=29966): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29966)] 21:27:28.635939 run osmo-stp_10.42.42.5(pid=29966): stdout: | (launched: 2022-12-12_21:27:26.947144) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:27:28.784611 run osmo-stp_10.42.42.5(pid=29966): stderr: | 20221212212727196 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212727197 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212727197 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212727197 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212727198 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212727198 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212727198 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:27:28.934309 run osmo-stp_10.42.42.5(pid=29966): stdout: | (launched: 2022-12-12_21:27:26.947144) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:27:29.078732 run osmo-stp_10.42.42.5(pid=29966): stderr: | 20221212212727196 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212727197 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212727197 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212727197 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212727198 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212727198 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212727198 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:27:29.248819 run patchelf(pid=29969): Terminating (SIGINT) 21:27:29.446210 run patchelf(pid=29969): Terminated: ok {rc=0} 21:27:29.588027 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29966): Process ended prematurely: osmo-stp_10.42.42.5(pid=29966) [trial-2382↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29966)] [trial-2382↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8] 21:27:29.599602 tst iperf3.py:8: Test FAILED (8.6 sec) 21:27:29.634544 run osmo-hlr_10.42.42.2(pid=29963): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29963)] 21:27:29.689391 run osmo-hlr_10.42.42.2(pid=29963): stdout: | (launched: 2022-12-12_21:27:25.690407) 21:27:29.745875 run osmo-hlr_10.42.42.2(pid=29963): stderr: | 20221212212725980 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212212725980 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212212725980 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212212725980 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212212725980 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212212725980 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212212726010 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-lms+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212212726022 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212212726023 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212212726023 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:27:29.803748 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29958): Terminating (SIGTERM) 21:27:29.849744 run iperf3-srv_10.42.42.10(pid=29959): Terminating (SIGTERM) 21:27:29.898066 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29962): Terminating (SIGTERM) 21:27:29.944743 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29965): Terminating (SIGTERM) 21:27:29.992072 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29968): Terminating (SIGTERM) 21:27:30.039508 --- ParallelTerminationStrategy: PID 29958 died... 21:27:30.061107 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29958): Terminated: ok {rc=0} 21:27:30.112528 --- ParallelTerminationStrategy: PID 29959 died... 21:27:30.133912 run iperf3-srv_10.42.42.10(pid=29959): Terminated {rc=256} 21:27:30.185375 --- ParallelTerminationStrategy: PID 29962 died... 21:27:30.207792 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29962): Terminated: ok {rc=0} 21:27:30.258672 --- ParallelTerminationStrategy: PID 29965 died... 21:27:30.279987 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29965): Terminated: ok {rc=0} 21:27:30.330511 --- ParallelTerminationStrategy: PID 29968 died... 21:27:30.351895 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29968): Terminated: ok {rc=0} 21:27:30.445463 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:trx-lms+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 21:27:31.623919 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:27:31.639286 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:27:31.701901 tst iperf3m4.py: using LAC 31612 21:27:31.862056 tst iperf3m4.py: using RAC 247 21:27:32.051604 tst iperf3m4.py: using CellId 31612 21:27:32.199282 tst iperf3m4.py: using BVCI 31613 21:27:32.349047 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:27:32.361962 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:27:32.374602 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:27:32.387781 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:27:32.400910 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:27:32.415448 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:27:32.428080 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:27:32.441385 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:27:32.456099 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:27:32.606694 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:27:32.758497 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:27:32.883877 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:27:33.012658 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 21:27:33.248693 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:27:33.598585 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29970): Launched 21:27:33.910105 run iperf3-srv_10.42.42.10(pid=29971): Launched 21:27:34.053664 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 21:27:34.290319 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:27:34.640207 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29972): Launched 21:27:34.975904 run iperf3-srv_10.42.42.10(pid=29973): Launched 21:27:35.120154 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 21:27:35.356110 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:27:35.707167 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29974): Launched 21:27:36.013306 run iperf3-srv_10.42.42.10(pid=29975): Launched 21:27:36.139771 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 21:27:36.362677 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:27:36.696582 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29976): Launched 21:27:36.995648 run iperf3-srv_10.42.42.10(pid=29977): Launched 21:27:37.132393 tst iperf3m4.py:8: start network... 21:27:37.356484 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:27:37.869665 run create_hlr_db(pid=29978): Launched 21:27:38.037626 bus /gobi_6: Setting Powered False 21:27:39.108337 run create_hlr_db(pid=29978): Terminated: ok {rc=0} 21:27:39.573105 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29980): Launched 21:27:39.916016 run osmo-hlr_10.42.42.2(pid=29981): Launched 21:27:40.168130 run osmo-stp_10.42.42.5: Starting osmo-stp 21:27:40.905316 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29983): Launched 21:27:41.266050 run osmo-stp_10.42.42.5(pid=29984): Launched 21:27:41.428302 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:27:42.269806 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29986): Launched 21:27:42.404805 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:27:42.676833 run patchelf(pid=29987): Launched 21:27:42.950214 run osmo-stp_10.42.42.5(pid=29984): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29984)] 21:27:43.108765 run osmo-stp_10.42.42.5(pid=29984): stdout: | (launched: 2022-12-12_21:27:41.201803) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:27:43.276567 run osmo-stp_10.42.42.5(pid=29984): stderr: | 20221212212741561 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212741561 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212741561 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212741562 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212741562 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212741562 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212741562 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:27:43.446457 run osmo-stp_10.42.42.5(pid=29984): stdout: | (launched: 2022-12-12_21:27:41.201803) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:27:43.614300 run osmo-stp_10.42.42.5(pid=29984): stderr: | 20221212212741561 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212741561 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212741561 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212741562 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212741562 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212741562 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212741562 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:27:43.813482 run patchelf(pid=29987): Terminating (SIGINT) 21:27:44.041716 run patchelf(pid=29987): Terminated: ok {rc=0} 21:27:44.210197 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29984): Process ended prematurely: osmo-stp_10.42.42.5(pid=29984) [trial-2382↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29984)] [trial-2382↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8] 21:27:44.223655 tst iperf3m4.py:8: Test FAILED (12.6 sec) 21:27:44.261378 run osmo-hlr_10.42.42.2(pid=29981): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29981)] 21:27:44.323304 run osmo-hlr_10.42.42.2(pid=29981): stdout: | (launched: 2022-12-12_21:27:39.853152) 21:27:44.388886 run osmo-hlr_10.42.42.2(pid=29981): stderr: | 20221212212740196 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212212740196 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212212740196 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212212740196 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212212740196 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212212740196 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212212740223 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-lms+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212212740239 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212212740239 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212212740240 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:27:44.455088 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29970): Terminating (SIGTERM) 21:27:44.507219 run iperf3-srv_10.42.42.10(pid=29971): Terminating (SIGTERM) 21:27:44.558033 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29972): Terminating (SIGTERM) 21:27:44.609962 run iperf3-srv_10.42.42.10(pid=29973): Terminating (SIGTERM) 21:27:44.662277 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29974): Terminating (SIGTERM) 21:27:44.714208 run iperf3-srv_10.42.42.10(pid=29975): Terminating (SIGTERM) 21:27:44.761990 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29976): Terminating (SIGTERM) 21:27:44.806617 run iperf3-srv_10.42.42.10(pid=29977): Terminating (SIGTERM) 21:27:44.849480 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29980): Terminating (SIGTERM) 21:27:44.893455 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29983): Terminating (SIGTERM) 21:27:44.941280 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29986): Terminating (SIGTERM) 21:27:44.991740 --- ParallelTerminationStrategy: PID 29970 died... 21:27:45.016065 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29970): Terminated: ok {rc=0} 21:27:45.072094 --- ParallelTerminationStrategy: PID 29971 died... 21:27:45.095336 run iperf3-srv_10.42.42.10(pid=29971): Terminated {rc=256} 21:27:45.150642 --- ParallelTerminationStrategy: PID 29972 died... 21:27:45.174227 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29972): Terminated: ok {rc=0} 21:27:45.234252 --- ParallelTerminationStrategy: PID 29973 died... 21:27:45.257749 run iperf3-srv_10.42.42.10(pid=29973): Terminated {rc=256} 21:27:45.313307 --- ParallelTerminationStrategy: PID 29974 died... 21:27:45.336811 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29974): Terminated: ok {rc=0} 21:27:45.391364 --- ParallelTerminationStrategy: PID 29975 died... 21:27:45.414042 run iperf3-srv_10.42.42.10(pid=29975): Terminated {rc=256} 21:27:45.466812 --- ParallelTerminationStrategy: PID 29976 died... 21:27:45.489088 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29976): Terminated: ok {rc=0} 21:27:45.542560 --- ParallelTerminationStrategy: PID 29977 died... 21:27:45.565038 run iperf3-srv_10.42.42.10(pid=29977): Terminated {rc=256} 21:27:45.622569 --- ParallelTerminationStrategy: PID 29980 died... 21:27:45.646961 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29980): Terminated: ok {rc=0} 21:27:45.707335 --- ParallelTerminationStrategy: PID 29983 died... 21:27:45.731078 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29983): Terminated: ok {rc=0} 21:27:45.789152 --- ParallelTerminationStrategy: PID 29986 died... 21:27:45.811782 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29986): Terminated: ok {rc=0} 21:27:45.915671 bus /gobi_4: Setting Powered False 21:27:47.042180 bus /gobi_4: Setting Powered False 21:27:48.172247 bus /gobi_1: Setting Powered False 21:27:49.281484 bus /gobi_1: Setting Powered False 21:27:50.422469 bus /gobi_0: Setting Powered False 21:27:51.537799 bus /gobi_0: Setting Powered False 21:27:52.682843 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:trx-lms+mod-bts0-egprs ping.py ---------------------------------------------- 21:27:53.805389 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:27:53.818720 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:27:53.873775 tst ping.py: using LAC 31613 21:27:54.002943 tst ping.py: using RAC 248 21:27:54.125088 tst ping.py: using CellId 31613 21:27:54.277963 tst ping.py: using BVCI 31614 21:27:54.397224 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:27:54.408458 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:27:54.420378 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:27:54.432634 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:27:54.444500 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:27:54.456418 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:27:54.468254 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:27:54.480351 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:27:54.601314 tst ping.py:19: start network... 21:27:54.812888 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:27:55.301717 run create_hlr_db(pid=29988): Launched 21:27:55.431294 bus /gobi_6: Setting Powered False 21:27:56.502780 run create_hlr_db(pid=29988): Terminated: ok {rc=0} 21:27:57.025564 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29990): Launched 21:27:57.434164 run osmo-hlr_10.42.42.2(pid=29991): Launched 21:27:57.619967 run osmo-stp_10.42.42.5: Starting osmo-stp 21:27:58.295603 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29993): Launched 21:27:58.698415 run osmo-stp_10.42.42.5(pid=29994): Launched 21:27:58.866867 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:27:59.601918 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29996): Launched 21:27:59.737606 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:28:00.011461 run patchelf(pid=29997): Launched 21:28:00.262189 run osmo-stp_10.42.42.5(pid=29994): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29994)] 21:28:00.437328 run osmo-stp_10.42.42.5(pid=29994): stdout: | (launched: 2022-12-12_21:27:58.622387) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:28:00.616457 run osmo-stp_10.42.42.5(pid=29994): stderr: | 20221212212758909 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212758909 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212758909 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212758910 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212758910 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212758910 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212758910 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:28:00.774925 run osmo-stp_10.42.42.5(pid=29994): stdout: | (launched: 2022-12-12_21:27:58.622387) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:28:00.924403 run osmo-stp_10.42.42.5(pid=29994): stderr: | 20221212212758909 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212758909 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212758909 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212758910 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212758910 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212758910 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212758910 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:28:01.078787 run patchelf(pid=29997): Terminating (SIGINT) 21:28:01.257735 run patchelf(pid=29997): Terminated: ok {rc=0} 21:28:01.386935 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=29994): Process ended prematurely: osmo-stp_10.42.42.5(pid=29994) [trial-2382↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29994)] [trial-2382↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22] 21:28:01.396118 tst ping.py:22: Test FAILED (7.6 sec) 21:28:01.424060 run osmo-hlr_10.42.42.2(pid=29991): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-lms+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29991)] 21:28:01.474062 run osmo-hlr_10.42.42.2(pid=29991): stdout: | (launched: 2022-12-12_21:27:57.360802) 21:28:01.526551 run osmo-hlr_10.42.42.2(pid=29991): stderr: | 20221212212757587 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212212757587 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212212757587 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212212757587 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212212757587 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212212757587 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212212757603 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-lms+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212212757614 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212212757614 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212212757616 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:28:01.580106 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29990): Terminating (SIGTERM) 21:28:01.622706 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29993): Terminating (SIGTERM) 21:28:01.668206 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29996): Terminating (SIGTERM) 21:28:01.712108 --- ParallelTerminationStrategy: PID 29990 died... 21:28:01.732058 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29990): Terminated: ok {rc=0} 21:28:01.778235 --- ParallelTerminationStrategy: PID 29993 died... 21:28:01.798184 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29993): Terminated: ok {rc=0} 21:28:01.844867 --- ParallelTerminationStrategy: PID 29996 died... 21:28:01.864872 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29996): Terminated: ok {rc=0} 21:28:01.953540 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:trx-lms+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 21:28:03.047101 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:28:03.062514 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:28:03.120155 tst ping_idle_ping.py: using LAC 31614 21:28:03.250236 tst ping_idle_ping.py: using RAC 249 21:28:03.382416 tst ping_idle_ping.py: using CellId 31614 21:28:03.512655 tst ping_idle_ping.py: using BVCI 31615 21:28:03.637361 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:28:03.649509 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:28:03.660914 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:28:03.672781 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:28:03.683792 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:28:03.694817 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:28:03.706051 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:28:03.716887 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:28:03.844417 tst ping_idle_ping.py:24: start network... 21:28:04.063241 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:28:04.555278 run create_hlr_db(pid=29998): Launched 21:28:04.686668 bus /gobi_6: Setting Powered False 21:28:05.751110 run create_hlr_db(pid=29998): Terminated: ok {rc=0} 21:28:06.259169 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30000): Launched 21:28:06.645633 run osmo-hlr_10.42.42.2(pid=30001): Launched 21:28:06.871169 run osmo-stp_10.42.42.5: Starting osmo-stp 21:28:07.657582 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30003): Launched 21:28:08.066671 run osmo-stp_10.42.42.5(pid=30004): Launched 21:28:08.266619 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:28:08.860591 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30006): Launched 21:28:08.983905 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:28:09.251652 run patchelf(pid=30007): Launched 21:28:09.484224 run osmo-stp_10.42.42.5(pid=30004): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30004)] 21:28:09.657346 run osmo-stp_10.42.42.5(pid=30004): stdout: | (launched: 2022-12-12_21:28:07.994546) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:28:09.825945 run osmo-stp_10.42.42.5(pid=30004): stderr: | 20221212212808198 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212808198 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212808198 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212808199 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212808200 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212808200 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212808200 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:28:09.996624 run osmo-stp_10.42.42.5(pid=30004): stdout: | (launched: 2022-12-12_21:28:07.994546) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:28:10.155157 run osmo-stp_10.42.42.5(pid=30004): stderr: | 20221212212808198 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212808198 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212808198 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212808199 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212808200 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212808200 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212808200 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:28:10.332932 run patchelf(pid=30007): Terminating (SIGINT) 21:28:10.534925 run patchelf(pid=30007): Terminated: ok {rc=0} 21:28:10.682597 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=30004): Process ended prematurely: osmo-stp_10.42.42.5(pid=30004) [trial-2382↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30004)] [trial-2382↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27] 21:28:10.693431 tst ping_idle_ping.py:27: Test FAILED (7.6 sec) 21:28:10.728502 run osmo-hlr_10.42.42.2(pid=30001): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30001)] 21:28:10.790519 run osmo-hlr_10.42.42.2(pid=30001): stdout: | (launched: 2022-12-12_21:28:06.575603) 21:28:10.850308 run osmo-hlr_10.42.42.2(pid=30001): stderr: | 20221212212806879 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212212806879 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212212806879 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212212806879 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212212806879 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212212806879 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212212806892 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-lms+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212212806903 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212212806903 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212212806903 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:28:10.913761 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30000): Terminating (SIGTERM) 21:28:10.962184 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30003): Terminating (SIGTERM) 21:28:11.011608 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30006): Terminating (SIGTERM) 21:28:11.061386 --- ParallelTerminationStrategy: PID 30000 died... 21:28:11.082762 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30000): Terminated: ok {rc=0} 21:28:11.136346 --- ParallelTerminationStrategy: PID 30003 died... 21:28:11.157991 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30003): Terminated: ok {rc=0} 21:28:11.210936 --- ParallelTerminationStrategy: PID 30006 died... 21:28:11.232587 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30006): Terminated: ok {rc=0} 21:28:11.327544 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2382 gprs:trx-lms+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 gprs:trx-lms+mod-bts0-dynts-ipa --------------------------------------------------------------------- 21:28:12.638182 tst gprs:trx-lms+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:28:12.644816 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 21:28:12.680736 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 21:28:12.721589 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 21:28:12.810063 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 21:28:12.848371 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 21:28:12.896333 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 21:28:13.511785 tst gprs:trx-lms+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2382 gprs:trx-lms+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 21:28:13.566485 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:28:13.578579 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 21:28:13.648267 tst cs_paging_gprs_active.py: using LAC 31615 21:28:13.801059 tst cs_paging_gprs_active.py: using RAC 250 21:28:13.946584 tst cs_paging_gprs_active.py: using CellId 31615 21:28:14.108300 tst cs_paging_gprs_active.py: using BVCI 31616 21:28:14.268802 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:28:14.281206 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:28:14.293219 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:28:14.307144 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:28:14.320221 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:28:14.331933 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:28:14.344423 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:28:14.356571 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:28:14.368794 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:28:14.495663 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:28:14.623027 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 21:28:14.859863 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:28:15.208330 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30011): Launched 21:28:15.524263 run iperf3-srv_10.42.42.10(pid=30012): Launched 21:28:15.735194 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 21:28:16.002517 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:28:16.367771 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30013): Launched 21:28:16.681721 run iperf3-srv_10.42.42.10(pid=30014): Launched 21:28:16.872095 tst cs_paging_gprs_active.py:38: start network... 21:28:17.136596 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:28:17.761692 run create_hlr_db(pid=30015): Launched 21:28:17.956190 bus /gobi_6: Setting Powered False 21:28:19.027512 run create_hlr_db(pid=30015): Terminated: ok {rc=0} 21:28:19.516931 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30017): Launched 21:28:19.932512 run osmo-hlr_10.42.42.2(pid=30018): Launched 21:28:20.204799 run osmo-stp_10.42.42.5: Starting osmo-stp 21:28:20.771378 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30020): Launched 21:28:21.106432 run osmo-stp_10.42.42.5(pid=30021): Launched 21:28:21.287372 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:28:22.014719 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30023): Launched 21:28:22.177699 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:28:22.521649 run patchelf(pid=30024): Launched 21:28:22.716806 run osmo-stp_10.42.42.5(pid=30021): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30021)] 21:28:22.861943 run osmo-stp_10.42.42.5(pid=30021): stdout: | (launched: 2022-12-12_21:28:21.042084) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:28:23.001308 run osmo-stp_10.42.42.5(pid=30021): stderr: | 20221212212821274 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212821274 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212821274 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212821275 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212821275 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212821275 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212821275 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:28:23.143527 run osmo-stp_10.42.42.5(pid=30021): stdout: | (launched: 2022-12-12_21:28:21.042084) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:28:23.276829 run osmo-stp_10.42.42.5(pid=30021): stderr: | 20221212212821274 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212821274 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212821274 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212821275 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212821275 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212821275 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212821275 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:28:23.434609 run patchelf(pid=30024): Terminating (SIGINT) 21:28:23.617169 run patchelf(pid=30024): Terminated: ok {rc=0} 21:28:23.749482 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=30021): Process ended prematurely: osmo-stp_10.42.42.5(pid=30021) [trial-2382↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30021)] [trial-2382↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 21:28:23.759546 tst cs_paging_gprs_active.py:38: Test FAILED (10.2 sec) 21:28:23.788348 run osmo-hlr_10.42.42.2(pid=30018): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30018)] 21:28:23.838528 run osmo-hlr_10.42.42.2(pid=30018): stdout: | (launched: 2022-12-12_21:28:19.856038) 21:28:23.890291 run osmo-hlr_10.42.42.2(pid=30018): stderr: | 20221212212820068 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212212820068 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212212820068 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212212820068 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212212820068 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212212820068 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212212820092 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-lms+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212212820109 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212212820109 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212212820109 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:28:23.942660 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30011): Terminating (SIGTERM) 21:28:23.984324 run iperf3-srv_10.42.42.10(pid=30012): Terminating (SIGTERM) 21:28:24.026015 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30013): Terminating (SIGTERM) 21:28:24.067638 run iperf3-srv_10.42.42.10(pid=30014): Terminating (SIGTERM) 21:28:24.109602 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30017): Terminating (SIGTERM) 21:28:24.152014 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30020): Terminating (SIGTERM) 21:28:24.194444 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30023): Terminating (SIGTERM) 21:28:24.236708 --- ParallelTerminationStrategy: PID 30011 died... 21:28:24.256313 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30011): Terminated: ok {rc=0} 21:28:24.302973 --- ParallelTerminationStrategy: PID 30012 died... 21:28:24.322601 run iperf3-srv_10.42.42.10(pid=30012): Terminated {rc=256} 21:28:24.368550 --- ParallelTerminationStrategy: PID 30013 died... 21:28:24.388345 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30013): Terminated: ok {rc=0} 21:28:24.434720 --- ParallelTerminationStrategy: PID 30014 died... 21:28:24.454467 run iperf3-srv_10.42.42.10(pid=30014): Terminated {rc=256} 21:28:24.500164 --- ParallelTerminationStrategy: PID 30017 died... 21:28:24.519876 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30017): Terminated: ok {rc=0} 21:28:24.565651 --- ParallelTerminationStrategy: PID 30020 died... 21:28:24.585221 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30020): Terminated: ok {rc=0} 21:28:24.631049 --- ParallelTerminationStrategy: PID 30023 died... 21:28:24.650700 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30023): Terminated: ok {rc=0} 21:28:24.743802 bus /gobi_0: Setting Powered False 21:28:25.864066 bus /gobi_0: Setting Powered False 21:28:27.006589 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:trx-lms+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 21:28:28.168324 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:28:28.181730 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 21:28:28.258622 tst iperf3.py: using LAC 31616 21:28:28.394168 tst iperf3.py: using RAC 251 21:28:28.524809 tst iperf3.py: using CellId 31616 21:28:28.654052 tst iperf3.py: using BVCI 31617 21:28:28.771748 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:28:28.783094 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:28:28.794199 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:28:28.805316 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:28:28.816440 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:28:28.827532 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:28:28.838705 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:28:28.849728 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:28:28.861597 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:28:28.978911 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 21:28:29.194759 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:28:29.517291 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30025): Launched 21:28:29.800230 run iperf3-srv_10.42.42.10(pid=30026): Launched 21:28:29.926208 tst iperf3.py:8: start network... 21:28:30.141262 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:28:30.641624 run create_hlr_db(pid=30027): Launched 21:28:30.850492 bus /gobi_6: Setting Powered False 21:28:31.932342 run create_hlr_db(pid=30027): Terminated: ok {rc=0} 21:28:32.533088 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30029): Launched 21:28:32.977970 run osmo-hlr_10.42.42.2(pid=30030): Launched 21:28:33.163975 run osmo-stp_10.42.42.5: Starting osmo-stp 21:28:33.760721 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30032): Launched 21:28:34.090105 run osmo-stp_10.42.42.5(pid=30033): Launched 21:28:34.247189 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:28:34.961043 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30035): Launched 21:28:35.126580 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:28:35.451416 run patchelf(pid=30036): Launched 21:28:35.677827 run osmo-stp_10.42.42.5(pid=30033): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30033)] 21:28:35.824659 run osmo-stp_10.42.42.5(pid=30033): stdout: | (launched: 2022-12-12_21:28:34.026530) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:28:35.988174 run osmo-stp_10.42.42.5(pid=30033): stderr: | 20221212212834290 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212834290 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212834291 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212834291 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212834291 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212834291 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212834292 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:28:36.154386 run osmo-stp_10.42.42.5(pid=30033): stdout: | (launched: 2022-12-12_21:28:34.026530) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:28:36.311517 run osmo-stp_10.42.42.5(pid=30033): stderr: | 20221212212834290 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212834290 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212834291 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212834291 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212834291 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212834291 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212834292 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:28:36.506644 run patchelf(pid=30036): Terminating (SIGINT) 21:28:36.734224 run patchelf(pid=30036): Terminated: ok {rc=0} 21:28:36.897220 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30033): Process ended prematurely: osmo-stp_10.42.42.5(pid=30033) [trial-2382↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30033)] [trial-2382↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8] 21:28:36.909439 tst iperf3.py:8: Test FAILED (8.8 sec) 21:28:36.945225 run osmo-hlr_10.42.42.2(pid=30030): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30030)] 21:28:37.007559 run osmo-hlr_10.42.42.2(pid=30030): stdout: | (launched: 2022-12-12_21:28:32.903632) 21:28:37.069630 run osmo-hlr_10.42.42.2(pid=30030): stderr: | 20221212212833110 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212212833110 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212212833110 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212212833110 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212212833110 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212212833110 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212212833122 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212212833134 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212212833134 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212212833134 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:28:37.134236 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30025): Terminating (SIGTERM) 21:28:37.185200 run iperf3-srv_10.42.42.10(pid=30026): Terminating (SIGTERM) 21:28:37.238659 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30029): Terminating (SIGTERM) 21:28:37.291086 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30032): Terminating (SIGTERM) 21:28:37.341849 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30035): Terminating (SIGTERM) 21:28:37.393427 --- ParallelTerminationStrategy: PID 30025 died... 21:28:37.417716 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30025): Terminated: ok {rc=0} 21:28:37.473124 --- ParallelTerminationStrategy: PID 30026 died... 21:28:37.495052 run iperf3-srv_10.42.42.10(pid=30026): Terminated {rc=256} 21:28:37.543025 --- ParallelTerminationStrategy: PID 30029 died... 21:28:37.562830 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30029): Terminated: ok {rc=0} 21:28:37.609419 --- ParallelTerminationStrategy: PID 30032 died... 21:28:37.628761 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30032): Terminated: ok {rc=0} 21:28:37.675857 --- ParallelTerminationStrategy: PID 30035 died... 21:28:37.695492 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30035): Terminated: ok {rc=0} 21:28:37.786369 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:trx-lms+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 21:28:38.971525 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:28:38.985535 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 21:28:39.080720 tst iperf3m4.py: using LAC 31617 21:28:39.223193 tst iperf3m4.py: using RAC 252 21:28:39.394815 tst iperf3m4.py: using CellId 31617 21:28:39.557370 tst iperf3m4.py: using BVCI 31618 21:28:39.688916 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:28:39.700302 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:28:39.711454 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:28:39.722630 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:28:39.733693 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:28:39.746072 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:28:39.758411 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:28:39.770066 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:28:39.781997 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:28:39.906783 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:28:40.044289 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:28:40.168743 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:28:40.294876 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 21:28:40.512465 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:28:40.845582 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30047): Launched 21:28:41.125820 run iperf3-srv_10.42.42.10(pid=30048): Launched 21:28:41.255128 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 21:28:41.485811 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:28:41.830032 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30049): Launched 21:28:42.128427 run iperf3-srv_10.42.42.10(pid=30050): Launched 21:28:42.257186 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 21:28:42.487536 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:28:42.831726 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30051): Launched 21:28:43.131079 run iperf3-srv_10.42.42.10(pid=30052): Launched 21:28:43.261025 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 21:28:43.491208 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:28:43.835813 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30053): Launched 21:28:44.136067 run iperf3-srv_10.42.42.10(pid=30054): Launched 21:28:44.266020 tst iperf3m4.py:8: start network... 21:28:44.496250 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:28:45.028029 run create_hlr_db(pid=30055): Launched 21:28:45.158059 bus /gobi_6: Setting Powered False 21:28:46.252164 run create_hlr_db(pid=30055): Terminated: ok {rc=0} 21:28:46.745058 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30058): Launched 21:28:47.112316 run osmo-hlr_10.42.42.2(pid=30059): Launched 21:28:47.373784 run osmo-stp_10.42.42.5: Starting osmo-stp 21:28:48.033298 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30062): Launched 21:28:48.376676 run osmo-stp_10.42.42.5(pid=30063): Launched 21:28:48.616740 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:28:49.305583 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30065): Launched 21:28:49.485796 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:28:49.770803 run patchelf(pid=30066): Launched 21:28:49.997399 run osmo-stp_10.42.42.5(pid=30063): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30063)] 21:28:50.134324 run osmo-stp_10.42.42.5(pid=30063): stdout: | (launched: 2022-12-12_21:28:48.315210) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:28:50.273169 run osmo-stp_10.42.42.5(pid=30063): stderr: | 20221212212848635 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212848635 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212848635 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212848635 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212848636 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212848636 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212848636 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:28:50.412446 run osmo-stp_10.42.42.5(pid=30063): stdout: | (launched: 2022-12-12_21:28:48.315210) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:28:50.546273 run osmo-stp_10.42.42.5(pid=30063): stderr: | 20221212212848635 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212848635 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212848635 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212848635 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212848636 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212848636 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212848636 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:28:50.706584 run patchelf(pid=30066): Terminating (SIGINT) 21:28:50.891103 run patchelf(pid=30066): Terminated: ok {rc=0} 21:28:51.022490 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30063): Process ended prematurely: osmo-stp_10.42.42.5(pid=30063) [trial-2382↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30063)] [trial-2382↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8] 21:28:51.034330 tst iperf3m4.py:8: Test FAILED (12.1 sec) 21:28:51.064466 run osmo-hlr_10.42.42.2(pid=30059): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30059)] 21:28:51.115127 run osmo-hlr_10.42.42.2(pid=30059): stdout: | (launched: 2022-12-12_21:28:47.045990) 21:28:51.167125 run osmo-hlr_10.42.42.2(pid=30059): stderr: | 20221212212847306 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212212847306 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212212847306 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212212847306 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212212847306 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212212847307 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212212847319 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212212847327 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212212847327 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212212847327 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:28:51.219913 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30047): Terminating (SIGTERM) 21:28:51.263313 run iperf3-srv_10.42.42.10(pid=30048): Terminating (SIGTERM) 21:28:51.307250 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30049): Terminating (SIGTERM) 21:28:51.350791 run iperf3-srv_10.42.42.10(pid=30050): Terminating (SIGTERM) 21:28:51.396356 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30051): Terminating (SIGTERM) 21:28:51.440598 run iperf3-srv_10.42.42.10(pid=30052): Terminating (SIGTERM) 21:28:51.486202 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30053): Terminating (SIGTERM) 21:28:51.529696 run iperf3-srv_10.42.42.10(pid=30054): Terminating (SIGTERM) 21:28:51.575306 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30058): Terminating (SIGTERM) 21:28:51.618233 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30062): Terminating (SIGTERM) 21:28:51.662283 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30065): Terminating (SIGTERM) 21:28:51.708243 --- ParallelTerminationStrategy: PID 30047 died... 21:28:51.728181 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30047): Terminated: ok {rc=0} 21:28:51.774956 --- ParallelTerminationStrategy: PID 30048 died... 21:28:51.794961 run iperf3-srv_10.42.42.10(pid=30048): Terminated {rc=256} 21:28:51.842328 --- ParallelTerminationStrategy: PID 30049 died... 21:28:51.862333 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30049): Terminated: ok {rc=0} 21:28:51.909860 --- ParallelTerminationStrategy: PID 30050 died... 21:28:51.929936 run iperf3-srv_10.42.42.10(pid=30050): Terminated {rc=256} 21:28:51.977438 --- ParallelTerminationStrategy: PID 30051 died... 21:28:51.997666 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30051): Terminated: ok {rc=0} 21:28:52.045350 --- ParallelTerminationStrategy: PID 30052 died... 21:28:52.065239 run iperf3-srv_10.42.42.10(pid=30052): Terminated {rc=256} 21:28:52.111677 --- ParallelTerminationStrategy: PID 30053 died... 21:28:52.131945 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30053): Terminated: ok {rc=0} 21:28:52.178557 --- ParallelTerminationStrategy: PID 30054 died... 21:28:52.198696 run iperf3-srv_10.42.42.10(pid=30054): Terminated {rc=256} 21:28:52.246430 --- ParallelTerminationStrategy: PID 30058 died... 21:28:52.266661 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30058): Terminated: ok {rc=0} 21:28:52.313434 --- ParallelTerminationStrategy: PID 30062 died... 21:28:52.353393 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30062): Terminated: ok {rc=0} 21:28:52.430972 --- ParallelTerminationStrategy: PID 30065 died... 21:28:52.451407 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30065): Terminated: ok {rc=0} 21:28:52.553755 bus /gobi_4: Setting Powered False 21:28:53.702252 bus /gobi_4: Setting Powered False 21:28:54.825948 bus /gobi_1: Setting Powered False 21:28:55.943427 bus /gobi_1: Setting Powered False 21:28:57.076655 bus /gobi_0: Setting Powered False 21:28:58.198679 bus /gobi_0: Setting Powered False 21:28:59.347910 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:trx-lms+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 21:29:00.479096 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:29:00.499434 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 21:29:00.570526 tst ping.py: using LAC 31618 21:29:00.705060 tst ping.py: using RAC 253 21:29:00.855060 tst ping.py: using CellId 31618 21:29:00.999450 tst ping.py: using BVCI 31619 21:29:01.144006 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:29:01.156489 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:29:01.168676 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:29:01.181242 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:29:01.193600 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:29:01.206114 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:29:01.219316 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:29:01.233057 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:29:01.375042 tst ping.py:19: start network... 21:29:01.665782 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:29:02.309018 run create_hlr_db(pid=30067): Launched 21:29:02.493565 bus /gobi_6: Setting Powered False 21:29:03.566938 run create_hlr_db(pid=30067): Terminated: ok {rc=0} 21:29:04.075859 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30069): Launched 21:29:04.428898 run osmo-hlr_10.42.42.2(pid=30070): Launched 21:29:04.681466 run osmo-stp_10.42.42.5: Starting osmo-stp 21:29:05.369736 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30072): Launched 21:29:05.723117 run osmo-stp_10.42.42.5(pid=30073): Launched 21:29:05.976931 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:29:06.605167 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30075): Launched 21:29:06.741407 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:29:07.013946 run patchelf(pid=30076): Launched 21:29:07.206177 run osmo-stp_10.42.42.5(pid=30073): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30073)] 21:29:07.351115 run osmo-stp_10.42.42.5(pid=30073): stdout: | (launched: 2022-12-12_21:29:05.659963) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:29:07.488582 run osmo-stp_10.42.42.5(pid=30073): stderr: | 20221212212905963 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212905963 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212905963 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212905963 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212905964 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212905964 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212905964 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:29:07.625516 run osmo-stp_10.42.42.5(pid=30073): stdout: | (launched: 2022-12-12_21:29:05.659963) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:29:07.758310 run osmo-stp_10.42.42.5(pid=30073): stderr: | 20221212212905963 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212905963 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212905963 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212905963 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212905964 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212905964 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212905964 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:29:07.913930 run patchelf(pid=30076): Terminating (SIGINT) 21:29:08.094003 run patchelf(pid=30076): Terminated: ok {rc=0} 21:29:08.222753 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=30073): Process ended prematurely: osmo-stp_10.42.42.5(pid=30073) [trial-2382↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30073)] [trial-2382↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22] 21:29:08.233094 tst ping.py:22: Test FAILED (7.7 sec) 21:29:08.260882 run osmo-hlr_10.42.42.2(pid=30070): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30070)] 21:29:08.310657 run osmo-hlr_10.42.42.2(pid=30070): stdout: | (launched: 2022-12-12_21:29:04.366046) 21:29:08.362853 run osmo-hlr_10.42.42.2(pid=30070): stderr: | 20221212212904670 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212212904670 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212212904670 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212212904670 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212212904671 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212212904671 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212212904689 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-lms+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212212904706 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212212904706 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212212904706 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:29:08.415588 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30069): Terminating (SIGTERM) 21:29:08.459198 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30072): Terminating (SIGTERM) 21:29:08.502836 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30075): Terminating (SIGTERM) 21:29:08.546907 --- ParallelTerminationStrategy: PID 30069 died... 21:29:08.566981 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30069): Terminated: ok {rc=0} 21:29:08.615368 --- ParallelTerminationStrategy: PID 30072 died... 21:29:08.636854 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30072): Terminated: ok {rc=0} 21:29:08.686137 --- ParallelTerminationStrategy: PID 30075 died... 21:29:08.708131 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30075): Terminated: ok {rc=0} 21:29:08.802395 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:trx-lms+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 21:29:09.896290 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:29:09.921552 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 21:29:10.011073 tst ping_idle_ping.py: using LAC 31619 21:29:10.144820 tst ping_idle_ping.py: using RAC 254 21:29:10.273268 tst ping_idle_ping.py: using CellId 31619 21:29:10.416340 tst ping_idle_ping.py: using BVCI 31620 21:29:10.600879 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:29:10.613217 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:29:10.625261 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:29:10.638095 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:29:10.650421 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:29:10.663562 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:29:10.676255 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:29:10.689435 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:29:10.811544 tst ping_idle_ping.py:24: start network... 21:29:11.029294 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:29:11.531467 run create_hlr_db(pid=30077): Launched 21:29:11.697576 bus /gobi_6: Setting Powered False 21:29:12.783539 run create_hlr_db(pid=30077): Terminated: ok {rc=0} 21:29:13.240365 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30079): Launched 21:29:13.571822 run osmo-hlr_10.42.42.2(pid=30080): Launched 21:29:13.820608 run osmo-stp_10.42.42.5: Starting osmo-stp 21:29:14.559987 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30082): Launched 21:29:14.910605 run osmo-stp_10.42.42.5(pid=30083): Launched 21:29:15.168169 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:29:15.823227 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30085): Launched 21:29:16.007131 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:29:16.322478 run patchelf(pid=30086): Launched 21:29:16.580839 run osmo-stp_10.42.42.5(pid=30083): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30083)] 21:29:16.763113 run osmo-stp_10.42.42.5(pid=30083): stdout: | (launched: 2022-12-12_21:29:14.848157) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:29:16.937242 run osmo-stp_10.42.42.5(pid=30083): stderr: | 20221212212915142 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212915142 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212915142 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212915143 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212915143 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212915143 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212915143 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:29:17.115417 run osmo-stp_10.42.42.5(pid=30083): stdout: | (launched: 2022-12-12_21:29:14.848157) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:29:17.282274 run osmo-stp_10.42.42.5(pid=30083): stderr: | 20221212212915142 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212915142 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212915142 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212915143 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212915143 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212915143 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212915143 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:29:17.481366 run patchelf(pid=30086): Terminating (SIGINT) 21:29:17.718288 run patchelf(pid=30086): Terminated: ok {rc=0} 21:29:17.874680 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=30083): Process ended prematurely: osmo-stp_10.42.42.5(pid=30083) [trial-2382↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30083)] [trial-2382↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 21:29:17.884734 tst ping_idle_ping.py:27: Test FAILED (8.0 sec) 21:29:17.917830 run osmo-hlr_10.42.42.2(pid=30080): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30080)] 21:29:17.969385 run osmo-hlr_10.42.42.2(pid=30080): stdout: | (launched: 2022-12-12_21:29:13.511697) 21:29:18.030104 run osmo-hlr_10.42.42.2(pid=30080): stderr: | 20221212212913851 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212212913851 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212212913851 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212212913851 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212212913851 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212212913851 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212212913870 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-lms+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212212913883 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212212913883 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212212913883 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:29:18.089940 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30079): Terminating (SIGTERM) 21:29:18.133153 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30082): Terminating (SIGTERM) 21:29:18.177887 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30085): Terminating (SIGTERM) 21:29:18.220632 --- ParallelTerminationStrategy: PID 30079 died... 21:29:18.240664 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30079): Terminated: ok {rc=0} 21:29:18.287822 --- ParallelTerminationStrategy: PID 30082 died... 21:29:18.307793 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30082): Terminated: ok {rc=0} 21:29:18.354925 --- ParallelTerminationStrategy: PID 30085 died... 21:29:18.375354 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30085): Terminated: ok {rc=0} 21:29:18.465096 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2382 gprs:trx-lms+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 gprs:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 21:29:19.786306 tst gprs:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:29:19.792887 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 21:29:19.828055 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 21:29:19.869121 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 21:29:19.956803 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 21:29:19.993574 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 21:29:20.035848 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 21:29:20.635369 tst gprs:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2382 gprs:trx-lms+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 21:29:20.690905 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:29:20.704463 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 21:29:20.777552 tst cs_paging_gprs_active.py: using LAC 31620 21:29:20.914743 tst cs_paging_gprs_active.py: using RAC 255 21:29:21.116728 tst cs_paging_gprs_active.py: using CellId 31620 21:29:21.275202 tst cs_paging_gprs_active.py: using BVCI 31621 21:29:21.454571 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:29:21.466455 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:29:21.478062 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:29:21.490613 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:29:21.503242 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:29:21.515625 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:29:21.529392 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:29:21.541333 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:29:21.555123 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 21:29:21.690505 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 21:29:21.852225 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 21:29:22.094136 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:29:22.444894 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30090): Launched 21:29:22.796454 run iperf3-srv_10.42.42.10(pid=30091): Launched 21:29:22.936132 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 21:29:23.159461 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:29:23.497566 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30092): Launched 21:29:23.830848 run iperf3-srv_10.42.42.10(pid=30093): Launched 21:29:23.986591 tst cs_paging_gprs_active.py:38: start network... 21:29:24.221360 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:29:24.759373 run create_hlr_db(pid=30095): Launched 21:29:24.927415 bus /gobi_6: Setting Powered False 21:29:26.014247 run create_hlr_db(pid=30095): Terminated: ok {rc=0} 21:29:26.494850 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30097): Launched 21:29:26.852069 run osmo-hlr_10.42.42.2(pid=30098): Launched 21:29:27.107617 run osmo-stp_10.42.42.5: Starting osmo-stp 21:29:27.820318 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30100): Launched 21:29:28.165408 run osmo-stp_10.42.42.5(pid=30101): Launched 21:29:28.417720 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:29:29.122674 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30103): Launched 21:29:29.260596 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:29:29.541939 run patchelf(pid=30104): Launched 21:29:29.742771 run osmo-stp_10.42.42.5(pid=30101): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30101)] 21:29:29.883047 run osmo-stp_10.42.42.5(pid=30101): stdout: | (launched: 2022-12-12_21:29:28.103779) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:29:30.022785 run osmo-stp_10.42.42.5(pid=30101): stderr: | 20221212212928430 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212928430 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212928430 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212928431 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212928431 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212928431 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212928431 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:29:30.163755 run osmo-stp_10.42.42.5(pid=30101): stdout: | (launched: 2022-12-12_21:29:28.103779) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:29:30.299140 run osmo-stp_10.42.42.5(pid=30101): stderr: | 20221212212928430 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212928430 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212928430 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212928431 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212928431 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212928431 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212928431 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:29:30.459504 run patchelf(pid=30104): Terminating (SIGINT) 21:29:30.645290 run patchelf(pid=30104): Terminated: ok {rc=0} 21:29:30.779914 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=30101): Process ended prematurely: osmo-stp_10.42.42.5(pid=30101) [trial-2382↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30101)] [trial-2382↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 21:29:30.789897 tst cs_paging_gprs_active.py:38: Test FAILED (10.1 sec) 21:29:30.818316 run osmo-hlr_10.42.42.2(pid=30098): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30098)] 21:29:30.872088 run osmo-hlr_10.42.42.2(pid=30098): stdout: | (launched: 2022-12-12_21:29:26.788586) 21:29:30.925363 run osmo-hlr_10.42.42.2(pid=30098): stderr: | 20221212212927095 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212212927095 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212212927095 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212212927095 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212212927095 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212212927095 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212212927113 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-lms+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212212927129 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212212927130 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212212927130 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:29:30.978622 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30090): Terminating (SIGTERM) 21:29:31.021011 run iperf3-srv_10.42.42.10(pid=30091): Terminating (SIGTERM) 21:29:31.077612 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30092): Terminating (SIGTERM) 21:29:31.121262 run iperf3-srv_10.42.42.10(pid=30093): Terminating (SIGTERM) 21:29:31.168611 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30097): Terminating (SIGTERM) 21:29:31.210380 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30100): Terminating (SIGTERM) 21:29:31.253264 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30103): Terminating (SIGTERM) 21:29:31.297745 --- ParallelTerminationStrategy: PID 30090 died... 21:29:31.317645 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30090): Terminated: ok {rc=0} 21:29:31.365304 --- ParallelTerminationStrategy: PID 30091 died... 21:29:31.384836 run iperf3-srv_10.42.42.10(pid=30091): Terminated {rc=256} 21:29:31.430645 --- ParallelTerminationStrategy: PID 30092 died... 21:29:31.450987 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30092): Terminated: ok {rc=0} 21:29:31.496921 --- ParallelTerminationStrategy: PID 30093 died... 21:29:31.516286 run iperf3-srv_10.42.42.10(pid=30093): Terminated {rc=256} 21:29:31.562255 --- ParallelTerminationStrategy: PID 30097 died... 21:29:31.582376 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30097): Terminated: ok {rc=0} 21:29:31.628162 --- ParallelTerminationStrategy: PID 30100 died... 21:29:31.648720 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30100): Terminated: ok {rc=0} 21:29:31.695198 --- ParallelTerminationStrategy: PID 30103 died... 21:29:31.716116 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30103): Terminated: ok {rc=0} 21:29:31.814400 bus /gobi_0: Setting Powered False 21:29:32.933589 bus /gobi_0: Setting Powered False 21:29:34.108404 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:trx-lms+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 21:29:35.318070 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:29:35.334155 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 21:29:35.412116 tst iperf3.py: using LAC 31621 21:29:35.541317 tst iperf3.py: using RAC 1 21:29:35.671370 tst iperf3.py: using CellId 31621 21:29:35.811169 tst iperf3.py: using BVCI 31622 21:29:35.930011 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:29:35.941155 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:29:35.952136 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:29:35.963125 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:29:35.974058 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:29:35.985298 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:29:35.996224 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:29:36.007095 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:29:36.018045 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 21:29:36.180309 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 21:29:36.484658 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:29:36.811688 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30109): Launched 21:29:37.149596 run iperf3-srv_10.42.42.10(pid=30110): Launched 21:29:37.283753 tst iperf3.py:8: start network... 21:29:37.500579 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:29:38.006122 run create_hlr_db(pid=30111): Launched 21:29:38.165227 bus /gobi_6: Setting Powered False 21:29:39.258802 run create_hlr_db(pid=30111): Terminated: ok {rc=0} 21:29:39.730905 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30113): Launched 21:29:40.074258 run osmo-hlr_10.42.42.2(pid=30114): Launched 21:29:40.277450 run osmo-stp_10.42.42.5: Starting osmo-stp 21:29:40.912648 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30116): Launched 21:29:41.248880 run osmo-stp_10.42.42.5(pid=30117): Launched 21:29:41.498495 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:29:42.203181 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30119): Launched 21:29:42.340500 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:29:42.625637 run patchelf(pid=30120): Launched 21:29:42.822726 run osmo-stp_10.42.42.5(pid=30117): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30117)] 21:29:42.967720 run osmo-stp_10.42.42.5(pid=30117): stdout: | (launched: 2022-12-12_21:29:41.187165) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:29:43.117908 run osmo-stp_10.42.42.5(pid=30117): stderr: | 20221212212941510 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212941510 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212941510 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212941511 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212941511 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212941511 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212941511 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:29:43.268558 run osmo-stp_10.42.42.5(pid=30117): stdout: | (launched: 2022-12-12_21:29:41.187165) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:29:43.411679 run osmo-stp_10.42.42.5(pid=30117): stderr: | 20221212212941510 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212941510 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212941510 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212941511 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212941511 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212941511 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212941511 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:29:43.582291 run patchelf(pid=30120): Terminating (SIGINT) 21:29:43.778275 run patchelf(pid=30120): Terminated: ok {rc=0} 21:29:43.919879 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30117): Process ended prematurely: osmo-stp_10.42.42.5(pid=30117) [trial-2382↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30117)] [trial-2382↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8] 21:29:43.930774 tst iperf3.py:8: Test FAILED (8.7 sec) 21:29:43.962525 run osmo-hlr_10.42.42.2(pid=30114): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30114)] 21:29:44.015966 run osmo-hlr_10.42.42.2(pid=30114): stdout: | (launched: 2022-12-12_21:29:40.012846) 21:29:44.070855 run osmo-hlr_10.42.42.2(pid=30114): stderr: | 20221212212940332 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212212940332 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212212940332 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212212940332 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212212940332 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212212940332 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212212940347 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212212940361 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212212940361 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212212940361 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:29:44.126520 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30109): Terminating (SIGTERM) 21:29:44.170819 run iperf3-srv_10.42.42.10(pid=30110): Terminating (SIGTERM) 21:29:44.215676 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30113): Terminating (SIGTERM) 21:29:44.260418 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30116): Terminating (SIGTERM) 21:29:44.305547 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30119): Terminating (SIGTERM) 21:29:44.351326 --- ParallelTerminationStrategy: PID 30109 died... 21:29:44.372173 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30109): Terminated: ok {rc=0} 21:29:44.422536 --- ParallelTerminationStrategy: PID 30110 died... 21:29:44.443578 run iperf3-srv_10.42.42.10(pid=30110): Terminated {rc=256} 21:29:44.492603 --- ParallelTerminationStrategy: PID 30113 died... 21:29:44.513956 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30113): Terminated: ok {rc=0} 21:29:44.563435 --- ParallelTerminationStrategy: PID 30116 died... 21:29:44.584415 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30116): Terminated: ok {rc=0} 21:29:44.634034 --- ParallelTerminationStrategy: PID 30119 died... 21:29:44.654985 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30119): Terminated: ok {rc=0} 21:29:44.748340 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:trx-lms+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 21:29:45.901668 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:29:45.914560 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 21:29:45.986482 tst iperf3m4.py: using LAC 31622 21:29:46.125657 tst iperf3m4.py: using RAC 2 21:29:46.289278 tst iperf3m4.py: using CellId 31622 21:29:46.478435 tst iperf3m4.py: using BVCI 31623 21:29:46.641930 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:29:46.654779 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:29:46.667591 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:29:46.680475 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:29:46.692378 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:29:46.704845 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:29:46.717922 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:29:46.729683 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:29:46.742160 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 21:29:46.878925 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 21:29:47.018104 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 21:29:47.157923 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 21:29:47.337810 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 21:29:47.580478 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:29:47.903966 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30121): Launched 21:29:48.191611 run iperf3-srv_10.42.42.10(pid=30122): Launched 21:29:48.315959 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 21:29:48.537171 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:29:48.867265 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30123): Launched 21:29:49.154397 run iperf3-srv_10.42.42.10(pid=30124): Launched 21:29:49.280319 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 21:29:49.494117 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:29:49.817623 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30125): Launched 21:29:50.098411 run iperf3-srv_10.42.42.10(pid=30126): Launched 21:29:50.221638 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 21:29:50.436168 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:29:50.757955 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30127): Launched 21:29:51.039840 run iperf3-srv_10.42.42.10(pid=30128): Launched 21:29:51.165157 tst iperf3m4.py:8: start network... 21:29:51.384858 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:29:51.892790 run create_hlr_db(pid=30129): Launched 21:29:52.024719 bus /gobi_6: Setting Powered False 21:29:53.086446 run create_hlr_db(pid=30129): Terminated: ok {rc=0} 21:29:53.531556 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30131): Launched 21:29:53.861212 run osmo-hlr_10.42.42.2(pid=30132): Launched 21:29:53.989797 run osmo-stp_10.42.42.5: Starting osmo-stp 21:29:54.554896 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30134): Launched 21:29:54.882426 run osmo-stp_10.42.42.5(pid=30135): Launched 21:29:55.007192 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:29:55.601158 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30137): Launched 21:29:55.740705 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:29:56.036360 run patchelf(pid=30138): Launched 21:29:56.243038 run osmo-stp_10.42.42.5(pid=30135): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30135)] 21:29:56.391784 run osmo-stp_10.42.42.5(pid=30135): stdout: | (launched: 2022-12-12_21:29:54.820353) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:29:56.541810 run osmo-stp_10.42.42.5(pid=30135): stderr: | 20221212212955003 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212955003 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212955004 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212955004 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212955005 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212955005 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212955005 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:29:56.691061 run osmo-stp_10.42.42.5(pid=30135): stdout: | (launched: 2022-12-12_21:29:54.820353) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:29:56.834115 run osmo-stp_10.42.42.5(pid=30135): stderr: | 20221212212955003 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212212955003 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212212955004 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212212955004 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212212955005 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212212955005 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212212955005 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:29:57.003448 run patchelf(pid=30138): Terminating (SIGINT) 21:29:57.200880 run patchelf(pid=30138): Terminated: ok {rc=0} 21:29:57.342676 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30135): Process ended prematurely: osmo-stp_10.42.42.5(pid=30135) [trial-2382↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30135)] [trial-2382↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8] 21:29:57.354782 tst iperf3m4.py:8: Test FAILED (11.5 sec) 21:29:57.388678 run osmo-hlr_10.42.42.2(pid=30132): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30132)] 21:29:57.443474 run osmo-hlr_10.42.42.2(pid=30132): stdout: | (launched: 2022-12-12_21:29:53.800178) 21:29:57.499660 run osmo-hlr_10.42.42.2(pid=30132): stderr: | 20221212212953985 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212212953985 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212212953985 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212212953985 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212212953985 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212212953985 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212212953998 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212212954007 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212212954007 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212212954007 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:29:57.556523 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30121): Terminating (SIGTERM) 21:29:57.603710 run iperf3-srv_10.42.42.10(pid=30122): Terminating (SIGTERM) 21:29:57.652803 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30123): Terminating (SIGTERM) 21:29:57.699319 run iperf3-srv_10.42.42.10(pid=30124): Terminating (SIGTERM) 21:29:57.747956 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30125): Terminating (SIGTERM) 21:29:57.794623 run iperf3-srv_10.42.42.10(pid=30126): Terminating (SIGTERM) 21:29:57.843570 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30127): Terminating (SIGTERM) 21:29:57.889553 run iperf3-srv_10.42.42.10(pid=30128): Terminating (SIGTERM) 21:29:57.938010 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30131): Terminating (SIGTERM) 21:29:57.984506 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30134): Terminating (SIGTERM) 21:29:58.032047 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30137): Terminating (SIGTERM) 21:29:58.080626 --- ParallelTerminationStrategy: PID 30121 died... 21:29:58.102376 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30121): Terminated: ok {rc=0} 21:29:58.155104 --- ParallelTerminationStrategy: PID 30122 died... 21:29:58.176605 run iperf3-srv_10.42.42.10(pid=30122): Terminated {rc=256} 21:29:58.227808 --- ParallelTerminationStrategy: PID 30123 died... 21:29:58.249565 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30123): Terminated: ok {rc=0} 21:29:58.300646 --- ParallelTerminationStrategy: PID 30124 died... 21:29:58.322072 run iperf3-srv_10.42.42.10(pid=30124): Terminated {rc=256} 21:29:58.374849 --- ParallelTerminationStrategy: PID 30125 died... 21:29:58.396216 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30125): Terminated: ok {rc=0} 21:29:58.447155 --- ParallelTerminationStrategy: PID 30126 died... 21:29:58.468331 run iperf3-srv_10.42.42.10(pid=30126): Terminated {rc=256} 21:29:58.519870 --- ParallelTerminationStrategy: PID 30127 died... 21:29:58.542008 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30127): Terminated: ok {rc=0} 21:29:58.594246 --- ParallelTerminationStrategy: PID 30128 died... 21:29:58.615548 run iperf3-srv_10.42.42.10(pid=30128): Terminated {rc=256} 21:29:58.666577 --- ParallelTerminationStrategy: PID 30131 died... 21:29:58.687980 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30131): Terminated: ok {rc=0} 21:29:58.739607 --- ParallelTerminationStrategy: PID 30134 died... 21:29:58.761077 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30134): Terminated: ok {rc=0} 21:29:58.812373 --- ParallelTerminationStrategy: PID 30137 died... 21:29:58.833945 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30137): Terminated: ok {rc=0} 21:29:58.929613 bus /gobi_4: Setting Powered False 21:30:00.044527 bus /gobi_4: Setting Powered False 21:30:01.208635 bus /gobi_1: Setting Powered False 21:30:02.393572 bus /gobi_1: Setting Powered False 21:30:03.550256 bus /gobi_0: Setting Powered False 21:30:04.649889 bus /gobi_0: Setting Powered False 21:30:05.776901 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:trx-lms+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 21:30:06.890820 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:30:06.903898 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 21:30:06.989698 tst ping.py: using LAC 31623 21:30:07.135318 tst ping.py: using RAC 3 21:30:07.279735 tst ping.py: using CellId 31623 21:30:07.420310 tst ping.py: using BVCI 31624 21:30:07.538402 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:30:07.549857 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:30:07.560834 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:30:07.571761 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:30:07.583386 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:30:07.594839 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:30:07.605892 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:30:07.617346 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 21:30:07.737753 tst ping.py:19: start network... 21:30:07.948297 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:30:08.438828 run create_hlr_db(pid=30142): Launched 21:30:08.568099 bus /gobi_6: Setting Powered False 21:30:09.631200 run create_hlr_db(pid=30142): Terminated: ok {rc=0} 21:30:10.072734 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30144): Launched 21:30:10.391265 run osmo-hlr_10.42.42.2(pid=30145): Launched 21:30:10.560112 run osmo-stp_10.42.42.5: Starting osmo-stp 21:30:11.159885 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30148): Launched 21:30:11.476551 run osmo-stp_10.42.42.5(pid=30149): Launched 21:30:11.597177 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:30:12.140216 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30151): Launched 21:30:12.261314 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:30:12.531467 run patchelf(pid=30152): Launched 21:30:12.707907 run osmo-stp_10.42.42.5(pid=30149): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30149)] 21:30:12.839853 run osmo-stp_10.42.42.5(pid=30149): stdout: | (launched: 2022-12-12_21:30:11.416861) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:30:12.973879 run osmo-stp_10.42.42.5(pid=30149): stderr: | 20221212213011591 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213011591 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213011591 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213011592 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213011592 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213011592 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213011592 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:30:13.107980 run osmo-stp_10.42.42.5(pid=30149): stdout: | (launched: 2022-12-12_21:30:11.416861) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:30:13.236288 run osmo-stp_10.42.42.5(pid=30149): stderr: | 20221212213011591 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213011591 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213011591 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213011592 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213011592 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213011592 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213011592 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:30:13.388261 run patchelf(pid=30152): Terminating (SIGINT) 21:30:13.564517 run patchelf(pid=30152): Terminated: ok {rc=0} 21:30:13.691716 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=30149): Process ended prematurely: osmo-stp_10.42.42.5(pid=30149) [trial-2382↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30149)] [trial-2382↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22] 21:30:13.700670 tst ping.py:22: Test FAILED (6.8 sec) 21:30:13.728308 run osmo-hlr_10.42.42.2(pid=30145): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30145)] 21:30:13.777281 run osmo-hlr_10.42.42.2(pid=30145): stdout: | (launched: 2022-12-12_21:30:10.331441) 21:30:13.827941 run osmo-hlr_10.42.42.2(pid=30145): stderr: | 20221212213010525 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212213010525 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212213010525 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212213010525 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212213010525 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212213010526 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212213010540 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-lms+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212213010557 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212213010557 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212213010557 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:30:13.879440 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30144): Terminating (SIGTERM) 21:30:13.920087 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30148): Terminating (SIGTERM) 21:30:13.960599 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30151): Terminating (SIGTERM) 21:30:14.001665 --- ParallelTerminationStrategy: PID 30144 died... 21:30:14.021388 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30144): Terminated: ok {rc=0} 21:30:14.066786 --- ParallelTerminationStrategy: PID 30148 died... 21:30:14.085951 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30148): Terminated: ok {rc=0} 21:30:14.130876 --- ParallelTerminationStrategy: PID 30151 died... 21:30:14.150031 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30151): Terminated: ok {rc=0} 21:30:14.236102 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:trx-lms+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 21:30:15.324183 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:30:15.336808 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 21:30:15.413680 tst ping_idle_ping.py: using LAC 31624 21:30:15.537847 tst ping_idle_ping.py: using RAC 4 21:30:15.661572 tst ping_idle_ping.py: using CellId 31624 21:30:15.785809 tst ping_idle_ping.py: using BVCI 31625 21:30:15.913411 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:30:15.925557 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:30:15.937301 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:30:15.948924 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:30:15.960507 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:30:15.972260 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:30:15.984068 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:30:15.996672 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 21:30:16.128509 tst ping_idle_ping.py:24: start network... 21:30:16.360943 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:30:16.864798 run create_hlr_db(pid=30154): Launched 21:30:17.037127 bus /gobi_6: Setting Powered False 21:30:18.100031 run create_hlr_db(pid=30154): Terminated: ok {rc=0} 21:30:18.582021 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30156): Launched 21:30:18.907504 run osmo-hlr_10.42.42.2(pid=30157): Launched 21:30:19.029676 run osmo-stp_10.42.42.5: Starting osmo-stp 21:30:19.592350 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30159): Launched 21:30:19.910463 run osmo-stp_10.42.42.5(pid=30160): Launched 21:30:20.029779 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:30:20.573135 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30162): Launched 21:30:20.694605 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:30:20.961108 run patchelf(pid=30163): Launched 21:30:21.135745 run osmo-stp_10.42.42.5(pid=30160): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30160)] 21:30:21.268320 run osmo-stp_10.42.42.5(pid=30160): stdout: | (launched: 2022-12-12_21:30:19.850501) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:30:21.402739 run osmo-stp_10.42.42.5(pid=30160): stderr: | 20221212213020025 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213020025 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213020025 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213020026 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213020027 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213020027 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213020027 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:30:21.536788 run osmo-stp_10.42.42.5(pid=30160): stdout: | (launched: 2022-12-12_21:30:19.850501) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:30:21.664883 run osmo-stp_10.42.42.5(pid=30160): stderr: | 20221212213020025 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213020025 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213020025 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213020026 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213020027 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213020027 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213020027 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:30:21.818978 run patchelf(pid=30163): Terminating (SIGINT) 21:30:21.996578 run patchelf(pid=30163): Terminated: ok {rc=0} 21:30:22.123796 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=30160): Process ended prematurely: osmo-stp_10.42.42.5(pid=30160) [trial-2382↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30160)] [trial-2382↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 21:30:22.132896 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 21:30:22.160648 run osmo-hlr_10.42.42.2(pid=30157): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30157)] 21:30:22.209936 run osmo-hlr_10.42.42.2(pid=30157): stdout: | (launched: 2022-12-12_21:30:18.847713) 21:30:22.261224 run osmo-hlr_10.42.42.2(pid=30157): stderr: | 20221212213019027 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212213019027 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212213019027 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212213019027 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212213019027 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212213019028 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212213019043 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-lms+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212213019052 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212213019052 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212213019052 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:30:22.312762 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30156): Terminating (SIGTERM) 21:30:22.354005 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30159): Terminating (SIGTERM) 21:30:22.395039 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30162): Terminating (SIGTERM) 21:30:22.436490 --- ParallelTerminationStrategy: PID 30156 died... 21:30:22.456430 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30156): Terminated: ok {rc=0} 21:30:22.502142 --- ParallelTerminationStrategy: PID 30159 died... 21:30:22.521535 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30159): Terminated: ok {rc=0} 21:30:22.566757 --- ParallelTerminationStrategy: PID 30162 died... 21:30:22.586214 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30162): Terminated: ok {rc=0} 21:30:22.672344 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2382 gprs:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 21:30:23.983807 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:30:23.991507 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 21:30:24.028609 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 21:30:24.065558 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 21:30:24.120987 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 21:30:24.156209 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 21:30:24.193199 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 21:30:24.750643 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2382 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 21:30:24.756392 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:30:24.768405 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 21:30:24.842526 tst switch_tch_pdch.py: using LAC 31625 21:30:24.975536 tst switch_tch_pdch.py: using RAC 5 21:30:25.109642 tst switch_tch_pdch.py: using CellId 31625 21:30:25.242361 tst switch_tch_pdch.py: using BVCI 31626 21:30:25.367543 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:30:25.379413 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:30:25.391256 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:30:25.403838 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:30:25.416168 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:30:25.428702 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:30:25.441553 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:30:25.454216 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:30:25.573100 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:30:25.703086 tst switch_tch_pdch.py:51: start network... 21:30:25.930226 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:30:26.453170 run create_hlr_db(pid=30168): Launched 21:30:26.582619 bus /gobi_6: Setting Powered False 21:30:27.647423 run create_hlr_db(pid=30168): Terminated: ok {rc=0} 21:30:28.095881 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30170): Launched 21:30:28.412630 run osmo-hlr_10.42.42.2(pid=30171): Launched 21:30:28.534349 run osmo-stp_10.42.42.5: Starting osmo-stp 21:30:29.092648 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30173): Launched 21:30:29.408045 run osmo-stp_10.42.42.5(pid=30174): Launched 21:30:29.528801 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:30:30.070292 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30176): Launched 21:30:30.189635 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:30:30.456239 run patchelf(pid=30177): Launched 21:30:30.632635 run osmo-stp_10.42.42.5(pid=30174): ERR: Terminated: ERROR {rc=1} [trial-2382↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30174)] 21:30:30.764526 run osmo-stp_10.42.42.5(pid=30174): stdout: | (launched: 2022-12-12_21:30:29.348758) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:30:30.926649 run osmo-stp_10.42.42.5(pid=30174): stderr: | 20221212213029522 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213029522 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213029522 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213029523 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213029523 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213029523 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213029523 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:30:31.075460 run osmo-stp_10.42.42.5(pid=30174): stdout: | (launched: 2022-12-12_21:30:29.348758) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:30:31.216439 run osmo-stp_10.42.42.5(pid=30174): stderr: | 20221212213029522 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213029522 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213029522 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213029523 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213029523 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213029523 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213029523 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:30:31.385398 run patchelf(pid=30177): Terminating (SIGINT) 21:30:31.580240 run patchelf(pid=30177): Terminated: ok {rc=0} 21:30:31.721623 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=30174): Process ended prematurely: osmo-stp_10.42.42.5(pid=30174) [trial-2382↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30174)] [trial-2382↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 21:30:31.732626 tst switch_tch_pdch.py:54: Test FAILED (7.0 sec) 21:30:31.766721 run osmo-hlr_10.42.42.2(pid=30171): ERR: Terminated: ERROR {rc=237} [trial-2382↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30171)] 21:30:31.826857 run osmo-hlr_10.42.42.2(pid=30171): stdout: | (launched: 2022-12-12_21:30:28.353570) 21:30:31.890059 run osmo-hlr_10.42.42.2(pid=30171): stderr: | 20221212213028534 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212213028534 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212213028534 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212213028534 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212213028534 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212213028534 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212213028546 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212213028556 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212213028557 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212213028557 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:30:31.952556 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30170): Terminating (SIGTERM) 21:30:32.001669 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30173): Terminating (SIGTERM) 21:30:32.052904 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30176): Terminating (SIGTERM) 21:30:32.103504 --- ParallelTerminationStrategy: PID 30170 died... 21:30:32.126255 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30170): Terminated: ok {rc=0} 21:30:32.172214 --- ParallelTerminationStrategy: PID 30173 died... 21:30:32.192593 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30173): Terminated: ok {rc=0} 21:30:32.238228 --- ParallelTerminationStrategy: PID 30176 died... 21:30:32.257802 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30176): Terminated: ok {rc=0} 21:30:32.344083 bus /gobi_0: Setting Powered False 21:30:33.442729 bus /gobi_0: Setting Powered False 21:30:34.560128 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2382 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 dynts:trx-lms+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 21:30:35.829125 tst dynts:trx-lms+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:30:35.836143 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 21:30:35.869437 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 21:30:35.903689 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 21:30:35.956374 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 21:30:35.989706 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 21:30:36.024271 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 21:30:36.579883 tst dynts:trx-lms+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2382 dynts:trx-lms+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 21:30:36.584925 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 21:30:36.596094 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 21:30:36.664459 tst switch_tch_pdch.py: using LAC 31626 21:30:36.788166 tst switch_tch_pdch.py: using RAC 6 21:30:36.924427 tst switch_tch_pdch.py: using CellId 31626 21:30:37.055811 tst switch_tch_pdch.py: using BVCI 31627 21:30:37.178722 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 21:30:37.190499 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 21:30:37.202013 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 21:30:37.213833 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 21:30:37.225737 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 21:30:37.237373 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 21:30:37.248877 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 21:30:37.260434 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 21:30:37.381672 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 21:30:37.501455 tst switch_tch_pdch.py:51: start network... 21:30:37.728438 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:30:38.224083 run create_hlr_db(pid=30183): Launched 21:30:38.354994 bus /gobi_6: Setting Powered False 21:30:39.420757 run create_hlr_db(pid=30183): Terminated: ok {rc=0} 21:30:39.858897 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30185): Launched 21:30:40.197903 run osmo-hlr_10.42.42.2(pid=30186): Launched 21:30:40.328746 run osmo-stp_10.42.42.5: Starting osmo-stp 21:30:40.853575 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30188): Launched 21:30:41.169257 run osmo-stp_10.42.42.5(pid=30189): Launched 21:30:41.288865 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:30:41.802492 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30191): Launched 21:30:41.923575 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:30:42.190080 run patchelf(pid=30192): Launched 21:30:42.364088 run osmo-stp_10.42.42.5(pid=30189): ERR: Terminated: ERROR {rc=1} [trial-2382↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30189)] 21:30:42.495763 run osmo-stp_10.42.42.5(pid=30189): stdout: | (launched: 2022-12-12_21:30:41.109843) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:30:42.629461 run osmo-stp_10.42.42.5(pid=30189): stderr: | 20221212213041286 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213041286 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213041286 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213041287 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213041287 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213041287 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213041287 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:30:42.763674 run osmo-stp_10.42.42.5(pid=30189): stdout: | (launched: 2022-12-12_21:30:41.109843) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:30:42.892592 run osmo-stp_10.42.42.5(pid=30189): stderr: | 20221212213041286 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213041286 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213041286 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213041287 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213041287 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213041287 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213041287 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:30:43.043911 run patchelf(pid=30192): Terminating (SIGINT) 21:30:43.219571 run patchelf(pid=30192): Terminated: ok {rc=0} 21:30:43.346806 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=30189): Process ended prematurely: osmo-stp_10.42.42.5(pid=30189) [trial-2382↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30189)] [trial-2382↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 21:30:43.356239 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 21:30:43.383663 run osmo-hlr_10.42.42.2(pid=30186): ERR: Terminated: ERROR {rc=237} [trial-2382↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30186)] 21:30:43.432403 run osmo-hlr_10.42.42.2(pid=30186): stdout: | (launched: 2022-12-12_21:30:40.134832) 21:30:43.482877 run osmo-hlr_10.42.42.2(pid=30186): stderr: | 20221212213040335 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212213040335 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212213040335 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212213040335 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212213040335 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212213040335 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212213040355 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/dynts:trx-lms+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212213040365 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212213040366 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212213040366 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:30:43.534406 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30185): Terminating (SIGTERM) 21:30:43.575253 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30188): Terminating (SIGTERM) 21:30:43.615892 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30191): Terminating (SIGTERM) 21:30:43.657084 --- ParallelTerminationStrategy: PID 30185 died... 21:30:43.676667 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30185): Terminated: ok {rc=0} 21:30:43.722136 --- ParallelTerminationStrategy: PID 30188 died... 21:30:43.741358 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30188): Terminated: ok {rc=0} 21:30:43.786368 --- ParallelTerminationStrategy: PID 30191 died... 21:30:43.805654 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30191): Terminated: ok {rc=0} 21:30:43.894147 bus /gobi_0: Setting Powered False 21:30:44.995410 bus /gobi_0: Setting Powered False 21:30:46.114866 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2382 dynts:trx-lms+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 nitb_sms:trx-lms-limenet-micro --------------------------------------------------------------------- 21:30:47.373375 tst nitb_sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:30:47.377797 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 21:30:47.406914 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 21:30:47.413771 tst nitb_sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 21:30:47.466056 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 21:30:47.495572 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 21:30:47.502379 tst nitb_sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 21:30:48.040438 tst nitb_sms:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_sms: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 nitb_sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 21:30:48.045494 tst nitb_sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 21:30:48.056461 tst nitb_sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 21:30:48.100415 tst mo_mt_sms.py: using LAC 31627 21:30:48.232786 tst mo_mt_sms.py: using RAC 7 21:30:48.364532 tst mo_mt_sms.py: using CellId 31627 21:30:48.497494 tst mo_mt_sms.py: using BVCI 31628 21:30:48.619989 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 21:30:48.739655 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 21:30:48.860380 tst mo_mt_sms.py:9: start nitb and bts... 21:30:49.072058 run osmo-nitb_10.42.42.2: Starting osmo-nitb 21:30:49.710480 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30196): Launched 21:30:50.029692 run osmo-nitb_10.42.42.2(pid=30197): Launched 21:30:50.206182 run osmo-nitb_10.42.42.2(pid=30197): ERR: Terminated: ERROR {rc=2} [trial-2382↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30197)] 21:30:50.347256 run osmo-nitb_10.42.42.2(pid=30197): stdout: | (launched: 2022-12-12_21:30:49.967699) 21:30:50.488878 run osmo-nitb_10.42.42.2(pid=30197): stderr: | (launched: 2022-12-12_21:30:50.014337) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 21:30:50.630897 run osmo-nitb_10.42.42.2(pid=30197): stdout: | (launched: 2022-12-12_21:30:49.967699) 21:30:50.766967 run osmo-nitb_10.42.42.2(pid=30197): stderr: | (launched: 2022-12-12_21:30:50.014337) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7ff6b86c2268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=30197): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30197) [trial-2382↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30197)] 21:30:51.150176 tst osmo-nitb_10.42.42.2(pid=30197): stdout: | (launched: 2022-12-12_21:30:49.967699) 21:30:51.277473 tst osmo-nitb_10.42.42.2(pid=30197): stderr: | (launched: 2022-12-12_21:30:50.014337) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 21:30:51.426597 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=30197): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30197) [trial-2382↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30197)] [trial-2382↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11] 21:30:51.435049 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 21:30:51.441665 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30196): Terminating (SIGTERM) 21:30:51.651329 --- ParallelTerminationStrategy: PID 30196 died... 21:30:51.672483 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30196): Terminated: ok {rc=0} 21:30:51.760729 bus /sierra_3: Setting Powered False 21:30:52.865297 bus /sierra_3: Setting Powered False 21:30:53.986492 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 nitb_sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 sms:trx-lms-limenet-micro --------------------------------------------------------------------- 21:30:55.187171 tst sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:30:55.191705 tst sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 21:30:55.223296 tst sms:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 21:30:55.251763 tst sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 21:30:55.306191 tst sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 21:30:55.336649 tst sms:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 21:30:55.364156 tst sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 21:30:55.913528 tst sms:trx-lms-limenet-micro: RESERVED RESOURCES for sms: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 21:30:55.918844 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:30:55.930363 tst sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 21:30:55.975684 tst mo_mt_sms.py: using LAC 31628 21:30:56.107671 tst mo_mt_sms.py: using RAC 8 21:30:56.233584 tst mo_mt_sms.py: using CellId 31628 21:30:56.360723 tst mo_mt_sms.py: using BVCI 31629 21:30:56.484487 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:30:56.495933 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:30:56.507261 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:30:56.518769 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:30:56.530599 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:30:56.542543 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 21:30:56.661373 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 21:30:56.782833 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:30:57.307663 run create_hlr_db(pid=30202): Launched 21:30:57.436942 bus /sierra_2: Setting Powered False 21:30:58.503066 run create_hlr_db(pid=30202): Terminated: ok {rc=0} 21:30:58.951424 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30204): Launched 21:30:59.267737 run osmo-hlr_10.42.42.2(pid=30205): Launched 21:30:59.388776 run osmo-stp_10.42.42.5: Starting osmo-stp 21:30:59.930523 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30207): Launched 21:31:00.246592 run osmo-stp_10.42.42.5(pid=30208): Launched 21:31:00.366295 run osmo-msc_10.42.42.6: Starting osmo-msc 21:31:00.955300 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30210): Launched 21:31:01.309076 run osmo-msc_10.42.42.6(pid=30211): Launched 21:31:01.716269 run osmo-stp_10.42.42.5(pid=30208): ERR: Terminated: ERROR {rc=1} [trial-2382↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30208)] 21:31:02.058850 run osmo-stp_10.42.42.5(pid=30208): stdout: | (launched: 2022-12-12_21:31:00.186432) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:31:02.369856 run osmo-stp_10.42.42.5(pid=30208): stderr: | 20221212213100361 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213100362 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213100362 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213100362 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213100363 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213100363 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213100363 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:31:02.501577 run osmo-stp_10.42.42.5(pid=30208): stdout: | (launched: 2022-12-12_21:31:00.186432) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:31:02.625807 run osmo-stp_10.42.42.5(pid=30208): stderr: | 20221212213100361 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213100362 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213100362 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213100362 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213100363 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213100363 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213100363 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:31:02.774754 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=30208): Process ended prematurely: osmo-stp_10.42.42.5(pid=30208) [trial-2382↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30208)] [trial-2382↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16] 21:31:02.783181 tst mo_mt_sms.py:16: Test FAILED (6.9 sec) 21:31:02.810393 run osmo-hlr_10.42.42.2(pid=30205): ERR: Terminated: ERROR {rc=237} [trial-2382↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30205)] 21:31:02.860011 run osmo-hlr_10.42.42.2(pid=30205): stdout: | (launched: 2022-12-12_21:30:59.208373) 21:31:02.911416 run osmo-hlr_10.42.42.2(pid=30205): stderr: | 20221212213059388 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212213059388 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212213059389 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212213059389 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212213059389 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212213059389 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212213059401 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/sms:trx-lms-limenet-micro/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212213059409 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212213059409 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212213059409 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:31:02.982946 run osmo-msc_10.42.42.6(pid=30211): ERR: Terminated: ERROR {rc=2} [trial-2382↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30211)] 21:31:03.033571 run osmo-msc_10.42.42.6(pid=30211): stdout: | (launched: 2022-12-12_21:31:01.248053) 21:31:03.084660 run osmo-msc_10.42.42.6(pid=30211): stderr: | 20221212213101837 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212213101838 DLGLOBAL DEBUG validating counter group 0x7fa495ad2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212213101838 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212213101838 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212213101838 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212213101838 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212213101843 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212213101843 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212213101844 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212213101844 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:31:03.136323 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30204): Terminating (SIGTERM) 21:31:03.177407 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30207): Terminating (SIGTERM) 21:31:03.218546 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30210): Terminating (SIGTERM) 21:31:03.259918 --- ParallelTerminationStrategy: PID 30204 died... 21:31:03.279746 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30204): Terminated: ok {rc=0} 21:31:03.325282 --- ParallelTerminationStrategy: PID 30207 died... 21:31:03.344676 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30207): Terminated: ok {rc=0} 21:31:03.390124 --- ParallelTerminationStrategy: PID 30210 died... 21:31:03.409523 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30210): Terminated: ok {rc=0} 21:31:03.496627 bus /sierra_3: Setting Powered False 21:31:04.598110 bus /sierra_3: Setting Powered False 21:31:05.720430 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 nitb_ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 21:31:06.951777 tst nitb_ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:31:06.955768 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 21:31:06.984893 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 21:31:06.991740 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 21:31:07.026906 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 21:31:07.056741 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 21:31:07.063737 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 21:31:07.584225 tst nitb_ussd:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_ussd: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2382 nitb_ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 21:31:07.591736 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 21:31:07.604240 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 21:31:07.649956 tst assert_extension.py: using LAC 31629 21:31:07.784347 tst assert_extension.py: using RAC 9 21:31:07.916252 tst assert_extension.py: using CellId 31629 21:31:08.048285 tst assert_extension.py: using BVCI 31630 21:31:08.172125 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 21:31:08.296194 tst assert_extension.py:10: start nitb and bts... 21:31:08.523301 run osmo-nitb_10.42.42.2: Starting osmo-nitb 21:31:09.209535 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30217): Launched 21:31:09.550801 run osmo-nitb_10.42.42.2(pid=30218): Launched 21:31:09.738706 run osmo-nitb_10.42.42.2(pid=30218): ERR: Terminated: ERROR {rc=2} [trial-2382↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30218)] 21:31:09.889135 run osmo-nitb_10.42.42.2(pid=30218): stdout: | (launched: 2022-12-12_21:31:09.487437) 21:31:10.040654 run osmo-nitb_10.42.42.2(pid=30218): stderr: | (launched: 2022-12-12_21:31:09.537705) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 21:31:10.192235 run osmo-nitb_10.42.42.2(pid=30218): stdout: | (launched: 2022-12-12_21:31:09.487437) 21:31:10.338734 run osmo-nitb_10.42.42.2(pid=30218): stderr: | (launched: 2022-12-12_21:31:09.537705) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7ff6b86c2268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=30218): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30218) [trial-2382↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30218)] 21:31:10.679857 tst osmo-nitb_10.42.42.2(pid=30218): stdout: | (launched: 2022-12-12_21:31:09.487437) 21:31:10.815685 tst osmo-nitb_10.42.42.2(pid=30218): stderr: | (launched: 2022-12-12_21:31:09.537705) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 21:31:10.976089 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=30218): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30218) [trial-2382↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30218)] [trial-2382↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12] 21:31:10.985315 tst assert_extension.py:12: Test FAILED (3.4 sec) 21:31:10.992885 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30217): Terminating (SIGTERM) 21:31:11.205753 --- ParallelTerminationStrategy: PID 30217 died... 21:31:11.228546 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30217): Terminated: ok {rc=0} 21:31:11.319997 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 nitb_ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 21:31:12.500412 tst ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:31:12.504942 tst ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 21:31:12.538234 tst ussd:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 21:31:12.565062 tst ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 21:31:12.601548 tst ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 21:31:12.631645 tst ussd:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 21:31:12.658918 tst ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 21:31:13.186866 tst ussd:trx-lms-limenet-micro: RESERVED RESOURCES for ussd: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2382 ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 21:31:13.192019 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:31:13.203191 tst ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 21:31:13.248467 tst assert_extension.py: using LAC 31630 21:31:13.373377 tst assert_extension.py: using RAC 10 21:31:13.501806 tst assert_extension.py: using CellId 31630 21:31:13.624466 tst assert_extension.py: using BVCI 31631 21:31:13.738311 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:31:13.749278 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:31:13.759985 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:31:13.771199 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:31:13.781933 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:31:13.793550 tst ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 21:31:13.915922 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:31:14.439541 run create_hlr_db(pid=30222): Launched 21:31:14.567969 bus /sierra_2: Setting Powered False 21:31:15.634661 run create_hlr_db(pid=30222): Terminated: ok {rc=0} 21:31:16.124058 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30224): Launched 21:31:16.462888 run osmo-hlr_10.42.42.2(pid=30225): Launched 21:31:16.681288 run osmo-stp_10.42.42.5: Starting osmo-stp 21:31:17.388439 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30227): Launched 21:31:17.733513 run osmo-stp_10.42.42.5(pid=30228): Launched 21:31:17.864630 run osmo-msc_10.42.42.6: Starting osmo-msc 21:31:18.476380 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30230): Launched 21:31:18.816085 run osmo-msc_10.42.42.6(pid=30231): Launched 21:31:19.004053 run osmo-stp_10.42.42.5(pid=30228): ERR: Terminated: ERROR {rc=1} [trial-2382↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30228)] 21:31:19.147500 run osmo-stp_10.42.42.5(pid=30228): stdout: | (launched: 2022-12-12_21:31:17.670256) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:31:19.291782 run osmo-stp_10.42.42.5(pid=30228): stderr: | 20221212213117870 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213117870 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213117870 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213117870 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213117871 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213117871 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213117871 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:31:19.432882 run osmo-stp_10.42.42.5(pid=30228): stdout: | (launched: 2022-12-12_21:31:17.670256) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:31:19.566834 run osmo-stp_10.42.42.5(pid=30228): stderr: | 20221212213117870 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213117870 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213117870 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213117870 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213117871 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213117871 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213117871 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:31:19.727162 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=30228): Process ended prematurely: osmo-stp_10.42.42.5(pid=30228) [trial-2382↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30228)] [trial-2382↪ussd:trx-lms-limenet-micro↪assert_extension.py:17] 21:31:19.736371 tst assert_extension.py:17: Test FAILED (6.5 sec) 21:31:19.765691 run osmo-hlr_10.42.42.2(pid=30225): ERR: Terminated: ERROR {rc=237} [trial-2382↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30225)] 21:31:19.817946 run osmo-hlr_10.42.42.2(pid=30225): stdout: | (launched: 2022-12-12_21:31:16.398160) 21:31:19.871939 run osmo-hlr_10.42.42.2(pid=30225): stderr: | 20221212213116622 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212213116622 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212213116622 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212213116622 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212213116622 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212213116622 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212213116647 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/ussd:trx-lms-limenet-micro/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212213116667 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212213116668 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212213116668 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:31:19.946996 run osmo-msc_10.42.42.6(pid=30231): ERR: Terminated: ERROR {rc=2} [trial-2382↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30231)] 21:31:19.999049 run osmo-msc_10.42.42.6(pid=30231): stdout: | (launched: 2022-12-12_21:31:18.752663) 21:31:20.052910 run osmo-msc_10.42.42.6(pid=30231): stderr: | 20221212213119080 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212213119080 DLGLOBAL DEBUG validating counter group 0x7f5a7eaa6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212213119080 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212213119080 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212213119081 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212213119081 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212213119083 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212213119083 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212213119083 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212213119083 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:31:20.107113 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30224): Terminating (SIGTERM) 21:31:20.150781 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30227): Terminating (SIGTERM) 21:31:20.194333 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30230): Terminating (SIGTERM) 21:31:20.238296 --- ParallelTerminationStrategy: PID 30224 died... 21:31:20.259422 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30224): Terminated: ok {rc=0} 21:31:20.308089 --- ParallelTerminationStrategy: PID 30227 died... 21:31:20.328482 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30227): Terminated: ok {rc=0} 21:31:20.376522 --- ParallelTerminationStrategy: PID 30230 died... 21:31:20.396779 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30230): Terminated: ok {rc=0} 21:31:20.487989 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 21:31:21.700098 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:31:21.707855 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 21:31:21.737522 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 21:31:21.764227 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 21:31:21.815558 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 21:31:21.844931 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 21:31:21.871746 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 21:31:22.429569 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 21:31:22.486300 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:31:22.498661 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 21:31:22.567330 tst mo_mt_call.py: using LAC 31631 21:31:22.700795 tst mo_mt_call.py: using RAC 11 21:31:22.835068 tst mo_mt_call.py: using CellId 31631 21:31:22.969374 tst mo_mt_call.py: using BVCI 31632 21:31:23.094853 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:31:23.106886 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:31:23.118784 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:31:23.131126 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:31:23.143377 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:31:23.155668 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 21:31:23.280067 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 21:31:23.403302 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:31:23.936245 run create_hlr_db(pid=30236): Launched 21:31:24.068580 bus /sierra_2: Setting Powered False 21:31:25.136289 run create_hlr_db(pid=30236): Terminated: ok {rc=0} 21:31:25.594903 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30238): Launched 21:31:25.918102 run osmo-hlr_10.42.42.2(pid=30239): Launched 21:31:26.040322 run osmo-stp_10.42.42.5: Starting osmo-stp 21:31:26.605277 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30241): Launched 21:31:26.927827 run osmo-stp_10.42.42.5(pid=30242): Launched 21:31:27.050532 run osmo-msc_10.42.42.6: Starting osmo-msc 21:31:27.628193 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30244): Launched 21:31:27.951933 run osmo-msc_10.42.42.6(pid=30245): Launched 21:31:28.130927 run osmo-stp_10.42.42.5(pid=30242): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30242)] 21:31:28.264930 run osmo-stp_10.42.42.5(pid=30242): stdout: | (launched: 2022-12-12_21:31:26.867223) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:31:28.398266 run osmo-stp_10.42.42.5(pid=30242): stderr: | 20221212213127041 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213127042 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213127042 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213127042 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213127043 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213127043 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213127043 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:31:28.529858 run osmo-stp_10.42.42.5(pid=30242): stdout: | (launched: 2022-12-12_21:31:26.867223) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:31:28.655936 run osmo-stp_10.42.42.5(pid=30242): stderr: | 20221212213127041 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213127042 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213127042 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213127042 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213127043 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213127043 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213127043 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:31:28.806966 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30242): Process ended prematurely: osmo-stp_10.42.42.5(pid=30242) [trial-2382↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30242)] [trial-2382↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 21:31:28.815951 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 21:31:28.843353 run osmo-hlr_10.42.42.2(pid=30239): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30239)] 21:31:28.892607 run osmo-hlr_10.42.42.2(pid=30239): stdout: | (launched: 2022-12-12_21:31:25.857663) 21:31:28.943666 run osmo-hlr_10.42.42.2(pid=30239): stderr: | 20221212213126035 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212213126035 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212213126035 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212213126035 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212213126035 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212213126035 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212213126048 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212213126056 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212213126057 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212213126057 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:31:29.015414 run osmo-msc_10.42.42.6(pid=30245): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30245)] 21:31:29.064445 run osmo-msc_10.42.42.6(pid=30245): stdout: | (launched: 2022-12-12_21:31:27.891429) 21:31:29.115275 run osmo-msc_10.42.42.6(pid=30245): stderr: | 20221212213128167 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212213128167 DLGLOBAL DEBUG validating counter group 0x7f2979180c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212213128167 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212213128168 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212213128168 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212213128168 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212213128170 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212213128170 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212213128170 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212213128170 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:31:29.166219 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30238): Terminating (SIGTERM) 21:31:29.207044 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30241): Terminating (SIGTERM) 21:31:29.247985 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30244): Terminating (SIGTERM) 21:31:29.288773 --- ParallelTerminationStrategy: PID 30238 died... 21:31:29.308097 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30238): Terminated: ok {rc=0} 21:31:29.353377 --- ParallelTerminationStrategy: PID 30241 died... 21:31:29.372543 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30241): Terminated: ok {rc=0} 21:31:29.417866 --- ParallelTerminationStrategy: PID 30244 died... 21:31:29.437098 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30244): Terminated: ok {rc=0} 21:31:29.522881 bus /sierra_3: Setting Powered False 21:31:30.623940 bus /sierra_3: Setting Powered False 21:31:31.745348 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2382 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 21:31:32.897355 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:31:32.909584 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 21:31:32.976706 tst mo_mt_call_osmux.py: using LAC 31632 21:31:33.102479 tst mo_mt_call_osmux.py: using RAC 12 21:31:33.232216 tst mo_mt_call_osmux.py: using CellId 31632 21:31:33.358543 tst mo_mt_call_osmux.py: using BVCI 31633 21:31:33.485287 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:31:33.497567 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:31:33.509583 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:31:33.522075 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:31:33.534499 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:31:33.547175 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 21:31:33.672467 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 21:31:33.792723 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:31:34.325633 run create_hlr_db(pid=30247): Launched 21:31:34.456366 bus /sierra_2: Setting Powered False 21:31:35.524875 run create_hlr_db(pid=30247): Terminated: ok {rc=0} 21:31:35.982064 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30249): Launched 21:31:36.304862 run osmo-hlr_10.42.42.2(pid=30250): Launched 21:31:36.428674 run osmo-stp_10.42.42.5: Starting osmo-stp 21:31:36.993427 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30252): Launched 21:31:37.315205 run osmo-stp_10.42.42.5(pid=30253): Launched 21:31:37.438179 run osmo-msc_10.42.42.6: Starting osmo-msc 21:31:38.020409 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30255): Launched 21:31:38.344131 run osmo-msc_10.42.42.6(pid=30256): Launched 21:31:38.523451 run osmo-stp_10.42.42.5(pid=30253): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30253)] 21:31:38.658548 run osmo-stp_10.42.42.5(pid=30253): stdout: | (launched: 2022-12-12_21:31:37.254447) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:31:38.792734 run osmo-stp_10.42.42.5(pid=30253): stderr: | 20221212213137429 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213137429 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213137429 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213137430 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213137430 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213137430 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213137430 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:31:38.925464 run osmo-stp_10.42.42.5(pid=30253): stdout: | (launched: 2022-12-12_21:31:37.254447) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:31:39.052391 run osmo-stp_10.42.42.5(pid=30253): stderr: | 20221212213137429 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213137429 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213137429 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213137430 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213137430 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213137430 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213137430 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:31:39.205310 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30253): Process ended prematurely: osmo-stp_10.42.42.5(pid=30253) [trial-2382↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30253)] [trial-2382↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 21:31:39.214194 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 21:31:39.241502 run osmo-hlr_10.42.42.2(pid=30250): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30250)] 21:31:39.291146 run osmo-hlr_10.42.42.2(pid=30250): stdout: | (launched: 2022-12-12_21:31:36.244248) 21:31:39.342087 run osmo-hlr_10.42.42.2(pid=30250): stderr: | 20221212213136424 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212213136424 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212213136424 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212213136424 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212213136424 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212213136424 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212213136436 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212213136445 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212213136445 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212213136445 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:31:39.413333 run osmo-msc_10.42.42.6(pid=30256): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30256)] 21:31:39.462403 run osmo-msc_10.42.42.6(pid=30256): stdout: | (launched: 2022-12-12_21:31:38.283372) 21:31:39.513204 run osmo-msc_10.42.42.6(pid=30256): stderr: | 20221212213138560 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212213138561 DLGLOBAL DEBUG validating counter group 0x7fb259570c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212213138561 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212213138561 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212213138561 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212213138561 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212213138563 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212213138563 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212213138563 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212213138564 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:31:39.564239 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30249): Terminating (SIGTERM) 21:31:39.605098 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30252): Terminating (SIGTERM) 21:31:39.645976 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30255): Terminating (SIGTERM) 21:31:39.687034 --- ParallelTerminationStrategy: PID 30249 died... 21:31:39.707284 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30249): Terminated: ok {rc=0} 21:31:39.752806 --- ParallelTerminationStrategy: PID 30252 died... 21:31:39.772480 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30252): Terminated: ok {rc=0} 21:31:39.817746 --- ParallelTerminationStrategy: PID 30255 died... 21:31:39.837053 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30255): Terminated: ok {rc=0} 21:31:39.925260 bus /sierra_3: Setting Powered False 21:31:41.027983 bus /sierra_3: Setting Powered False 21:31:42.146581 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 21:31:43.400192 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:31:43.406970 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 21:31:43.436201 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 21:31:43.463070 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 21:31:43.516157 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 21:31:43.547345 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 21:31:43.575790 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 21:31:44.125968 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 21:31:44.177377 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:31:44.188715 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 21:31:44.254450 tst mo_mt_call.py: using LAC 31633 21:31:44.381069 tst mo_mt_call.py: using RAC 13 21:31:44.508182 tst mo_mt_call.py: using CellId 31633 21:31:44.636007 tst mo_mt_call.py: using BVCI 31634 21:31:44.753735 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:31:44.765295 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:31:44.776500 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:31:44.787905 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:31:44.799255 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:31:44.810627 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 21:31:44.928540 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 21:31:45.046573 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:31:45.544044 run create_hlr_db(pid=30261): Launched 21:31:45.675323 bus /sierra_2: Setting Powered False 21:31:46.737656 run create_hlr_db(pid=30261): Terminated: ok {rc=0} 21:31:47.189605 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30263): Launched 21:31:47.524711 run osmo-hlr_10.42.42.2(pid=30264): Launched 21:31:47.648437 run osmo-stp_10.42.42.5: Starting osmo-stp 21:31:48.197657 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30266): Launched 21:31:48.520368 run osmo-stp_10.42.42.5(pid=30267): Launched 21:31:48.645922 run osmo-msc_10.42.42.6: Starting osmo-msc 21:31:49.225484 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30269): Launched 21:31:49.551410 run osmo-msc_10.42.42.6(pid=30270): Launched 21:31:49.730396 run osmo-stp_10.42.42.5(pid=30267): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30267)] 21:31:49.864644 run osmo-stp_10.42.42.5(pid=30267): stdout: | (launched: 2022-12-12_21:31:48.459689) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:31:49.998821 run osmo-stp_10.42.42.5(pid=30267): stderr: | 20221212213148634 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213148634 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213148635 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213148635 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213148636 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213148636 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213148636 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:31:50.131715 run osmo-stp_10.42.42.5(pid=30267): stdout: | (launched: 2022-12-12_21:31:48.459689) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:31:50.258855 run osmo-stp_10.42.42.5(pid=30267): stderr: | 20221212213148634 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213148634 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213148635 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213148635 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213148636 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213148636 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213148636 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:31:50.411318 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30267): Process ended prematurely: osmo-stp_10.42.42.5(pid=30267) [trial-2382↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30267)] [trial-2382↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 21:31:50.420498 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 21:31:50.447931 run osmo-hlr_10.42.42.2(pid=30264): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30264)] 21:31:50.497253 run osmo-hlr_10.42.42.2(pid=30264): stdout: | (launched: 2022-12-12_21:31:47.463970) 21:31:50.547784 run osmo-hlr_10.42.42.2(pid=30264): stderr: | 20221212213147644 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212213147644 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212213147644 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212213147644 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212213147644 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212213147644 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212213147658 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212213147667 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212213147667 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212213147667 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:31:50.619486 run osmo-msc_10.42.42.6(pid=30270): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30270)] 21:31:50.668802 run osmo-msc_10.42.42.6(pid=30270): stdout: | (launched: 2022-12-12_21:31:49.490419) 21:31:50.719438 run osmo-msc_10.42.42.6(pid=30270): stderr: | 20221212213149768 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212213149768 DLGLOBAL DEBUG validating counter group 0x7f61b12d5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212213149768 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212213149769 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212213149769 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212213149769 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212213149771 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212213149771 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212213149771 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212213149771 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:31:50.770127 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30263): Terminating (SIGTERM) 21:31:50.810472 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30266): Terminating (SIGTERM) 21:31:50.850834 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30269): Terminating (SIGTERM) 21:31:50.891475 --- ParallelTerminationStrategy: PID 30263 died... 21:31:50.910716 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30263): Terminated: ok {rc=0} 21:31:50.955970 --- ParallelTerminationStrategy: PID 30266 died... 21:31:50.975241 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30266): Terminated: ok {rc=0} 21:31:51.020215 --- ParallelTerminationStrategy: PID 30269 died... 21:31:51.039246 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30269): Terminated: ok {rc=0} 21:31:51.127358 bus /sierra_3: Setting Powered False 21:31:52.230447 bus /sierra_3: Setting Powered False 21:31:53.345444 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2382 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 21:31:54.493674 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:31:54.506022 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 21:31:54.572483 tst mo_mt_call_osmux.py: using LAC 31634 21:31:54.698082 tst mo_mt_call_osmux.py: using RAC 14 21:31:54.824783 tst mo_mt_call_osmux.py: using CellId 31634 21:31:54.949603 tst mo_mt_call_osmux.py: using BVCI 31635 21:31:55.077167 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:31:55.089376 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:31:55.101354 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:31:55.113662 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:31:55.126129 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:31:55.138497 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 21:31:55.259061 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 21:31:55.379357 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:31:55.879780 run create_hlr_db(pid=30272): Launched 21:31:56.012383 bus /sierra_2: Setting Powered False 21:31:57.076725 run create_hlr_db(pid=30272): Terminated: ok {rc=0} 21:31:57.545094 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30274): Launched 21:31:57.891382 run osmo-hlr_10.42.42.2(pid=30275): Launched 21:31:58.023048 run osmo-stp_10.42.42.5: Starting osmo-stp 21:31:58.618738 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30277): Launched 21:31:58.964294 run osmo-stp_10.42.42.5(pid=30278): Launched 21:31:59.095019 run osmo-msc_10.42.42.6: Starting osmo-msc 21:31:59.719040 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30280): Launched 21:32:00.064916 run osmo-msc_10.42.42.6(pid=30281): Launched 21:32:00.256819 run osmo-stp_10.42.42.5(pid=30278): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30278)] 21:32:00.402656 run osmo-stp_10.42.42.5(pid=30278): stdout: | (launched: 2022-12-12_21:31:58.899869) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:32:00.548136 run osmo-stp_10.42.42.5(pid=30278): stderr: | 20221212213159099 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213159099 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213159099 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213159099 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213159100 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213159100 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213159100 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:32:00.692343 run osmo-stp_10.42.42.5(pid=30278): stdout: | (launched: 2022-12-12_21:31:58.899869) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:32:00.838290 run osmo-stp_10.42.42.5(pid=30278): stderr: | 20221212213159099 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213159099 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213159099 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213159099 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213159100 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213159100 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213159100 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:32:01.018764 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30278): Process ended prematurely: osmo-stp_10.42.42.5(pid=30278) [trial-2382↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30278)] [trial-2382↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 21:32:01.029718 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 21:32:01.060506 run osmo-hlr_10.42.42.2(pid=30275): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30275)] 21:32:01.114033 run osmo-hlr_10.42.42.2(pid=30275): stdout: | (launched: 2022-12-12_21:31:57.827129) 21:32:01.169370 run osmo-hlr_10.42.42.2(pid=30275): stderr: | 20221212213158030 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212213158030 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212213158030 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212213158030 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212213158030 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212213158030 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212213158043 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212213158054 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212213158054 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212213158054 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:32:01.246293 run osmo-msc_10.42.42.6(pid=30281): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30281)] 21:32:01.300443 run osmo-msc_10.42.42.6(pid=30281): stdout: | (launched: 2022-12-12_21:32:00.000194) 21:32:01.355805 run osmo-msc_10.42.42.6(pid=30281): stderr: | 20221212213200328 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212213200328 DLGLOBAL DEBUG validating counter group 0x7f2f9b120c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212213200329 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212213200329 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212213200329 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212213200329 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212213200331 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212213200331 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212213200331 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212213200331 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:32:01.411367 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30274): Terminating (SIGTERM) 21:32:01.457023 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30277): Terminating (SIGTERM) 21:32:01.503957 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30280): Terminating (SIGTERM) 21:32:01.551374 --- ParallelTerminationStrategy: PID 30274 died... 21:32:01.573124 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30274): Terminated: ok {rc=0} 21:32:01.624551 --- ParallelTerminationStrategy: PID 30277 died... 21:32:01.645664 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30277): Terminated: ok {rc=0} 21:32:01.695120 --- ParallelTerminationStrategy: PID 30280 died... 21:32:01.716282 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30280): Terminated: ok {rc=0} 21:32:01.809497 bus /sierra_3: Setting Powered False 21:32:02.914037 bus /sierra_3: Setting Powered False 21:32:04.035078 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 21:32:05.290136 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:32:05.297197 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 21:32:05.327270 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 21:32:05.354287 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 21:32:05.407077 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 21:32:05.436429 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 21:32:05.463477 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 21:32:06.015920 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 21:32:06.066869 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:32:06.078556 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 21:32:06.144652 tst mo_mt_call.py: using LAC 31635 21:32:06.273494 tst mo_mt_call.py: using RAC 15 21:32:06.401435 tst mo_mt_call.py: using CellId 31635 21:32:06.526381 tst mo_mt_call.py: using BVCI 31636 21:32:06.642248 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:32:06.653920 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:32:06.665295 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:32:06.676563 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:32:06.687967 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:32:06.699332 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 21:32:06.823958 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 21:32:06.943215 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:32:07.440703 run create_hlr_db(pid=30286): Launched 21:32:07.573825 bus /sierra_2: Setting Powered False 21:32:08.638136 run create_hlr_db(pid=30286): Terminated: ok {rc=0} 21:32:09.107668 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30288): Launched 21:32:09.457402 run osmo-hlr_10.42.42.2(pid=30289): Launched 21:32:09.592083 run osmo-stp_10.42.42.5: Starting osmo-stp 21:32:10.190029 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30291): Launched 21:32:10.536051 run osmo-stp_10.42.42.5(pid=30292): Launched 21:32:10.668085 run osmo-msc_10.42.42.6: Starting osmo-msc 21:32:11.293781 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30294): Launched 21:32:11.644331 run osmo-msc_10.42.42.6(pid=30295): Launched 21:32:11.837357 run osmo-stp_10.42.42.5(pid=30292): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30292)] 21:32:11.982455 run osmo-stp_10.42.42.5(pid=30292): stdout: | (launched: 2022-12-12_21:32:10.471721) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:32:12.127694 run osmo-stp_10.42.42.5(pid=30292): stderr: | 20221212213210670 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213210670 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213210671 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213210671 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213210671 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213210672 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213210672 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:32:12.271488 run osmo-stp_10.42.42.5(pid=30292): stdout: | (launched: 2022-12-12_21:32:10.471721) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:32:12.409489 run osmo-stp_10.42.42.5(pid=30292): stderr: | 20221212213210670 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213210670 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213210671 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213210671 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213210671 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213210672 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213210672 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:32:12.573875 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30292): Process ended prematurely: osmo-stp_10.42.42.5(pid=30292) [trial-2382↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30292)] [trial-2382↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 21:32:12.583734 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 21:32:12.613504 run osmo-hlr_10.42.42.2(pid=30289): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30289)] 21:32:12.665703 run osmo-hlr_10.42.42.2(pid=30289): stdout: | (launched: 2022-12-12_21:32:09.391971) 21:32:12.719550 run osmo-hlr_10.42.42.2(pid=30289): stderr: | 20221212213209597 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212213209597 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212213209597 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212213209597 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212213209597 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212213209598 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212213209613 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212213209622 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212213209622 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212213209622 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:32:12.794465 run osmo-msc_10.42.42.6(pid=30295): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30295)] 21:32:12.846360 run osmo-msc_10.42.42.6(pid=30295): stdout: | (launched: 2022-12-12_21:32:11.579366) 21:32:12.900022 run osmo-msc_10.42.42.6(pid=30295): stderr: | 20221212213211909 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212213211909 DLGLOBAL DEBUG validating counter group 0x7f6b6698ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212213211909 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212213211910 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212213211910 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212213211910 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212213211912 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212213211912 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212213211912 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212213211912 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:32:12.954087 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30288): Terminating (SIGTERM) 21:32:12.997589 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30291): Terminating (SIGTERM) 21:32:13.041509 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30294): Terminating (SIGTERM) 21:32:13.085550 --- ParallelTerminationStrategy: PID 30288 died... 21:32:13.106354 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30288): Terminated: ok {rc=0} 21:32:13.154783 --- ParallelTerminationStrategy: PID 30291 died... 21:32:13.175243 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30291): Terminated: ok {rc=0} 21:32:13.223905 --- ParallelTerminationStrategy: PID 30294 died... 21:32:13.244237 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30294): Terminated: ok {rc=0} 21:32:13.335013 bus /sierra_3: Setting Powered False 21:32:14.437040 bus /sierra_3: Setting Powered False 21:32:15.556330 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2382 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 21:32:16.706855 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:32:16.720032 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 21:32:16.789308 tst mo_mt_call_osmux.py: using LAC 31636 21:32:16.959860 tst mo_mt_call_osmux.py: using RAC 16 21:32:17.100767 tst mo_mt_call_osmux.py: using CellId 31636 21:32:17.239855 tst mo_mt_call_osmux.py: using BVCI 31637 21:32:17.373654 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:32:17.386024 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:32:17.398143 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:32:17.410844 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:32:17.423364 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:32:17.435693 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 21:32:17.559412 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 21:32:17.685196 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:32:18.221345 run create_hlr_db(pid=30297): Launched 21:32:18.354967 bus /sierra_2: Setting Powered False 21:32:19.422421 run create_hlr_db(pid=30297): Terminated: ok {rc=0} 21:32:19.900223 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30299): Launched 21:32:20.245593 run osmo-hlr_10.42.42.2(pid=30300): Launched 21:32:20.378408 run osmo-stp_10.42.42.5: Starting osmo-stp 21:32:20.971558 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30302): Launched 21:32:21.318202 run osmo-stp_10.42.42.5(pid=30303): Launched 21:32:21.450752 run osmo-msc_10.42.42.6: Starting osmo-msc 21:32:22.073701 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30305): Launched 21:32:22.422502 run osmo-msc_10.42.42.6(pid=30306): Launched 21:32:22.615078 run osmo-stp_10.42.42.5(pid=30303): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30303)] 21:32:22.758611 run osmo-stp_10.42.42.5(pid=30303): stdout: | (launched: 2022-12-12_21:32:21.253603) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:32:22.902928 run osmo-stp_10.42.42.5(pid=30303): stderr: | 20221212213221453 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213221453 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213221454 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213221454 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213221455 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213221455 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213221455 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:32:23.045265 run osmo-stp_10.42.42.5(pid=30303): stdout: | (launched: 2022-12-12_21:32:21.253603) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:32:23.182001 run osmo-stp_10.42.42.5(pid=30303): stderr: | 20221212213221453 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213221453 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213221454 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213221454 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213221455 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213221455 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213221455 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:32:23.345899 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30303): Process ended prematurely: osmo-stp_10.42.42.5(pid=30303) [trial-2382↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30303)] [trial-2382↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 21:32:23.355941 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 21:32:23.385987 run osmo-hlr_10.42.42.2(pid=30300): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30300)] 21:32:23.438075 run osmo-hlr_10.42.42.2(pid=30300): stdout: | (launched: 2022-12-12_21:32:20.181428) 21:32:23.491598 run osmo-hlr_10.42.42.2(pid=30300): stderr: | 20221212213220385 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212213220385 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212213220385 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212213220385 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212213220385 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212213220385 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212213220398 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212213220406 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212213220407 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212213220407 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:32:23.566493 run osmo-msc_10.42.42.6(pid=30306): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30306)] 21:32:23.618675 run osmo-msc_10.42.42.6(pid=30306): stdout: | (launched: 2022-12-12_21:32:22.357707) 21:32:23.672800 run osmo-msc_10.42.42.6(pid=30306): stderr: | 20221212213222688 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212213222688 DLGLOBAL DEBUG validating counter group 0x7f5c25b2fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212213222688 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212213222688 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212213222688 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212213222689 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212213222690 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212213222691 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212213222691 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212213222691 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:32:23.727254 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30299): Terminating (SIGTERM) 21:32:23.770523 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30302): Terminating (SIGTERM) 21:32:23.813825 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30305): Terminating (SIGTERM) 21:32:23.857776 --- ParallelTerminationStrategy: PID 30299 died... 21:32:23.878592 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30299): Terminated: ok {rc=0} 21:32:23.927217 --- ParallelTerminationStrategy: PID 30302 died... 21:32:23.947691 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30302): Terminated: ok {rc=0} 21:32:23.996104 --- ParallelTerminationStrategy: PID 30305 died... 21:32:24.016443 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30305): Terminated: ok {rc=0} 21:32:24.106868 bus /sierra_3: Setting Powered False 21:32:25.207985 bus /sierra_3: Setting Powered False 21:32:26.326174 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 21:32:27.576712 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:32:27.583230 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 21:32:27.612903 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 21:32:27.639777 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 21:32:27.695811 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 21:32:27.727881 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 21:32:27.756195 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 21:32:28.303237 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 21:32:28.355748 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:32:28.367242 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 21:32:28.437570 tst mo_mt_call.py: using LAC 31637 21:32:28.562824 tst mo_mt_call.py: using RAC 17 21:32:28.688427 tst mo_mt_call.py: using CellId 31637 21:32:28.814995 tst mo_mt_call.py: using BVCI 31638 21:32:28.932740 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:32:28.944523 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:32:28.955865 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:32:28.967155 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:32:28.978530 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:32:28.989804 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 21:32:29.112880 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 21:32:29.236110 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:32:29.771225 run create_hlr_db(pid=30311): Launched 21:32:29.905386 bus /sierra_2: Setting Powered False 21:32:30.969097 run create_hlr_db(pid=30311): Terminated: ok {rc=0} 21:32:31.435093 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30313): Launched 21:32:31.778642 run osmo-hlr_10.42.42.2(pid=30314): Launched 21:32:31.907148 run osmo-stp_10.42.42.5: Starting osmo-stp 21:32:32.697444 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30316): Launched 21:32:33.021666 run osmo-stp_10.42.42.5(pid=30317): Launched 21:32:33.144731 run osmo-msc_10.42.42.6: Starting osmo-msc 21:32:33.726882 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30319): Launched 21:32:34.050604 run osmo-msc_10.42.42.6(pid=30320): Launched 21:32:34.229666 run osmo-stp_10.42.42.5(pid=30317): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30317)] 21:32:34.364219 run osmo-stp_10.42.42.5(pid=30317): stdout: | (launched: 2022-12-12_21:32:32.960793) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:32:34.498338 run osmo-stp_10.42.42.5(pid=30317): stderr: | 20221212213233137 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213233137 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213233138 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213233138 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213233139 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213233139 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213233139 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:32:34.630777 run osmo-stp_10.42.42.5(pid=30317): stdout: | (launched: 2022-12-12_21:32:32.960793) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:32:34.757675 run osmo-stp_10.42.42.5(pid=30317): stderr: | 20221212213233137 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213233137 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213233138 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213233138 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213233139 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213233139 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213233139 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:32:34.910185 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30317): Process ended prematurely: osmo-stp_10.42.42.5(pid=30317) [trial-2382↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30317)] [trial-2382↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 21:32:34.919152 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 21:32:34.946388 run osmo-hlr_10.42.42.2(pid=30314): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30314)] 21:32:34.995412 run osmo-hlr_10.42.42.2(pid=30314): stdout: | (launched: 2022-12-12_21:32:31.716647) 21:32:35.046063 run osmo-hlr_10.42.42.2(pid=30314): stderr: | 20221212213232140 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212213232141 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212213232141 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212213232141 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212213232141 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212213232141 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212213232153 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212213232162 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212213232162 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212213232162 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:32:35.117479 run osmo-msc_10.42.42.6(pid=30320): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30320)] 21:32:35.166362 run osmo-msc_10.42.42.6(pid=30320): stdout: | (launched: 2022-12-12_21:32:33.989267) 21:32:35.217274 run osmo-msc_10.42.42.6(pid=30320): stderr: | 20221212213234267 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212213234267 DLGLOBAL DEBUG validating counter group 0x7f7311a1fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212213234268 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212213234268 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212213234268 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212213234268 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212213234270 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212213234270 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212213234270 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212213234270 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:32:35.268072 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30313): Terminating (SIGTERM) 21:32:35.308865 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30316): Terminating (SIGTERM) 21:32:35.349847 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30319): Terminating (SIGTERM) 21:32:35.390954 --- ParallelTerminationStrategy: PID 30313 died... 21:32:35.410606 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30313): Terminated: ok {rc=0} 21:32:35.455808 --- ParallelTerminationStrategy: PID 30316 died... 21:32:35.474958 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30316): Terminated: ok {rc=0} 21:32:35.519992 --- ParallelTerminationStrategy: PID 30319 died... 21:32:35.539156 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30319): Terminated: ok {rc=0} 21:32:35.625564 bus /sierra_3: Setting Powered False 21:32:36.725718 bus /sierra_3: Setting Powered False 21:32:37.848059 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2382 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 21:32:39.000015 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:32:39.012316 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 21:32:39.079260 tst mo_mt_call_osmux.py: using LAC 31638 21:32:39.205883 tst mo_mt_call_osmux.py: using RAC 18 21:32:39.337108 tst mo_mt_call_osmux.py: using CellId 31638 21:32:39.462412 tst mo_mt_call_osmux.py: using BVCI 31639 21:32:39.588606 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:32:39.600858 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:32:39.612910 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:32:39.625246 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:32:39.638306 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:32:39.650586 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 21:32:39.772132 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 21:32:39.891456 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:32:40.389916 run create_hlr_db(pid=30322): Launched 21:32:40.522686 bus /sierra_2: Setting Powered False 21:32:41.586243 run create_hlr_db(pid=30322): Terminated: ok {rc=0} 21:32:42.054123 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30324): Launched 21:32:42.401665 run osmo-hlr_10.42.42.2(pid=30325): Launched 21:32:42.533127 run osmo-stp_10.42.42.5: Starting osmo-stp 21:32:43.130815 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30327): Launched 21:32:43.479643 run osmo-stp_10.42.42.5(pid=30328): Launched 21:32:43.611419 run osmo-msc_10.42.42.6: Starting osmo-msc 21:32:44.235230 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30330): Launched 21:32:44.581636 run osmo-msc_10.42.42.6(pid=30331): Launched 21:32:44.775023 run osmo-stp_10.42.42.5(pid=30328): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30328)] 21:32:44.919637 run osmo-stp_10.42.42.5(pid=30328): stdout: | (launched: 2022-12-12_21:32:43.414934) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:32:45.064764 run osmo-stp_10.42.42.5(pid=30328): stderr: | 20221212213243613 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213243613 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213243613 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213243614 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213243614 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213243614 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213243614 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:32:45.207527 run osmo-stp_10.42.42.5(pid=30328): stdout: | (launched: 2022-12-12_21:32:43.414934) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:32:45.344663 run osmo-stp_10.42.42.5(pid=30328): stderr: | 20221212213243613 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213243613 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213243613 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213243614 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213243614 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213243614 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213243614 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:32:45.508500 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30328): Process ended prematurely: osmo-stp_10.42.42.5(pid=30328) [trial-2382↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30328)] [trial-2382↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 21:32:45.518519 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 21:32:45.548115 run osmo-hlr_10.42.42.2(pid=30325): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30325)] 21:32:45.600579 run osmo-hlr_10.42.42.2(pid=30325): stdout: | (launched: 2022-12-12_21:32:42.337034) 21:32:45.654688 run osmo-hlr_10.42.42.2(pid=30325): stderr: | 20221212213242542 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212213242543 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212213242543 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212213242543 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212213242543 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212213242543 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212213242555 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212213242564 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212213242564 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212213242564 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:32:45.729917 run osmo-msc_10.42.42.6(pid=30331): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30331)] 21:32:45.782233 run osmo-msc_10.42.42.6(pid=30331): stdout: | (launched: 2022-12-12_21:32:44.516864) 21:32:45.841089 run osmo-msc_10.42.42.6(pid=30331): stderr: | 20221212213244846 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212213244846 DLGLOBAL DEBUG validating counter group 0x7f0051776c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212213244846 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212213244846 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212213244846 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212213244846 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212213244848 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212213244849 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212213244849 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212213244849 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:32:45.912296 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30324): Terminating (SIGTERM) 21:32:45.961915 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30327): Terminating (SIGTERM) 21:32:46.008016 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30330): Terminating (SIGTERM) 21:32:46.055387 --- ParallelTerminationStrategy: PID 30324 died... 21:32:46.076841 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30324): Terminated: ok {rc=0} 21:32:46.128256 --- ParallelTerminationStrategy: PID 30327 died... 21:32:46.148919 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30327): Terminated: ok {rc=0} 21:32:46.198525 --- ParallelTerminationStrategy: PID 30330 died... 21:32:46.219353 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30330): Terminated: ok {rc=0} 21:32:46.312036 bus /sierra_3: Setting Powered False 21:32:47.414373 bus /sierra_3: Setting Powered False 21:32:48.533046 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 21:32:49.787827 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:32:49.795304 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 21:32:49.826932 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 21:32:49.855447 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 21:32:49.910405 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 21:32:49.940776 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 21:32:49.968394 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 21:32:50.526918 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 21:32:50.582502 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:32:50.594384 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 21:32:50.662968 tst mo_mt_call.py: using LAC 31639 21:32:50.798824 tst mo_mt_call.py: using RAC 19 21:32:50.928313 tst mo_mt_call.py: using CellId 31639 21:32:51.056409 tst mo_mt_call.py: using BVCI 31640 21:32:51.175495 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:32:51.187210 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:32:51.198632 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:32:51.210710 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:32:51.222861 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:32:51.234888 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 21:32:51.359481 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 21:32:51.481053 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:32:51.980520 run create_hlr_db(pid=30336): Launched 21:32:52.112547 bus /sierra_2: Setting Powered False 21:32:53.176461 run create_hlr_db(pid=30336): Terminated: ok {rc=0} 21:32:53.644343 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30338): Launched 21:32:53.991234 run osmo-hlr_10.42.42.2(pid=30339): Launched 21:32:54.122179 run osmo-stp_10.42.42.5: Starting osmo-stp 21:32:54.715333 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30341): Launched 21:32:55.060015 run osmo-stp_10.42.42.5(pid=30342): Launched 21:32:55.191171 run osmo-msc_10.42.42.6: Starting osmo-msc 21:32:55.813258 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30344): Launched 21:32:56.159176 run osmo-msc_10.42.42.6(pid=30345): Launched 21:32:56.351490 run osmo-stp_10.42.42.5(pid=30342): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30342)] 21:32:56.495774 run osmo-stp_10.42.42.5(pid=30342): stdout: | (launched: 2022-12-12_21:32:54.995472) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:32:56.640829 run osmo-stp_10.42.42.5(pid=30342): stderr: | 20221212213255191 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213255191 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213255192 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213255192 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213255192 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213255193 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213255193 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:32:56.783645 run osmo-stp_10.42.42.5(pid=30342): stdout: | (launched: 2022-12-12_21:32:54.995472) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:32:56.920003 run osmo-stp_10.42.42.5(pid=30342): stderr: | 20221212213255191 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213255191 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213255192 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213255192 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213255192 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213255193 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213255193 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:32:57.083225 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30342): Process ended prematurely: osmo-stp_10.42.42.5(pid=30342) [trial-2382↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30342)] [trial-2382↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 21:32:57.093242 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 21:32:57.122729 run osmo-hlr_10.42.42.2(pid=30339): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30339)] 21:32:57.174471 run osmo-hlr_10.42.42.2(pid=30339): stdout: | (launched: 2022-12-12_21:32:53.926568) 21:32:57.227700 run osmo-hlr_10.42.42.2(pid=30339): stderr: | 20221212213254129 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212213254129 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212213254129 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212213254130 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212213254130 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212213254130 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212213254143 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212213254153 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212213254154 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212213254154 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:32:57.302361 run osmo-msc_10.42.42.6(pid=30345): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30345)] 21:32:57.353940 run osmo-msc_10.42.42.6(pid=30345): stdout: | (launched: 2022-12-12_21:32:56.094474) 21:32:57.407134 run osmo-msc_10.42.42.6(pid=30345): stderr: | 20221212213256421 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212213256421 DLGLOBAL DEBUG validating counter group 0x7ff4c59cfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212213256421 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212213256421 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212213256421 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212213256421 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212213256423 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212213256423 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212213256424 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212213256424 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:32:57.461137 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30338): Terminating (SIGTERM) 21:32:57.504477 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30341): Terminating (SIGTERM) 21:32:57.547802 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30344): Terminating (SIGTERM) 21:32:57.591561 --- ParallelTerminationStrategy: PID 30338 died... 21:32:57.612155 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30338): Terminated: ok {rc=0} 21:32:57.660360 --- ParallelTerminationStrategy: PID 30341 died... 21:32:57.680659 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30341): Terminated: ok {rc=0} 21:32:57.728516 --- ParallelTerminationStrategy: PID 30344 died... 21:32:57.748728 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30344): Terminated: ok {rc=0} 21:32:57.839656 bus /sierra_3: Setting Powered False 21:32:58.941358 bus /sierra_3: Setting Powered False 21:33:00.060133 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2382 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 21:33:01.233371 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:33:01.250068 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 21:33:01.344822 tst mo_mt_call_osmux.py: using LAC 31640 21:33:01.482854 tst mo_mt_call_osmux.py: using RAC 20 21:33:01.647070 tst mo_mt_call_osmux.py: using CellId 31640 21:33:01.800473 tst mo_mt_call_osmux.py: using BVCI 31641 21:33:01.933129 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:33:01.946533 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:33:01.960805 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:33:01.975113 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:33:01.988153 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:33:02.002124 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 21:33:02.134439 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 21:33:02.260840 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:33:02.795978 run create_hlr_db(pid=30348): Launched 21:33:02.927272 bus /sierra_2: Setting Powered False 21:33:03.995485 run create_hlr_db(pid=30348): Terminated: ok {rc=0} 21:33:04.472578 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30350): Launched 21:33:04.817776 run osmo-hlr_10.42.42.2(pid=30351): Launched 21:33:04.949400 run osmo-stp_10.42.42.5: Starting osmo-stp 21:33:05.541183 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30353): Launched 21:33:05.886009 run osmo-stp_10.42.42.5(pid=30354): Launched 21:33:06.020069 run osmo-msc_10.42.42.6: Starting osmo-msc 21:33:06.642476 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30356): Launched 21:33:06.989824 run osmo-msc_10.42.42.6(pid=30357): Launched 21:33:07.182011 run osmo-stp_10.42.42.5(pid=30354): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30354)] 21:33:07.326936 run osmo-stp_10.42.42.5(pid=30354): stdout: | (launched: 2022-12-12_21:33:05.821677) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:33:07.471951 run osmo-stp_10.42.42.5(pid=30354): stderr: | 20221212213306017 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213306018 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213306018 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213306018 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213306019 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213306019 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213306019 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:33:07.615055 run osmo-stp_10.42.42.5(pid=30354): stdout: | (launched: 2022-12-12_21:33:05.821677) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:33:07.751695 run osmo-stp_10.42.42.5(pid=30354): stderr: | 20221212213306017 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213306018 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213306018 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213306018 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213306019 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213306019 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213306019 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:33:07.914901 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30354): Process ended prematurely: osmo-stp_10.42.42.5(pid=30354) [trial-2382↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30354)] [trial-2382↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 21:33:07.924721 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 21:33:07.954302 run osmo-hlr_10.42.42.2(pid=30351): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30351)] 21:33:08.006908 run osmo-hlr_10.42.42.2(pid=30351): stdout: | (launched: 2022-12-12_21:33:04.753377) 21:33:08.060542 run osmo-hlr_10.42.42.2(pid=30351): stderr: | 20221212213304958 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212213304958 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212213304958 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212213304958 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212213304958 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212213304959 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212213304971 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212213304980 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212213304980 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212213304980 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:33:08.135521 run osmo-msc_10.42.42.6(pid=30357): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30357)] 21:33:08.187402 run osmo-msc_10.42.42.6(pid=30357): stdout: | (launched: 2022-12-12_21:33:06.925225) 21:33:08.241131 run osmo-msc_10.42.42.6(pid=30357): stderr: | 20221212213307251 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212213307251 DLGLOBAL DEBUG validating counter group 0x7f0f21856c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212213307251 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212213307251 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212213307251 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212213307252 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212213307253 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212213307254 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212213307254 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212213307254 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:33:08.294995 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30350): Terminating (SIGTERM) 21:33:08.338646 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30353): Terminating (SIGTERM) 21:33:08.382162 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30356): Terminating (SIGTERM) 21:33:08.425834 --- ParallelTerminationStrategy: PID 30350 died... 21:33:08.446610 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30350): Terminated: ok {rc=0} 21:33:08.495157 --- ParallelTerminationStrategy: PID 30353 died... 21:33:08.515413 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30353): Terminated: ok {rc=0} 21:33:08.563351 --- ParallelTerminationStrategy: PID 30356 died... 21:33:08.583602 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30356): Terminated: ok {rc=0} 21:33:08.674692 bus /sierra_3: Setting Powered False 21:33:09.775806 bus /sierra_3: Setting Powered False 21:33:10.894677 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 21:33:12.148633 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:33:12.156181 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 21:33:12.187616 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 21:33:12.215519 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 21:33:12.272261 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 21:33:12.302810 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 21:33:12.329841 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 21:33:12.884230 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 21:33:12.938862 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:33:12.950603 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 21:33:13.018532 tst mo_mt_call.py: using LAC 31641 21:33:13.147528 tst mo_mt_call.py: using RAC 21 21:33:13.274348 tst mo_mt_call.py: using CellId 31641 21:33:13.402746 tst mo_mt_call.py: using BVCI 31642 21:33:13.518450 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:33:13.530202 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:33:13.541690 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:33:13.553175 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:33:13.564842 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:33:13.576331 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:33:13.699357 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:33:13.817659 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:33:14.318277 run create_hlr_db(pid=30362): Launched 21:33:14.452719 bus /sierra_2: Setting Powered False 21:33:15.517161 run create_hlr_db(pid=30362): Terminated: ok {rc=0} 21:33:16.012048 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30364): Launched 21:33:16.389854 run osmo-hlr_10.42.42.2(pid=30365): Launched 21:33:16.644153 run osmo-stp_10.42.42.5: Starting osmo-stp 21:33:17.398216 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30367): Launched 21:33:17.723172 run osmo-stp_10.42.42.5(pid=30368): Launched 21:33:17.846785 run osmo-msc_10.42.42.6: Starting osmo-msc 21:33:18.428202 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30370): Launched 21:33:18.752116 run osmo-msc_10.42.42.6(pid=30371): Launched 21:33:18.934094 run osmo-stp_10.42.42.5(pid=30368): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30368)] 21:33:19.070383 run osmo-stp_10.42.42.5(pid=30368): stdout: | (launched: 2022-12-12_21:33:17.662000) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:33:19.204284 run osmo-stp_10.42.42.5(pid=30368): stderr: | 20221212213317838 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213317838 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213317839 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213317839 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213317839 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213317840 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213317840 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:33:19.337476 run osmo-stp_10.42.42.5(pid=30368): stdout: | (launched: 2022-12-12_21:33:17.662000) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:33:19.464875 run osmo-stp_10.42.42.5(pid=30368): stderr: | 20221212213317838 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213317838 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213317839 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213317839 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213317839 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213317840 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213317840 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:33:19.617963 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30368): Process ended prematurely: osmo-stp_10.42.42.5(pid=30368) [trial-2382↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30368)] [trial-2382↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 21:33:19.627079 tst mo_mt_call.py:8: Test FAILED (6.7 sec) 21:33:19.654607 run osmo-hlr_10.42.42.2(pid=30365): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30365)] 21:33:19.704738 run osmo-hlr_10.42.42.2(pid=30365): stdout: | (launched: 2022-12-12_21:33:16.324841) 21:33:19.755966 run osmo-hlr_10.42.42.2(pid=30365): stderr: | 20221212213316593 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212213316593 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212213316594 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212213316594 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212213316594 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212213316594 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212213316610 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212213316627 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212213316627 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212213316627 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:33:19.828100 run osmo-msc_10.42.42.6(pid=30371): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30371)] 21:33:19.877728 run osmo-msc_10.42.42.6(pid=30371): stdout: | (launched: 2022-12-12_21:33:18.691220) 21:33:19.929178 run osmo-msc_10.42.42.6(pid=30371): stderr: | 20221212213318971 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212213318971 DLGLOBAL DEBUG validating counter group 0x7f46fd47cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212213318971 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212213318971 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212213318972 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212213318972 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212213318974 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212213318974 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212213318974 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212213318974 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:33:19.981039 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30364): Terminating (SIGTERM) 21:33:20.022062 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30367): Terminating (SIGTERM) 21:33:20.063083 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30370): Terminating (SIGTERM) 21:33:20.105163 --- ParallelTerminationStrategy: PID 30364 died... 21:33:20.125130 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30364): Terminated: ok {rc=0} 21:33:20.170918 --- ParallelTerminationStrategy: PID 30367 died... 21:33:20.190433 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30367): Terminated: ok {rc=0} 21:33:20.236006 --- ParallelTerminationStrategy: PID 30370 died... 21:33:20.255364 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30370): Terminated: ok {rc=0} 21:33:20.344853 bus /sierra_3: Setting Powered False 21:33:21.449064 bus /sierra_3: Setting Powered False 21:33:22.568338 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2382 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 21:33:23.723286 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:33:23.735636 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 21:33:23.803137 tst mo_mt_call_osmux.py: using LAC 31642 21:33:23.931231 tst mo_mt_call_osmux.py: using RAC 22 21:33:24.056775 tst mo_mt_call_osmux.py: using CellId 31642 21:33:24.183653 tst mo_mt_call_osmux.py: using BVCI 31643 21:33:24.310364 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:33:24.322578 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:33:24.334964 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:33:24.347204 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:33:24.359747 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:33:24.371929 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:33:24.497915 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:33:24.623349 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:33:25.120390 run create_hlr_db(pid=30373): Launched 21:33:25.253622 bus /sierra_2: Setting Powered False 21:33:26.317893 run create_hlr_db(pid=30373): Terminated: ok {rc=0} 21:33:26.763869 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30375): Launched 21:33:27.088374 run osmo-hlr_10.42.42.2(pid=30376): Launched 21:33:27.211390 run osmo-stp_10.42.42.5: Starting osmo-stp 21:33:27.778001 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30378): Launched 21:33:28.101693 run osmo-stp_10.42.42.5(pid=30379): Launched 21:33:28.223985 run osmo-msc_10.42.42.6: Starting osmo-msc 21:33:28.804023 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30381): Launched 21:33:29.127521 run osmo-msc_10.42.42.6(pid=30382): Launched 21:33:29.308381 run osmo-stp_10.42.42.5(pid=30379): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30379)] 21:33:29.452199 run osmo-stp_10.42.42.5(pid=30379): stdout: | (launched: 2022-12-12_21:33:28.040794) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:33:29.600830 run osmo-stp_10.42.42.5(pid=30379): stderr: | 20221212213328216 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213328216 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213328216 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213328217 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213328217 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213328217 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213328217 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:33:29.744413 run osmo-stp_10.42.42.5(pid=30379): stdout: | (launched: 2022-12-12_21:33:28.040794) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:33:29.882234 run osmo-stp_10.42.42.5(pid=30379): stderr: | 20221212213328216 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213328216 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213328216 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213328217 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213328217 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213328217 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213328217 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:33:30.046688 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30379): Process ended prematurely: osmo-stp_10.42.42.5(pid=30379) [trial-2382↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30379)] [trial-2382↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 21:33:30.056697 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 21:33:30.086489 run osmo-hlr_10.42.42.2(pid=30376): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30376)] 21:33:30.138966 run osmo-hlr_10.42.42.2(pid=30376): stdout: | (launched: 2022-12-12_21:33:27.027238) 21:33:30.193409 run osmo-hlr_10.42.42.2(pid=30376): stderr: | 20221212213327208 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212213327208 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212213327208 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212213327208 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212213327208 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212213327208 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212213327220 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212213327228 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212213327228 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212213327228 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:33:30.269299 run osmo-msc_10.42.42.6(pid=30382): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30382)] 21:33:30.321834 run osmo-msc_10.42.42.6(pid=30382): stdout: | (launched: 2022-12-12_21:33:29.066535) 21:33:30.375859 run osmo-msc_10.42.42.6(pid=30382): stderr: | 20221212213329363 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212213329363 DLGLOBAL DEBUG validating counter group 0x7f990549fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212213329363 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212213329363 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212213329363 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212213329363 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212213329367 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212213329367 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212213329367 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212213329367 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:33:30.430012 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30375): Terminating (SIGTERM) 21:33:30.473819 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30378): Terminating (SIGTERM) 21:33:30.517345 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30381): Terminating (SIGTERM) 21:33:30.561281 --- ParallelTerminationStrategy: PID 30375 died... 21:33:30.582195 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30375): Terminated: ok {rc=0} 21:33:30.630919 --- ParallelTerminationStrategy: PID 30378 died... 21:33:30.651302 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30378): Terminated: ok {rc=0} 21:33:30.699648 --- ParallelTerminationStrategy: PID 30381 died... 21:33:30.719943 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30381): Terminated: ok {rc=0} 21:33:30.811467 bus /sierra_3: Setting Powered False 21:33:31.933422 bus /sierra_3: Setting Powered False 21:33:33.055863 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 21:33:34.313030 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:33:34.319573 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 21:33:34.349408 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 21:33:34.376131 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 21:33:34.428060 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 21:33:34.457488 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 21:33:34.484221 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 21:33:35.035477 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 21:33:35.086719 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:33:35.098137 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 21:33:35.164292 tst mo_mt_call.py: using LAC 31643 21:33:35.289696 tst mo_mt_call.py: using RAC 23 21:33:35.414624 tst mo_mt_call.py: using CellId 31643 21:33:35.544241 tst mo_mt_call.py: using BVCI 31644 21:33:35.661850 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:33:35.673302 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:33:35.684305 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:33:35.695346 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:33:35.706554 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:33:35.717660 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 21:33:35.840073 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 21:33:35.961516 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:33:36.460535 run create_hlr_db(pid=30388): Launched 21:33:36.592582 bus /sierra_2: Setting Powered False 21:33:37.656600 run create_hlr_db(pid=30388): Terminated: ok {rc=0} 21:33:38.101701 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30390): Launched 21:33:38.426355 run osmo-hlr_10.42.42.2(pid=30391): Launched 21:33:38.547679 run osmo-stp_10.42.42.5: Starting osmo-stp 21:33:39.116221 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30393): Launched 21:33:39.440123 run osmo-stp_10.42.42.5(pid=30394): Launched 21:33:39.563338 run osmo-msc_10.42.42.6: Starting osmo-msc 21:33:40.143968 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30396): Launched 21:33:40.469402 run osmo-msc_10.42.42.6(pid=30397): Launched 21:33:40.650165 run osmo-stp_10.42.42.5(pid=30394): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30394)] 21:33:40.787183 run osmo-stp_10.42.42.5(pid=30394): stdout: | (launched: 2022-12-12_21:33:39.379509) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:33:40.922541 run osmo-stp_10.42.42.5(pid=30394): stderr: | 20221212213339558 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213339558 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213339558 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213339559 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213339559 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213339559 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213339559 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:33:41.055944 run osmo-stp_10.42.42.5(pid=30394): stdout: | (launched: 2022-12-12_21:33:39.379509) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:33:41.184147 run osmo-stp_10.42.42.5(pid=30394): stderr: | 20221212213339558 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213339558 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213339558 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213339559 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213339559 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213339559 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213339559 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:33:41.337987 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30394): Process ended prematurely: osmo-stp_10.42.42.5(pid=30394) [trial-2382↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30394)] [trial-2382↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 21:33:41.347085 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 21:33:41.374450 run osmo-hlr_10.42.42.2(pid=30391): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30391)] 21:33:41.423253 run osmo-hlr_10.42.42.2(pid=30391): stdout: | (launched: 2022-12-12_21:33:38.365677) 21:33:41.474081 run osmo-hlr_10.42.42.2(pid=30391): stderr: | 20221212213338549 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212213338549 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212213338549 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212213338549 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212213338549 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212213338549 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212213338561 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212213338570 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212213338570 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212213338570 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:33:41.545240 run osmo-msc_10.42.42.6(pid=30397): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30397)] 21:33:41.594335 run osmo-msc_10.42.42.6(pid=30397): stdout: | (launched: 2022-12-12_21:33:40.408394) 21:33:41.644929 run osmo-msc_10.42.42.6(pid=30397): stderr: | 20221212213340684 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212213340685 DLGLOBAL DEBUG validating counter group 0x7f8ec9891c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212213340685 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212213340685 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212213340685 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212213340685 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212213340688 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212213340689 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212213340689 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212213340689 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:33:41.695871 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30390): Terminating (SIGTERM) 21:33:41.736717 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30393): Terminating (SIGTERM) 21:33:41.777544 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30396): Terminating (SIGTERM) 21:33:41.818840 --- ParallelTerminationStrategy: PID 30390 died... 21:33:41.838539 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30390): Terminated: ok {rc=0} 21:33:41.884180 --- ParallelTerminationStrategy: PID 30393 died... 21:33:41.903415 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30393): Terminated: ok {rc=0} 21:33:41.949379 --- ParallelTerminationStrategy: PID 30396 died... 21:33:41.968549 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30396): Terminated: ok {rc=0} 21:33:42.054650 bus /sierra_3: Setting Powered False 21:33:43.155622 bus /sierra_3: Setting Powered False 21:33:44.276409 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2382 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 21:33:45.431936 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:33:45.444777 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 21:33:45.513926 tst mo_mt_call_osmux.py: using LAC 31644 21:33:45.649439 tst mo_mt_call_osmux.py: using RAC 24 21:33:45.785209 tst mo_mt_call_osmux.py: using CellId 31644 21:33:45.938548 tst mo_mt_call_osmux.py: using BVCI 31645 21:33:46.066288 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:33:46.079387 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:33:46.092325 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:33:46.106049 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:33:46.119486 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:33:46.134325 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 21:33:46.260555 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 21:33:46.418671 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:33:46.978296 run create_hlr_db(pid=30399): Launched 21:33:47.149477 bus /sierra_2: Setting Powered False 21:33:48.217855 run create_hlr_db(pid=30399): Terminated: ok {rc=0} 21:33:48.676316 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30401): Launched 21:33:49.002398 run osmo-hlr_10.42.42.2(pid=30402): Launched 21:33:49.125543 run osmo-stp_10.42.42.5: Starting osmo-stp 21:33:49.680427 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30404): Launched 21:33:50.003041 run osmo-stp_10.42.42.5(pid=30405): Launched 21:33:50.125159 run osmo-msc_10.42.42.6: Starting osmo-msc 21:33:50.705243 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30407): Launched 21:33:51.028772 run osmo-msc_10.42.42.6(pid=30408): Launched 21:33:51.209808 run osmo-stp_10.42.42.5(pid=30405): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30405)] 21:33:51.345260 run osmo-stp_10.42.42.5(pid=30405): stdout: | (launched: 2022-12-12_21:33:49.942532) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:33:51.479575 run osmo-stp_10.42.42.5(pid=30405): stderr: | 20221212213350119 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213350119 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213350119 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213350120 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213350120 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213350120 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213350120 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:33:51.612716 run osmo-stp_10.42.42.5(pid=30405): stdout: | (launched: 2022-12-12_21:33:49.942532) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:33:51.740213 run osmo-stp_10.42.42.5(pid=30405): stderr: | 20221212213350119 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213350119 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213350119 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213350120 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213350120 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213350120 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213350120 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:33:51.892772 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30405): Process ended prematurely: osmo-stp_10.42.42.5(pid=30405) [trial-2382↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30405)] [trial-2382↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 21:33:51.902277 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 21:33:51.929635 run osmo-hlr_10.42.42.2(pid=30402): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30402)] 21:33:51.978742 run osmo-hlr_10.42.42.2(pid=30402): stdout: | (launched: 2022-12-12_21:33:48.941753) 21:33:52.029687 run osmo-hlr_10.42.42.2(pid=30402): stderr: | 20221212213349124 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212213349124 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212213349124 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212213349125 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212213349125 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212213349125 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212213349136 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212213349145 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212213349145 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212213349145 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:33:52.101235 run osmo-msc_10.42.42.6(pid=30408): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30408)] 21:33:52.150376 run osmo-msc_10.42.42.6(pid=30408): stdout: | (launched: 2022-12-12_21:33:50.968260) 21:33:52.201339 run osmo-msc_10.42.42.6(pid=30408): stderr: | 20221212213351244 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212213351244 DLGLOBAL DEBUG validating counter group 0x7fe7605e2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212213351244 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212213351244 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212213351244 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212213351244 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212213351246 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212213351246 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212213351247 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212213351247 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:33:52.252477 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30401): Terminating (SIGTERM) 21:33:52.293367 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30404): Terminating (SIGTERM) 21:33:52.334439 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30407): Terminating (SIGTERM) 21:33:52.375853 --- ParallelTerminationStrategy: PID 30401 died... 21:33:52.395659 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30401): Terminated: ok {rc=0} 21:33:52.441239 --- ParallelTerminationStrategy: PID 30404 died... 21:33:52.460409 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30404): Terminated: ok {rc=0} 21:33:52.505770 --- ParallelTerminationStrategy: PID 30407 died... 21:33:52.525113 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30407): Terminated: ok {rc=0} 21:33:52.612860 bus /sierra_3: Setting Powered False 21:33:53.716625 bus /sierra_3: Setting Powered False 21:33:54.836703 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 emergency:trx-lms-limenet-micro --------------------------------------------------------------------- 21:33:56.088404 tst emergency:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:33:56.093413 tst emergency:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 21:33:56.125148 tst emergency:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 21:33:56.153163 tst emergency:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 21:33:56.240601 tst emergency:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 21:33:56.270860 tst emergency:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 21:33:56.299036 tst emergency:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 21:33:56.887773 tst emergency:trx-lms-limenet-micro: RESERVED RESOURCES for emergency: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2382 emergency:trx-lms-limenet-micro emergency_mo_mt_call.py ---------------------------------------------- 21:33:56.893197 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:33:56.904604 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 21:33:56.954538 tst emergency_mo_mt_call.py: using LAC 31645 21:33:57.089755 tst emergency_mo_mt_call.py: using RAC 25 21:33:57.220858 tst emergency_mo_mt_call.py: using CellId 31645 21:33:57.351616 tst emergency_mo_mt_call.py: using BVCI 31646 21:33:57.466459 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:33:57.478021 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:33:57.488932 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:33:57.500348 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:33:57.511425 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:33:57.522439 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 21:33:57.646690 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 21:33:57.765961 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:33:58.256087 run create_hlr_db(pid=30414): Launched 21:33:58.387503 bus /sierra_2: Setting Powered False 21:33:59.450129 run create_hlr_db(pid=30414): Terminated: ok {rc=0} 21:33:59.912161 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30416): Launched 21:34:00.252860 run osmo-hlr_10.42.42.2(pid=30417): Launched 21:34:00.385291 run osmo-stp_10.42.42.5: Starting osmo-stp 21:34:00.985790 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30419): Launched 21:34:01.334286 run osmo-stp_10.42.42.5(pid=30420): Launched 21:34:01.651907 tst emergency_mo_mt_call.py: using MSISDN 7977 21:34:01.894559 run osmo-msc_10.42.42.6: Starting osmo-msc 21:34:02.506858 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30422): Launched 21:34:02.846961 run osmo-msc_10.42.42.6(pid=30423): Launched 21:34:03.035248 run osmo-stp_10.42.42.5(pid=30420): ERR: Terminated: ERROR {rc=1} [trial-2382↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30420)] 21:34:03.177292 run osmo-stp_10.42.42.5(pid=30420): stdout: | (launched: 2022-12-12_21:34:01.272699) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:34:03.320209 run osmo-stp_10.42.42.5(pid=30420): stderr: | 20221212213401574 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213401575 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213401575 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213401575 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213401576 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213401576 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213401576 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:34:03.462166 run osmo-stp_10.42.42.5(pid=30420): stdout: | (launched: 2022-12-12_21:34:01.272699) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:34:03.596037 run osmo-stp_10.42.42.5(pid=30420): stderr: | 20221212213401574 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213401575 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213401575 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213401575 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213401576 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213401576 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213401576 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:34:03.756558 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=30420): Process ended prematurely: osmo-stp_10.42.42.5(pid=30420) [trial-2382↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30420)] [trial-2382↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19] 21:34:03.766079 tst emergency_mo_mt_call.py:19: Test FAILED (6.9 sec) 21:34:03.795279 run osmo-hlr_10.42.42.2(pid=30417): ERR: Terminated: ERROR {rc=237} [trial-2382↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30417)] 21:34:03.847605 run osmo-hlr_10.42.42.2(pid=30417): stdout: | (launched: 2022-12-12_21:34:00.189405) 21:34:03.901486 run osmo-hlr_10.42.42.2(pid=30417): stderr: | 20221212213400393 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212213400393 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212213400393 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212213400393 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212213400393 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212213400393 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212213400405 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/emergency:trx-lms-limenet-micro/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212213400414 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212213400414 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212213400414 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:34:03.976200 run osmo-msc_10.42.42.6(pid=30423): ERR: Terminated: ERROR {rc=2} [trial-2382↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30423)] 21:34:04.028240 run osmo-msc_10.42.42.6(pid=30423): stdout: | (launched: 2022-12-12_21:34:02.783308) 21:34:04.082016 run osmo-msc_10.42.42.6(pid=30423): stderr: | 20221212213403112 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212213403112 DLGLOBAL DEBUG validating counter group 0x7f59826e6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212213403112 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212213403113 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212213403113 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212213403113 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212213403115 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212213403115 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212213403115 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212213403115 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:34:04.136151 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30416): Terminating (SIGTERM) 21:34:04.179549 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30419): Terminating (SIGTERM) 21:34:04.222923 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30422): Terminating (SIGTERM) 21:34:04.266434 --- ParallelTerminationStrategy: PID 30416 died... 21:34:04.287257 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30416): Terminated: ok {rc=0} 21:34:04.335819 --- ParallelTerminationStrategy: PID 30419 died... 21:34:04.356158 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30419): Terminated: ok {rc=0} 21:34:04.404357 --- ParallelTerminationStrategy: PID 30422 died... 21:34:04.424471 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30422): Terminated: ok {rc=0} 21:34:04.515794 bus /sierra_3: Setting Powered False 21:34:05.618374 bus /sierra_3: Setting Powered False 21:34:06.739262 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2382 emergency:trx-lms-limenet-micro emergency_preemptive_call.py ---------------------------------------------- 21:34:07.829473 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:34:07.841434 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 21:34:07.892394 tst emergency_preemptive_call.py: using LAC 31646 21:34:08.014343 tst emergency_preemptive_call.py: using RAC 26 21:34:08.137748 tst emergency_preemptive_call.py: using CellId 31646 21:34:08.259033 tst emergency_preemptive_call.py: using BVCI 31647 21:34:08.373941 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:34:08.385255 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:34:08.396013 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:34:08.406930 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:34:08.417915 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:34:08.428728 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 21:34:08.547633 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 21:34:08.669671 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 21:34:08.790698 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 21:34:08.913071 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:34:09.439457 run create_hlr_db(pid=30425): Launched 21:34:09.568653 bus /sierra_2: Setting Powered False 21:34:10.635770 run create_hlr_db(pid=30425): Terminated: ok {rc=0} 21:34:11.105457 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30427): Launched 21:34:11.448138 run osmo-hlr_10.42.42.2(pid=30428): Launched 21:34:11.579420 run osmo-stp_10.42.42.5: Starting osmo-stp 21:34:12.169208 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30430): Launched 21:34:12.510597 run osmo-stp_10.42.42.5(pid=30431): Launched 21:34:12.651272 tst emergency_preemptive_call.py: using MSISDN 7978 21:34:12.825751 run osmo-msc_10.42.42.6: Starting osmo-msc 21:34:13.435573 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30433): Launched 21:34:13.776708 run osmo-msc_10.42.42.6(pid=30434): Launched 21:34:13.967100 run osmo-stp_10.42.42.5(pid=30431): ERR: Terminated: ERROR {rc=1} [trial-2382↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30431)] 21:34:14.109980 run osmo-stp_10.42.42.5(pid=30431): stdout: | (launched: 2022-12-12_21:34:12.446884) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:34:14.253732 run osmo-stp_10.42.42.5(pid=30431): stderr: | 20221212213412646 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213412646 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213412646 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213412647 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213412647 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213412647 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213412647 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:34:14.396083 run osmo-stp_10.42.42.5(pid=30431): stdout: | (launched: 2022-12-12_21:34:12.446884) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:34:14.530498 run osmo-stp_10.42.42.5(pid=30431): stderr: | 20221212213412646 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213412646 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213412646 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213412647 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213412647 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213412647 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213412647 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:34:14.691535 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=30431): Process ended prematurely: osmo-stp_10.42.42.5(pid=30431) [trial-2382↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30431)] [trial-2382↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32] 21:34:14.700853 tst emergency_preemptive_call.py:32: Test FAILED (6.9 sec) 21:34:14.730173 run osmo-hlr_10.42.42.2(pid=30428): ERR: Terminated: ERROR {rc=237} [trial-2382↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30428)] 21:34:14.782227 run osmo-hlr_10.42.42.2(pid=30428): stdout: | (launched: 2022-12-12_21:34:11.384239) 21:34:14.835821 run osmo-hlr_10.42.42.2(pid=30428): stderr: | 20221212213411589 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212213411589 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212213411589 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212213411589 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212213411589 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212213411589 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212213411602 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/emergency:trx-lms-limenet-micro/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212213411610 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212213411610 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212213411610 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:34:14.910741 run osmo-msc_10.42.42.6(pid=30434): ERR: Terminated: ERROR {rc=2} [trial-2382↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30434)] 21:34:14.962072 run osmo-msc_10.42.42.6(pid=30434): stdout: | (launched: 2022-12-12_21:34:13.713064) 21:34:15.015902 run osmo-msc_10.42.42.6(pid=30434): stderr: | 20221212213414039 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212213414039 DLGLOBAL DEBUG validating counter group 0x7f65d0d48c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212213414039 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212213414039 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212213414039 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212213414039 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212213414041 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212213414041 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212213414042 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212213414042 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:34:15.070007 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30427): Terminating (SIGTERM) 21:34:15.113406 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30430): Terminating (SIGTERM) 21:34:15.156887 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30433): Terminating (SIGTERM) 21:34:15.200528 --- ParallelTerminationStrategy: PID 30427 died... 21:34:15.221303 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30427): Terminated: ok {rc=0} 21:34:15.269821 --- ParallelTerminationStrategy: PID 30430 died... 21:34:15.290166 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30430): Terminated: ok {rc=0} 21:34:15.338617 --- ParallelTerminationStrategy: PID 30433 died... 21:34:15.358655 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30433): Terminated: ok {rc=0} 21:34:15.450262 bus /sierra_9: Setting Powered False 21:34:16.560307 bus /sierra_9: Setting Powered False 21:34:17.694039 bus /sierra_8: Setting Powered False 21:34:18.796863 bus /sierra_8: Setting Powered False 21:34:19.916021 bus /sierra_3: Setting Powered False 21:34:21.019236 bus /sierra_3: Setting Powered False 21:34:22.140336 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 emergency:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 gprs:trx-lms-limenet-micro --------------------------------------------------------------------- 21:34:23.428399 tst gprs:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:34:23.434036 tst gprs:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 21:34:23.465081 tst gprs:trx-lms-limenet-micro: Verifying 9 x ip_address (candidates: 9) 21:34:23.505543 tst gprs:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 21:34:23.594287 tst gprs:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 21:34:23.624716 tst gprs:trx-lms-limenet-micro: Reserving 9 x ip_address (candidates: 9) 21:34:23.664880 tst gprs:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 21:34:24.261789 tst gprs:trx-lms-limenet-micro: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2382 gprs:trx-lms-limenet-micro cs_paging_gprs_active.py ---------------------------------------------- 21:34:24.318352 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:34:24.329874 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 21:34:24.376136 tst cs_paging_gprs_active.py: using LAC 31647 21:34:24.510602 tst cs_paging_gprs_active.py: using RAC 27 21:34:24.645407 tst cs_paging_gprs_active.py: using CellId 31647 21:34:24.779745 tst cs_paging_gprs_active.py: using BVCI 31648 21:34:24.904786 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:34:24.916298 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:34:24.927624 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:34:24.939144 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:34:24.950716 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:34:24.962209 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:34:24.973925 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:34:24.985433 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:34:24.996900 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 21:34:25.119556 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 21:34:25.240515 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 21:34:25.476536 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:34:25.824419 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30440): Launched 21:34:26.128170 run iperf3-srv_10.42.42.10(pid=30441): Launched 21:34:26.258928 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 21:34:26.493289 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:34:26.842005 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30442): Launched 21:34:27.144138 run iperf3-srv_10.42.42.10(pid=30443): Launched 21:34:27.273484 tst cs_paging_gprs_active.py:38: start network... 21:34:27.507797 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:34:28.044610 run create_hlr_db(pid=30444): Launched 21:34:28.175307 bus /sierra_2: Setting Powered False 21:34:29.242773 run create_hlr_db(pid=30444): Terminated: ok {rc=0} 21:34:29.702678 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30446): Launched 21:34:30.026765 run osmo-hlr_10.42.42.2(pid=30447): Launched 21:34:30.151330 run osmo-stp_10.42.42.5: Starting osmo-stp 21:34:30.705072 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30449): Launched 21:34:31.042755 run osmo-stp_10.42.42.5(pid=30450): Launched 21:34:31.348244 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:34:31.967451 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30452): Launched 21:34:32.114137 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:34:32.411258 run patchelf(pid=30453): Launched 21:34:32.604445 run osmo-stp_10.42.42.5(pid=30450): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30450)] 21:34:32.749515 run osmo-stp_10.42.42.5(pid=30450): stdout: | (launched: 2022-12-12_21:34:30.981523) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:34:32.896669 run osmo-stp_10.42.42.5(pid=30450): stderr: | 20221212213431253 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213431253 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213431253 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213431254 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213431254 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213431254 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213431254 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:34:33.043683 run osmo-stp_10.42.42.5(pid=30450): stdout: | (launched: 2022-12-12_21:34:30.981523) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:34:33.184321 run osmo-stp_10.42.42.5(pid=30450): stderr: | 20221212213431253 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213431253 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213431253 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213431254 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213431254 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213431254 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213431254 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:34:33.351778 run patchelf(pid=30453): Terminating (SIGINT) 21:34:33.545500 run patchelf(pid=30453): Terminated: ok {rc=0} 21:34:33.684613 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=30450): Process ended prematurely: osmo-stp_10.42.42.5(pid=30450) [trial-2382↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30450)] [trial-2382↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38] 21:34:33.695288 tst cs_paging_gprs_active.py:38: Test FAILED (9.4 sec) 21:34:33.725688 run osmo-hlr_10.42.42.2(pid=30447): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30447)] 21:34:33.777975 run osmo-hlr_10.42.42.2(pid=30447): stdout: | (launched: 2022-12-12_21:34:29.966223) 21:34:33.831723 run osmo-hlr_10.42.42.2(pid=30447): stderr: | 20221212213430147 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212213430147 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212213430147 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212213430147 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212213430147 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212213430147 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212213430160 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-lms-limenet-micro/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212213430170 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212213430170 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212213430170 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:34:33.885864 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30440): Terminating (SIGTERM) 21:34:33.929310 run iperf3-srv_10.42.42.10(pid=30441): Terminating (SIGTERM) 21:34:33.972527 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30442): Terminating (SIGTERM) 21:34:34.015834 run iperf3-srv_10.42.42.10(pid=30443): Terminating (SIGTERM) 21:34:34.059041 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30446): Terminating (SIGTERM) 21:34:34.102494 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30449): Terminating (SIGTERM) 21:34:34.145622 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30452): Terminating (SIGTERM) 21:34:34.189221 --- ParallelTerminationStrategy: PID 30440 died... 21:34:34.209482 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30440): Terminated: ok {rc=0} 21:34:34.257734 --- ParallelTerminationStrategy: PID 30441 died... 21:34:34.277885 run iperf3-srv_10.42.42.10(pid=30441): Terminated {rc=256} 21:34:34.326005 --- ParallelTerminationStrategy: PID 30442 died... 21:34:34.346530 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30442): Terminated: ok {rc=0} 21:34:34.395919 --- ParallelTerminationStrategy: PID 30443 died... 21:34:34.416104 run iperf3-srv_10.42.42.10(pid=30443): Terminated {rc=256} 21:34:34.466854 --- ParallelTerminationStrategy: PID 30446 died... 21:34:34.487302 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30446): Terminated: ok {rc=0} 21:34:34.535617 --- ParallelTerminationStrategy: PID 30449 died... 21:34:34.556108 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30449): Terminated: ok {rc=0} 21:34:34.604383 --- ParallelTerminationStrategy: PID 30452 died... 21:34:34.624670 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30452): Terminated: ok {rc=0} 21:34:34.714937 bus /gobi_0: Setting Powered False 21:34:35.817051 bus /gobi_0: Setting Powered False 21:34:36.935548 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:trx-lms-limenet-micro iperf3.py ---------------------------------------------- 21:34:38.090690 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:34:38.103229 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 21:34:38.153480 tst iperf3.py: using LAC 31648 21:34:38.289362 tst iperf3.py: using RAC 28 21:34:38.425113 tst iperf3.py: using CellId 31648 21:34:38.561265 tst iperf3.py: using BVCI 31649 21:34:38.687776 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:34:38.699348 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:34:38.710751 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:34:38.722942 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:34:38.734496 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:34:38.745885 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:34:38.757695 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:34:38.769260 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:34:38.780902 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 21:34:38.902122 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 21:34:39.117883 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:34:39.442300 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30456): Launched 21:34:39.724508 run iperf3-srv_10.42.42.10(pid=30457): Launched 21:34:39.846705 tst iperf3.py:8: start network... 21:34:40.062233 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:34:40.561602 run create_hlr_db(pid=30458): Launched 21:34:40.693764 bus /gobi_6: Setting Powered False 21:34:41.757303 run create_hlr_db(pid=30458): Terminated: ok {rc=0} 21:34:42.225043 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30460): Launched 21:34:42.571584 run osmo-hlr_10.42.42.2(pid=30461): Launched 21:34:42.703192 run osmo-stp_10.42.42.5: Starting osmo-stp 21:34:43.297195 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30463): Launched 21:34:43.643481 run osmo-stp_10.42.42.5(pid=30464): Launched 21:34:43.774219 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:34:44.369228 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30466): Launched 21:34:44.500168 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:34:44.792212 run patchelf(pid=30467): Launched 21:34:44.984047 run osmo-stp_10.42.42.5(pid=30464): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30464)] 21:34:45.128284 run osmo-stp_10.42.42.5(pid=30464): stdout: | (launched: 2022-12-12_21:34:43.579037) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:34:45.274421 run osmo-stp_10.42.42.5(pid=30464): stderr: | 20221212213443776 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213443776 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213443777 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213443777 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213443779 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213443780 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213443780 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:34:45.421490 run osmo-stp_10.42.42.5(pid=30464): stdout: | (launched: 2022-12-12_21:34:43.579037) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:34:45.562288 run osmo-stp_10.42.42.5(pid=30464): stderr: | 20221212213443776 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213443776 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213443777 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213443777 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213443779 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213443780 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213443780 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:34:45.728780 run patchelf(pid=30467): Terminating (SIGINT) 21:34:45.929786 run patchelf(pid=30467): Terminated: ok {rc=0} 21:34:46.071106 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30464): Process ended prematurely: osmo-stp_10.42.42.5(pid=30464) [trial-2382↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30464)] [trial-2382↪gprs:trx-lms-limenet-micro↪iperf3.py:8] 21:34:46.082796 tst iperf3.py:8: Test FAILED (8.0 sec) 21:34:46.116131 run osmo-hlr_10.42.42.2(pid=30461): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-lms-limenet-micro↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30461)] 21:34:46.170007 run osmo-hlr_10.42.42.2(pid=30461): stdout: | (launched: 2022-12-12_21:34:42.506959) 21:34:46.225805 run osmo-hlr_10.42.42.2(pid=30461): stderr: | 20221212213442709 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212213442709 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212213442709 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212213442709 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212213442709 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212213442710 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212213442725 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-lms-limenet-micro/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212213442736 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212213442736 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212213442736 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:34:46.282216 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30456): Terminating (SIGTERM) 21:34:46.328171 run iperf3-srv_10.42.42.10(pid=30457): Terminating (SIGTERM) 21:34:46.376383 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30460): Terminating (SIGTERM) 21:34:46.422473 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30463): Terminating (SIGTERM) 21:34:46.468319 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30466): Terminating (SIGTERM) 21:34:46.515758 --- ParallelTerminationStrategy: PID 30456 died... 21:34:46.537468 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30456): Terminated: ok {rc=0} 21:34:46.591802 --- ParallelTerminationStrategy: PID 30457 died... 21:34:46.613268 run iperf3-srv_10.42.42.10(pid=30457): Terminated {rc=256} 21:34:46.664697 --- ParallelTerminationStrategy: PID 30460 died... 21:34:46.685983 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30460): Terminated: ok {rc=0} 21:34:46.737351 --- ParallelTerminationStrategy: PID 30463 died... 21:34:46.758808 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30463): Terminated: ok {rc=0} 21:34:46.810360 --- ParallelTerminationStrategy: PID 30466 died... 21:34:46.831812 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30466): Terminated: ok {rc=0} 21:34:46.925959 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:trx-lms-limenet-micro iperf3m4.py ---------------------------------------------- 21:34:48.077262 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:34:48.089076 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 21:34:48.135816 tst iperf3m4.py: using LAC 31649 21:34:48.263003 tst iperf3m4.py: using RAC 29 21:34:48.393089 tst iperf3m4.py: using CellId 31649 21:34:48.518347 tst iperf3m4.py: using BVCI 31650 21:34:48.636134 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:34:48.647142 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:34:48.657878 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:34:48.668630 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:34:48.679375 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:34:48.690061 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:34:48.700839 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:34:48.711452 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:34:48.722247 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 21:34:48.842818 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 21:34:48.970265 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 21:34:49.092839 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 21:34:49.222089 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 21:34:49.455414 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:34:49.802039 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30468): Launched 21:34:50.104053 run iperf3-srv_10.42.42.10(pid=30469): Launched 21:34:50.233217 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 21:34:50.466894 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:34:50.813985 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30470): Launched 21:34:51.116170 run iperf3-srv_10.42.42.10(pid=30471): Launched 21:34:51.245454 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 21:34:51.478371 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:34:51.825208 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30472): Launched 21:34:52.125398 run iperf3-srv_10.42.42.10(pid=30473): Launched 21:34:52.256577 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 21:34:52.490872 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:34:52.839977 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30474): Launched 21:34:53.140563 run iperf3-srv_10.42.42.10(pid=30475): Launched 21:34:53.270432 tst iperf3m4.py:8: start network... 21:34:53.503115 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:34:54.037526 run create_hlr_db(pid=30476): Launched 21:34:54.170497 bus /gobi_6: Setting Powered False 21:34:55.238461 run create_hlr_db(pid=30476): Terminated: ok {rc=0} 21:34:55.715727 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30478): Launched 21:34:56.064221 run osmo-hlr_10.42.42.2(pid=30479): Launched 21:34:56.198679 run osmo-stp_10.42.42.5: Starting osmo-stp 21:34:56.903101 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30481): Launched 21:34:57.243467 run osmo-stp_10.42.42.5(pid=30482): Launched 21:34:57.374426 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:34:57.957151 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30484): Launched 21:34:58.087483 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:34:58.374538 run patchelf(pid=30485): Launched 21:34:58.561868 run osmo-stp_10.42.42.5(pid=30482): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30482)] 21:34:58.704219 run osmo-stp_10.42.42.5(pid=30482): stdout: | (launched: 2022-12-12_21:34:57.180024) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:34:58.848320 run osmo-stp_10.42.42.5(pid=30482): stderr: | 20221212213457376 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213457376 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213457376 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213457377 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213457377 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213457377 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213457378 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:34:58.992279 run osmo-stp_10.42.42.5(pid=30482): stdout: | (launched: 2022-12-12_21:34:57.180024) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:34:59.130605 run osmo-stp_10.42.42.5(pid=30482): stderr: | 20221212213457376 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213457376 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213457376 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213457377 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213457377 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213457377 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213457378 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:34:59.294723 run patchelf(pid=30485): Terminating (SIGINT) 21:34:59.484843 run patchelf(pid=30485): Terminated: ok {rc=0} 21:34:59.621753 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30482): Process ended prematurely: osmo-stp_10.42.42.5(pid=30482) [trial-2382↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30482)] [trial-2382↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8] 21:34:59.632401 tst iperf3m4.py:8: Test FAILED (11.6 sec) 21:34:59.662844 run osmo-hlr_10.42.42.2(pid=30479): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-lms-limenet-micro↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30479)] 21:34:59.714750 run osmo-hlr_10.42.42.2(pid=30479): stdout: | (launched: 2022-12-12_21:34:55.999203) 21:34:59.768500 run osmo-hlr_10.42.42.2(pid=30479): stderr: | 20221212213456204 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212213456204 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212213456204 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212213456204 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212213456204 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212213456204 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212213456217 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-lms-limenet-micro/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212213456225 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212213456226 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212213456226 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:34:59.822865 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30468): Terminating (SIGTERM) 21:34:59.865967 run iperf3-srv_10.42.42.10(pid=30469): Terminating (SIGTERM) 21:34:59.909016 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30470): Terminating (SIGTERM) 21:34:59.952007 run iperf3-srv_10.42.42.10(pid=30471): Terminating (SIGTERM) 21:34:59.995014 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30472): Terminating (SIGTERM) 21:35:00.038188 run iperf3-srv_10.42.42.10(pid=30473): Terminating (SIGTERM) 21:35:00.081155 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30474): Terminating (SIGTERM) 21:35:00.124077 run iperf3-srv_10.42.42.10(pid=30475): Terminating (SIGTERM) 21:35:00.167157 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30478): Terminating (SIGTERM) 21:35:00.210409 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30481): Terminating (SIGTERM) 21:35:00.253533 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30484): Terminating (SIGTERM) 21:35:00.297217 --- ParallelTerminationStrategy: PID 30468 died... 21:35:00.317872 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30468): Terminated: ok {rc=0} 21:35:00.366237 --- ParallelTerminationStrategy: PID 30469 died... 21:35:00.386424 run iperf3-srv_10.42.42.10(pid=30469): Terminated {rc=256} 21:35:00.434193 --- ParallelTerminationStrategy: PID 30470 died... 21:35:00.454381 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30470): Terminated: ok {rc=0} 21:35:00.502144 --- ParallelTerminationStrategy: PID 30471 died... 21:35:00.522184 run iperf3-srv_10.42.42.10(pid=30471): Terminated {rc=256} 21:35:00.569896 --- ParallelTerminationStrategy: PID 30472 died... 21:35:00.590031 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30472): Terminated: ok {rc=0} 21:35:00.637745 --- ParallelTerminationStrategy: PID 30473 died... 21:35:00.657749 run iperf3-srv_10.42.42.10(pid=30473): Terminated {rc=256} 21:35:00.705631 --- ParallelTerminationStrategy: PID 30474 died... 21:35:00.725543 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30474): Terminated: ok {rc=0} 21:35:00.773639 --- ParallelTerminationStrategy: PID 30475 died... 21:35:00.793880 run iperf3-srv_10.42.42.10(pid=30475): Terminated {rc=256} 21:35:00.853461 --- ParallelTerminationStrategy: PID 30478 died... 21:35:00.883438 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30478): Terminated: ok {rc=0} 21:35:00.937247 --- ParallelTerminationStrategy: PID 30481 died... 21:35:00.957699 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30481): Terminated: ok {rc=0} 21:35:01.006986 --- ParallelTerminationStrategy: PID 30484 died... 21:35:01.029175 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30484): Terminated: ok {rc=0} 21:35:01.140580 bus /gobi_4: Setting Powered False 21:35:02.241164 bus /gobi_4: Setting Powered False 21:35:03.363757 bus /gobi_1: Setting Powered False 21:35:04.465111 bus /gobi_1: Setting Powered False 21:35:05.579808 bus /gobi_0: Setting Powered False 21:35:06.680235 bus /gobi_0: Setting Powered False 21:35:07.802085 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:trx-lms-limenet-micro ping.py ---------------------------------------------- 21:35:08.909212 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:35:08.920706 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 21:35:08.967433 tst ping.py: using LAC 31650 21:35:09.090252 tst ping.py: using RAC 30 21:35:09.213285 tst ping.py: using CellId 31650 21:35:09.337194 tst ping.py: using BVCI 31651 21:35:09.451445 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:35:09.462592 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:35:09.473692 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:35:09.484602 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:35:09.495404 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:35:09.506381 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:35:09.517482 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:35:09.528488 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 21:35:09.649392 tst ping.py:19: start network... 21:35:09.872726 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:35:10.387295 run create_hlr_db(pid=30489): Launched 21:35:10.516738 bus /gobi_6: Setting Powered False 21:35:11.582572 run create_hlr_db(pid=30489): Terminated: ok {rc=0} 21:35:12.027369 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30491): Launched 21:35:12.341599 run osmo-hlr_10.42.42.2(pid=30492): Launched 21:35:12.460778 run osmo-stp_10.42.42.5: Starting osmo-stp 21:35:13.002619 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30494): Launched 21:35:13.316204 run osmo-stp_10.42.42.5(pid=30495): Launched 21:35:13.436117 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:35:13.973973 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30497): Launched 21:35:14.094064 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:35:14.357979 run patchelf(pid=30498): Launched 21:35:14.530522 run osmo-stp_10.42.42.5(pid=30495): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30495)] 21:35:14.661492 run osmo-stp_10.42.42.5(pid=30495): stdout: | (launched: 2022-12-12_21:35:13.257636) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:35:14.794668 run osmo-stp_10.42.42.5(pid=30495): stderr: | 20221212213513432 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213513432 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213513432 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213513433 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213513433 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213513433 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213513433 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:35:14.927501 run osmo-stp_10.42.42.5(pid=30495): stdout: | (launched: 2022-12-12_21:35:13.257636) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:35:15.055225 run osmo-stp_10.42.42.5(pid=30495): stderr: | 20221212213513432 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213513432 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213513432 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213513433 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213513433 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213513433 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213513433 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:35:15.205733 run patchelf(pid=30498): Terminating (SIGINT) 21:35:15.380378 run patchelf(pid=30498): Terminated: ok {rc=0} 21:35:15.506407 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=30495): Process ended prematurely: osmo-stp_10.42.42.5(pid=30495) [trial-2382↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30495)] [trial-2382↪gprs:trx-lms-limenet-micro↪ping.py:22] 21:35:15.515427 tst ping.py:22: Test FAILED (6.6 sec) 21:35:15.542762 run osmo-hlr_10.42.42.2(pid=30492): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-lms-limenet-micro↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30492)] 21:35:15.591594 run osmo-hlr_10.42.42.2(pid=30492): stdout: | (launched: 2022-12-12_21:35:12.282946) 21:35:15.642532 run osmo-hlr_10.42.42.2(pid=30492): stderr: | 20221212213512461 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212213512461 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212213512461 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212213512461 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212213512461 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212213512461 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212213512475 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-lms-limenet-micro/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212213512483 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212213512483 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212213512483 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:35:15.693972 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30491): Terminating (SIGTERM) 21:35:15.735128 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30494): Terminating (SIGTERM) 21:35:15.776463 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30497): Terminating (SIGTERM) 21:35:15.817971 --- ParallelTerminationStrategy: PID 30491 died... 21:35:15.841544 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30491): Terminated: ok {rc=0} 21:35:15.889288 --- ParallelTerminationStrategy: PID 30494 died... 21:35:15.913584 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30494): Terminated: ok {rc=0} 21:35:15.960420 --- ParallelTerminationStrategy: PID 30497 died... 21:35:15.980900 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30497): Terminated: ok {rc=0} 21:35:16.073852 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:trx-lms-limenet-micro ping_idle_ping.py ---------------------------------------------- 21:35:17.165870 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:35:17.179038 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 21:35:17.229622 tst ping_idle_ping.py: using LAC 31651 21:35:17.356892 tst ping_idle_ping.py: using RAC 31 21:35:17.480064 tst ping_idle_ping.py: using CellId 31651 21:35:17.604382 tst ping_idle_ping.py: using BVCI 31652 21:35:17.719808 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:35:17.730889 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:35:17.741941 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:35:17.753050 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:35:17.764009 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:35:17.774868 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:35:17.785893 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:35:17.796743 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 21:35:17.917546 tst ping_idle_ping.py:24: start network... 21:35:18.143656 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:35:18.664851 run create_hlr_db(pid=30499): Launched 21:35:18.794827 bus /gobi_6: Setting Powered False 21:35:19.860667 run create_hlr_db(pid=30499): Terminated: ok {rc=0} 21:35:20.305991 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30501): Launched 21:35:20.620219 run osmo-hlr_10.42.42.2(pid=30502): Launched 21:35:20.741482 run osmo-stp_10.42.42.5: Starting osmo-stp 21:35:21.282883 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30504): Launched 21:35:21.598088 run osmo-stp_10.42.42.5(pid=30505): Launched 21:35:21.717735 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:35:22.258370 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30507): Launched 21:35:22.379192 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:35:22.644705 run patchelf(pid=30508): Launched 21:35:22.817812 run osmo-stp_10.42.42.5(pid=30505): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30505)] 21:35:22.949798 run osmo-stp_10.42.42.5(pid=30505): stdout: | (launched: 2022-12-12_21:35:21.539106) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:35:23.083867 run osmo-stp_10.42.42.5(pid=30505): stderr: | 20221212213521713 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213521713 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213521714 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213521714 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213521715 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213521715 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213521715 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:35:23.217927 run osmo-stp_10.42.42.5(pid=30505): stdout: | (launched: 2022-12-12_21:35:21.539106) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:35:23.345817 run osmo-stp_10.42.42.5(pid=30505): stderr: | 20221212213521713 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213521713 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213521714 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213521714 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213521715 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213521715 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213521715 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:35:23.497265 run patchelf(pid=30508): Terminating (SIGINT) 21:35:23.672229 run patchelf(pid=30508): Terminated: ok {rc=0} 21:35:23.798370 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=30505): Process ended prematurely: osmo-stp_10.42.42.5(pid=30505) [trial-2382↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30505)] [trial-2382↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27] 21:35:23.807354 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 21:35:23.834840 run osmo-hlr_10.42.42.2(pid=30502): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30502)] 21:35:23.883899 run osmo-hlr_10.42.42.2(pid=30502): stdout: | (launched: 2022-12-12_21:35:20.561181) 21:35:23.934704 run osmo-hlr_10.42.42.2(pid=30502): stderr: | 20221212213520742 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212213520742 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212213520743 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212213520743 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212213520743 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212213520743 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212213520754 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-lms-limenet-micro/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212213520763 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212213520763 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212213520763 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:35:23.986256 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30501): Terminating (SIGTERM) 21:35:24.027472 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30504): Terminating (SIGTERM) 21:35:24.068553 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30507): Terminating (SIGTERM) 21:35:24.110089 --- ParallelTerminationStrategy: PID 30501 died... 21:35:24.129731 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30501): Terminated: ok {rc=0} 21:35:24.175169 --- ParallelTerminationStrategy: PID 30504 died... 21:35:24.194465 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30504): Terminated: ok {rc=0} 21:35:24.239730 --- ParallelTerminationStrategy: PID 30507 died... 21:35:24.258865 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30507): Terminated: ok {rc=0} 21:35:24.345478 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2382 gprs:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 gprs:trx-lms-limenet-micro+mod-bts0-egprs --------------------------------------------------------------------- 21:35:25.650460 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:35:25.656438 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 21:35:25.686209 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 21:35:25.724942 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 21:35:25.814444 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 21:35:25.844115 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 21:35:25.882584 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 21:35:26.476691 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2382 gprs:trx-lms-limenet-micro+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 21:35:26.529364 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:35:26.540596 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:35:26.587945 tst cs_paging_gprs_active.py: using LAC 31652 21:35:26.714056 tst cs_paging_gprs_active.py: using RAC 32 21:35:26.838918 tst cs_paging_gprs_active.py: using CellId 31652 21:35:26.964367 tst cs_paging_gprs_active.py: using BVCI 31653 21:35:27.082407 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:35:27.093947 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:35:27.105231 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:35:27.116344 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:35:27.127413 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:35:27.138527 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:35:27.149852 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:35:27.160818 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:35:27.172038 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:35:27.294070 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:35:27.418486 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 21:35:27.649780 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:35:27.992801 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30512): Launched 21:35:28.291326 run iperf3-srv_10.42.42.10(pid=30513): Launched 21:35:28.420056 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 21:35:28.650586 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:35:28.995031 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30514): Launched 21:35:29.293065 run iperf3-srv_10.42.42.10(pid=30515): Launched 21:35:29.422213 tst cs_paging_gprs_active.py:38: start network... 21:35:29.652538 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:35:30.182397 run create_hlr_db(pid=30516): Launched 21:35:30.312675 bus /gobi_6: Setting Powered False 21:35:31.408458 run create_hlr_db(pid=30516): Terminated: ok {rc=0} 21:35:31.897647 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30518): Launched 21:35:32.267039 run osmo-hlr_10.42.42.2(pid=30519): Launched 21:35:32.400266 run osmo-stp_10.42.42.5: Starting osmo-stp 21:35:32.987730 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30521): Launched 21:35:33.329516 run osmo-stp_10.42.42.5(pid=30522): Launched 21:35:33.461389 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:35:34.054492 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30524): Launched 21:35:34.186089 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:35:34.476098 run patchelf(pid=30525): Launched 21:35:34.664396 run osmo-stp_10.42.42.5(pid=30522): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30522)] 21:35:34.807343 run osmo-stp_10.42.42.5(pid=30522): stdout: | (launched: 2022-12-12_21:35:33.265831) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:35:34.951948 run osmo-stp_10.42.42.5(pid=30522): stderr: | 20221212213533461 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213533461 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213533462 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213533462 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213533462 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213533463 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213533463 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:35:35.096579 run osmo-stp_10.42.42.5(pid=30522): stdout: | (launched: 2022-12-12_21:35:33.265831) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:35:35.235841 run osmo-stp_10.42.42.5(pid=30522): stderr: | 20221212213533461 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213533461 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213533462 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213533462 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213533462 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213533463 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213533463 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:35:35.401210 run patchelf(pid=30525): Terminating (SIGINT) 21:35:35.591700 run patchelf(pid=30525): Terminated: ok {rc=0} 21:35:35.729122 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=30522): Process ended prematurely: osmo-stp_10.42.42.5(pid=30522) [trial-2382↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30522)] [trial-2382↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 21:35:35.739478 tst cs_paging_gprs_active.py:38: Test FAILED (9.2 sec) 21:35:35.769287 run osmo-hlr_10.42.42.2(pid=30519): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30519)] 21:35:35.821357 run osmo-hlr_10.42.42.2(pid=30519): stdout: | (launched: 2022-12-12_21:35:32.202673) 21:35:35.874761 run osmo-hlr_10.42.42.2(pid=30519): stderr: | 20221212213532404 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212213532404 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212213532404 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212213532404 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212213532404 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212213532404 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212213532415 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-lms-limenet-micro+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212213532424 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212213532424 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212213532424 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:35:35.929157 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30512): Terminating (SIGTERM) 21:35:35.972143 run iperf3-srv_10.42.42.10(pid=30513): Terminating (SIGTERM) 21:35:36.015171 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30514): Terminating (SIGTERM) 21:35:36.058323 run iperf3-srv_10.42.42.10(pid=30515): Terminating (SIGTERM) 21:35:36.101288 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30518): Terminating (SIGTERM) 21:35:36.144426 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30521): Terminating (SIGTERM) 21:35:36.187424 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30524): Terminating (SIGTERM) 21:35:36.230658 --- ParallelTerminationStrategy: PID 30512 died... 21:35:36.251186 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30512): Terminated: ok {rc=0} 21:35:36.298880 --- ParallelTerminationStrategy: PID 30513 died... 21:35:36.318831 run iperf3-srv_10.42.42.10(pid=30513): Terminated {rc=256} 21:35:36.366978 --- ParallelTerminationStrategy: PID 30514 died... 21:35:36.387214 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30514): Terminated: ok {rc=0} 21:35:36.435153 --- ParallelTerminationStrategy: PID 30515 died... 21:35:36.455119 run iperf3-srv_10.42.42.10(pid=30515): Terminated {rc=256} 21:35:36.502832 --- ParallelTerminationStrategy: PID 30518 died... 21:35:36.522853 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30518): Terminated: ok {rc=0} 21:35:36.571048 --- ParallelTerminationStrategy: PID 30521 died... 21:35:36.591464 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30521): Terminated: ok {rc=0} 21:35:36.639413 --- ParallelTerminationStrategy: PID 30524 died... 21:35:36.659589 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30524): Terminated: ok {rc=0} 21:35:36.750391 bus /gobi_0: Setting Powered False 21:35:37.852445 bus /gobi_0: Setting Powered False 21:35:38.974144 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3.py ---------------------------------------------- 21:35:40.125577 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:35:40.137678 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:35:40.185409 tst iperf3.py: using LAC 31653 21:35:40.310784 tst iperf3.py: using RAC 33 21:35:40.437427 tst iperf3.py: using CellId 31653 21:35:40.562050 tst iperf3.py: using BVCI 31654 21:35:40.678003 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:35:40.689377 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:35:40.700435 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:35:40.711694 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:35:40.722842 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:35:40.733958 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:35:40.745164 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:35:40.756228 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:35:40.767626 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:35:40.885504 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 21:35:41.099325 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:35:41.420129 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30526): Launched 21:35:41.699700 run iperf3-srv_10.42.42.10(pid=30527): Launched 21:35:41.820539 tst iperf3.py:8: start network... 21:35:42.033481 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:35:42.527088 run create_hlr_db(pid=30528): Launched 21:35:42.658794 bus /gobi_6: Setting Powered False 21:35:43.721643 run create_hlr_db(pid=30528): Terminated: ok {rc=0} 21:35:44.183051 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30530): Launched 21:35:44.524273 run osmo-hlr_10.42.42.2(pid=30531): Launched 21:35:44.655431 run osmo-stp_10.42.42.5: Starting osmo-stp 21:35:45.237480 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30533): Launched 21:35:45.580938 run osmo-stp_10.42.42.5(pid=30534): Launched 21:35:45.711338 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:35:46.325055 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30536): Launched 21:35:46.496586 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:35:46.800241 run patchelf(pid=30537): Launched 21:35:47.002562 run osmo-stp_10.42.42.5(pid=30534): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30534)] 21:35:47.148181 run osmo-stp_10.42.42.5(pid=30534): stdout: | (launched: 2022-12-12_21:35:45.517105) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:35:47.295421 run osmo-stp_10.42.42.5(pid=30534): stderr: | 20221212213545715 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213545715 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213545715 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213545715 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213545718 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213545718 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213545718 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:35:47.440525 run osmo-stp_10.42.42.5(pid=30534): stdout: | (launched: 2022-12-12_21:35:45.517105) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:35:47.579745 run osmo-stp_10.42.42.5(pid=30534): stderr: | 20221212213545715 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213545715 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213545715 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213545715 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213545718 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213545718 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213545718 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:35:47.743762 run patchelf(pid=30537): Terminating (SIGINT) 21:35:47.933839 run patchelf(pid=30537): Terminated: ok {rc=0} 21:35:48.070323 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30534): Process ended prematurely: osmo-stp_10.42.42.5(pid=30534) [trial-2382↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30534)] [trial-2382↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8] 21:35:48.081359 tst iperf3.py:8: Test FAILED (8.0 sec) 21:35:48.111393 run osmo-hlr_10.42.42.2(pid=30531): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30531)] 21:35:48.163354 run osmo-hlr_10.42.42.2(pid=30531): stdout: | (launched: 2022-12-12_21:35:44.460729) 21:35:48.217426 run osmo-hlr_10.42.42.2(pid=30531): stderr: | 20221212213544662 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212213544662 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212213544662 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212213544662 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212213544662 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212213544662 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212213544676 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212213544685 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212213544685 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212213544685 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:35:48.271729 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30526): Terminating (SIGTERM) 21:35:48.315669 run iperf3-srv_10.42.42.10(pid=30527): Terminating (SIGTERM) 21:35:48.359507 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30530): Terminating (SIGTERM) 21:35:48.403594 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30533): Terminating (SIGTERM) 21:35:48.447464 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30536): Terminating (SIGTERM) 21:35:48.491374 --- ParallelTerminationStrategy: PID 30526 died... 21:35:48.512154 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30526): Terminated: ok {rc=0} 21:35:48.560915 --- ParallelTerminationStrategy: PID 30527 died... 21:35:48.581277 run iperf3-srv_10.42.42.10(pid=30527): Terminated {rc=256} 21:35:48.629645 --- ParallelTerminationStrategy: PID 30530 died... 21:35:48.649747 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30530): Terminated: ok {rc=0} 21:35:48.698192 --- ParallelTerminationStrategy: PID 30533 died... 21:35:48.718886 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30533): Terminated: ok {rc=0} 21:35:48.766853 --- ParallelTerminationStrategy: PID 30536 died... 21:35:48.787379 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30536): Terminated: ok {rc=0} 21:35:48.879365 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 21:35:50.035015 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:35:50.047785 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:35:50.097418 tst iperf3m4.py: using LAC 31654 21:35:50.222556 tst iperf3m4.py: using RAC 34 21:35:50.348862 tst iperf3m4.py: using CellId 31654 21:35:50.474893 tst iperf3m4.py: using BVCI 31655 21:35:50.591436 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:35:50.602945 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:35:50.614187 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:35:50.625262 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:35:50.636389 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:35:50.647532 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:35:50.658698 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:35:50.670261 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:35:50.681538 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:35:50.805837 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:35:50.924865 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:35:51.048718 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:35:51.172897 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 21:35:51.404110 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:35:51.746892 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30538): Launched 21:35:52.046258 run iperf3-srv_10.42.42.10(pid=30539): Launched 21:35:52.176314 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 21:35:52.407278 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:35:52.750845 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30540): Launched 21:35:53.047491 run iperf3-srv_10.42.42.10(pid=30541): Launched 21:35:53.175491 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 21:35:53.406652 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:35:53.749544 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30542): Launched 21:35:54.048651 run iperf3-srv_10.42.42.10(pid=30546): Launched 21:35:54.177434 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 21:35:54.406985 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:35:54.749060 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30547): Launched 21:35:55.046488 run iperf3-srv_10.42.42.10(pid=30548): Launched 21:35:55.175521 tst iperf3m4.py:8: start network... 21:35:55.405464 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:35:55.935854 run create_hlr_db(pid=30549): Launched 21:35:56.065286 bus /gobi_6: Setting Powered False 21:35:57.132576 run create_hlr_db(pid=30549): Terminated: ok {rc=0} 21:35:57.605270 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30551): Launched 21:35:57.948134 run osmo-hlr_10.42.42.2(pid=30552): Launched 21:35:58.078053 run osmo-stp_10.42.42.5: Starting osmo-stp 21:35:58.667602 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30554): Launched 21:35:59.008472 run osmo-stp_10.42.42.5(pid=30555): Launched 21:35:59.138013 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:35:59.726133 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30557): Launched 21:35:59.852279 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:36:00.122226 run patchelf(pid=30558): Launched 21:36:00.298419 run osmo-stp_10.42.42.5(pid=30555): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30555)] 21:36:00.432276 run osmo-stp_10.42.42.5(pid=30555): stdout: | (launched: 2022-12-12_21:35:58.944692) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:36:00.567550 run osmo-stp_10.42.42.5(pid=30555): stderr: | 20221212213559141 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213559141 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213559141 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213559142 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213559142 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213559142 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213559142 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:36:00.702570 run osmo-stp_10.42.42.5(pid=30555): stdout: | (launched: 2022-12-12_21:35:58.944692) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:36:00.836164 run osmo-stp_10.42.42.5(pid=30555): stderr: | 20221212213559141 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213559141 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213559141 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213559142 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213559142 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213559142 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213559142 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:36:00.999089 run patchelf(pid=30558): Terminating (SIGINT) 21:36:01.185562 run patchelf(pid=30558): Terminated: ok {rc=0} 21:36:01.316224 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30555): Process ended prematurely: osmo-stp_10.42.42.5(pid=30555) [trial-2382↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30555)] [trial-2382↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8] 21:36:01.326829 tst iperf3m4.py:8: Test FAILED (11.3 sec) 21:36:01.356424 run osmo-hlr_10.42.42.2(pid=30552): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30552)] 21:36:01.407455 run osmo-hlr_10.42.42.2(pid=30552): stdout: | (launched: 2022-12-12_21:35:57.884346) 21:36:01.459993 run osmo-hlr_10.42.42.2(pid=30552): stderr: | 20221212213558090 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212213558090 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212213558090 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212213558090 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212213558090 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212213558090 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212213558102 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212213558113 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212213558113 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212213558113 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:36:01.511887 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30538): Terminating (SIGTERM) 21:36:01.554410 run iperf3-srv_10.42.42.10(pid=30539): Terminating (SIGTERM) 21:36:01.599683 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30540): Terminating (SIGTERM) 21:36:01.643351 run iperf3-srv_10.42.42.10(pid=30541): Terminating (SIGTERM) 21:36:01.690147 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30542): Terminating (SIGTERM) 21:36:01.733364 run iperf3-srv_10.42.42.10(pid=30546): Terminating (SIGTERM) 21:36:01.778243 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30547): Terminating (SIGTERM) 21:36:01.821373 run iperf3-srv_10.42.42.10(pid=30548): Terminating (SIGTERM) 21:36:01.866425 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30551): Terminating (SIGTERM) 21:36:01.910505 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30554): Terminating (SIGTERM) 21:36:01.955040 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30557): Terminating (SIGTERM) 21:36:01.999827 --- ParallelTerminationStrategy: PID 30538 died... 21:36:02.019768 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30538): Terminated: ok {rc=0} 21:36:02.066402 --- ParallelTerminationStrategy: PID 30539 died... 21:36:02.086153 run iperf3-srv_10.42.42.10(pid=30539): Terminated {rc=256} 21:36:02.132389 --- ParallelTerminationStrategy: PID 30540 died... 21:36:02.152192 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30540): Terminated: ok {rc=0} 21:36:02.198299 --- ParallelTerminationStrategy: PID 30541 died... 21:36:02.218052 run iperf3-srv_10.42.42.10(pid=30541): Terminated {rc=256} 21:36:02.263940 --- ParallelTerminationStrategy: PID 30542 died... 21:36:02.283020 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30542): Terminated: ok {rc=0} 21:36:02.327802 --- ParallelTerminationStrategy: PID 30546 died... 21:36:02.346731 run iperf3-srv_10.42.42.10(pid=30546): Terminated {rc=256} 21:36:02.391575 --- ParallelTerminationStrategy: PID 30547 died... 21:36:02.410673 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30547): Terminated: ok {rc=0} 21:36:02.456016 --- ParallelTerminationStrategy: PID 30548 died... 21:36:02.475135 run iperf3-srv_10.42.42.10(pid=30548): Terminated {rc=256} 21:36:02.520151 --- ParallelTerminationStrategy: PID 30551 died... 21:36:02.539389 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30551): Terminated: ok {rc=0} 21:36:02.584247 --- ParallelTerminationStrategy: PID 30554 died... 21:36:02.603364 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30554): Terminated: ok {rc=0} 21:36:02.648205 --- ParallelTerminationStrategy: PID 30557 died... 21:36:02.667334 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30557): Terminated: ok {rc=0} 21:36:02.753585 bus /gobi_4: Setting Powered False 21:36:03.851006 bus /gobi_4: Setting Powered False 21:36:04.969602 bus /gobi_1: Setting Powered False 21:36:06.073567 bus /gobi_1: Setting Powered False 21:36:07.194785 bus /gobi_0: Setting Powered False 21:36:08.295871 bus /gobi_0: Setting Powered False 21:36:09.412463 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping.py ---------------------------------------------- 21:36:10.514611 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:36:10.526331 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:36:10.576722 tst ping.py: using LAC 31655 21:36:10.697601 tst ping.py: using RAC 35 21:36:10.818655 tst ping.py: using CellId 31655 21:36:10.937746 tst ping.py: using BVCI 31656 21:36:11.048554 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:36:11.059855 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:36:11.070702 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:36:11.081617 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:36:11.092288 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:36:11.103001 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:36:11.114067 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:36:11.124813 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:36:11.242390 tst ping.py:19: start network... 21:36:11.447252 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:36:11.920284 run create_hlr_db(pid=30559): Launched 21:36:12.044590 bus /gobi_6: Setting Powered False 21:36:13.105513 run create_hlr_db(pid=30559): Terminated: ok {rc=0} 21:36:13.535598 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30561): Launched 21:36:13.841709 run osmo-hlr_10.42.42.2(pid=30562): Launched 21:36:13.957795 run osmo-stp_10.42.42.5: Starting osmo-stp 21:36:14.500197 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30564): Launched 21:36:14.805302 run osmo-stp_10.42.42.5(pid=30565): Launched 21:36:14.920744 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:36:15.447591 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30567): Launched 21:36:15.564767 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:36:15.823730 run patchelf(pid=30568): Launched 21:36:16.004341 run osmo-stp_10.42.42.5(pid=30565): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30565)] 21:36:16.135557 run osmo-stp_10.42.42.5(pid=30565): stdout: | (launched: 2022-12-12_21:36:14.748143) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:36:16.269495 run osmo-stp_10.42.42.5(pid=30565): stderr: | 20221212213614920 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213614920 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213614920 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213614921 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213614921 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213614921 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213614921 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:36:16.403350 run osmo-stp_10.42.42.5(pid=30565): stdout: | (launched: 2022-12-12_21:36:14.748143) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:36:16.531693 run osmo-stp_10.42.42.5(pid=30565): stderr: | 20221212213614920 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213614920 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213614920 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213614921 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213614921 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213614921 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213614921 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:36:16.683192 run patchelf(pid=30568): Terminating (SIGINT) 21:36:16.857641 run patchelf(pid=30568): Terminated: ok {rc=0} 21:36:16.984579 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=30565): Process ended prematurely: osmo-stp_10.42.42.5(pid=30565) [trial-2382↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30565)] [trial-2382↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22] 21:36:16.994115 tst ping.py:22: Test FAILED (6.5 sec) 21:36:17.022649 run osmo-hlr_10.42.42.2(pid=30562): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30562)] 21:36:17.077854 run osmo-hlr_10.42.42.2(pid=30562): stdout: | (launched: 2022-12-12_21:36:13.784255) 21:36:17.134309 run osmo-hlr_10.42.42.2(pid=30562): stderr: | 20221212213613963 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212213613963 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212213613963 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212213613963 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212213613963 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212213613964 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212213613975 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212213613984 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212213613984 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212213613984 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:36:17.191677 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30561): Terminating (SIGTERM) 21:36:17.237700 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30564): Terminating (SIGTERM) 21:36:17.282531 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30567): Terminating (SIGTERM) 21:36:17.326794 --- ParallelTerminationStrategy: PID 30561 died... 21:36:17.347588 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30561): Terminated: ok {rc=0} 21:36:17.396904 --- ParallelTerminationStrategy: PID 30564 died... 21:36:17.417340 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30564): Terminated: ok {rc=0} 21:36:17.466529 --- ParallelTerminationStrategy: PID 30567 died... 21:36:17.487058 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30567): Terminated: ok {rc=0} 21:36:17.579122 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 21:36:18.667980 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:36:18.680215 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:36:18.731891 tst ping_idle_ping.py: using LAC 31656 21:36:18.862465 tst ping_idle_ping.py: using RAC 36 21:36:18.990854 tst ping_idle_ping.py: using CellId 31656 21:36:19.121455 tst ping_idle_ping.py: using BVCI 31657 21:36:19.234278 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:36:19.245803 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:36:19.256880 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:36:19.268241 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:36:19.280382 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:36:19.291746 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:36:19.303311 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:36:19.314773 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:36:19.432224 tst ping_idle_ping.py:24: start network... 21:36:19.638753 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:36:20.117323 run create_hlr_db(pid=30569): Launched 21:36:20.243857 bus /gobi_6: Setting Powered False 21:36:21.305874 run create_hlr_db(pid=30569): Terminated: ok {rc=0} 21:36:21.736186 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30571): Launched 21:36:22.068284 run osmo-hlr_10.42.42.2(pid=30572): Launched 21:36:22.184226 run osmo-stp_10.42.42.5: Starting osmo-stp 21:36:22.728532 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30574): Launched 21:36:23.034757 run osmo-stp_10.42.42.5(pid=30575): Launched 21:36:23.151367 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:36:23.679661 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30577): Launched 21:36:23.795911 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:36:24.056807 run patchelf(pid=30578): Launched 21:36:24.226202 run osmo-stp_10.42.42.5(pid=30575): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30575)] 21:36:24.354960 run osmo-stp_10.42.42.5(pid=30575): stdout: | (launched: 2022-12-12_21:36:22.977158) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:36:24.485741 run osmo-stp_10.42.42.5(pid=30575): stderr: | 20221212213623150 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213623151 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213623151 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213623151 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213623152 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213623152 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213623152 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:36:24.616521 run osmo-stp_10.42.42.5(pid=30575): stdout: | (launched: 2022-12-12_21:36:22.977158) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:36:24.741165 run osmo-stp_10.42.42.5(pid=30575): stderr: | 20221212213623150 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213623151 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213623151 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213623151 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213623152 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213623152 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213623152 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:36:24.889083 run patchelf(pid=30578): Terminating (SIGINT) 21:36:25.060060 run patchelf(pid=30578): Terminated: ok {rc=0} 21:36:25.183849 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=30575): Process ended prematurely: osmo-stp_10.42.42.5(pid=30575) [trial-2382↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30575)] [trial-2382↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27] 21:36:25.192690 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 21:36:25.219987 run osmo-hlr_10.42.42.2(pid=30572): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30572)] 21:36:25.268483 run osmo-hlr_10.42.42.2(pid=30572): stdout: | (launched: 2022-12-12_21:36:22.010634) 21:36:25.318766 run osmo-hlr_10.42.42.2(pid=30572): stderr: | 20221212213622191 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212213622191 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212213622191 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212213622191 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212213622191 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212213622191 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212213622203 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212213622214 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212213622214 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212213622214 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:36:25.369553 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30571): Terminating (SIGTERM) 21:36:25.409591 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30574): Terminating (SIGTERM) 21:36:25.449572 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30577): Terminating (SIGTERM) 21:36:25.489896 --- ParallelTerminationStrategy: PID 30571 died... 21:36:25.509241 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30571): Terminated: ok {rc=0} 21:36:25.553911 --- ParallelTerminationStrategy: PID 30574 died... 21:36:25.572671 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30574): Terminated: ok {rc=0} 21:36:25.617174 --- ParallelTerminationStrategy: PID 30577 died... 21:36:25.635822 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30577): Terminated: ok {rc=0} 21:36:25.723557 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2382 gprs:trx-lms-limenet-micro+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa --------------------------------------------------------------------- 21:36:27.024067 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:36:27.030051 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 21:36:27.059291 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 21:36:27.097570 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 21:36:27.184641 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 21:36:27.213534 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 21:36:27.251528 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 21:36:27.848512 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2382 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 21:36:27.898648 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:36:27.909749 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 21:36:27.974918 tst cs_paging_gprs_active.py: using LAC 31657 21:36:28.096704 tst cs_paging_gprs_active.py: using RAC 37 21:36:28.220622 tst cs_paging_gprs_active.py: using CellId 31657 21:36:28.344519 tst cs_paging_gprs_active.py: using BVCI 31658 21:36:28.458772 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:36:28.470029 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:36:28.480833 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:36:28.491882 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:36:28.502793 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:36:28.513719 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:36:28.524695 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:36:28.535634 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:36:28.546772 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:36:28.662244 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:36:28.780101 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 21:36:28.990492 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:36:29.304355 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30582): Launched 21:36:29.576612 run iperf3-srv_10.42.42.10(pid=30583): Launched 21:36:29.694584 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 21:36:29.903436 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:36:30.217933 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30584): Launched 21:36:30.489682 run iperf3-srv_10.42.42.10(pid=30585): Launched 21:36:30.606974 tst cs_paging_gprs_active.py:38: start network... 21:36:30.817372 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:36:31.332822 run create_hlr_db(pid=30586): Launched 21:36:31.494940 bus /gobi_6: Setting Powered False 21:36:32.560333 run create_hlr_db(pid=30586): Terminated: ok {rc=0} 21:36:33.007004 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30588): Launched 21:36:33.320581 run osmo-hlr_10.42.42.2(pid=30589): Launched 21:36:33.440005 run osmo-stp_10.42.42.5: Starting osmo-stp 21:36:33.979560 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30591): Launched 21:36:34.291931 run osmo-stp_10.42.42.5(pid=30592): Launched 21:36:34.410748 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:36:34.949364 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30594): Launched 21:36:35.069193 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:36:35.335255 run patchelf(pid=30595): Launched 21:36:35.508129 run osmo-stp_10.42.42.5(pid=30592): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30592)] 21:36:35.640096 run osmo-stp_10.42.42.5(pid=30592): stdout: | (launched: 2022-12-12_21:36:34.233477) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:36:35.773389 run osmo-stp_10.42.42.5(pid=30592): stderr: | 20221212213634410 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213634410 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213634410 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213634411 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213634411 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213634411 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213634411 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:36:35.906395 run osmo-stp_10.42.42.5(pid=30592): stdout: | (launched: 2022-12-12_21:36:34.233477) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:36:36.033647 run osmo-stp_10.42.42.5(pid=30592): stderr: | 20221212213634410 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213634410 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213634410 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213634411 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213634411 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213634411 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213634411 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:36:36.185123 run patchelf(pid=30595): Terminating (SIGINT) 21:36:36.360561 run patchelf(pid=30595): Terminated: ok {rc=0} 21:36:36.487310 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=30592): Process ended prematurely: osmo-stp_10.42.42.5(pid=30592) [trial-2382↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30592)] [trial-2382↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 21:36:36.496919 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 21:36:36.524678 run osmo-hlr_10.42.42.2(pid=30589): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30589)] 21:36:36.573384 run osmo-hlr_10.42.42.2(pid=30589): stdout: | (launched: 2022-12-12_21:36:33.261906) 21:36:36.623763 run osmo-hlr_10.42.42.2(pid=30589): stderr: | 20221212213633443 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212213633443 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212213633443 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212213633443 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212213633443 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212213633443 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212213633465 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212213633475 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212213633475 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212213633475 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:36:36.674536 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30582): Terminating (SIGTERM) 21:36:36.715155 run iperf3-srv_10.42.42.10(pid=30583): Terminating (SIGTERM) 21:36:36.755484 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30584): Terminating (SIGTERM) 21:36:36.795918 run iperf3-srv_10.42.42.10(pid=30585): Terminating (SIGTERM) 21:36:36.836223 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30588): Terminating (SIGTERM) 21:36:36.876725 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30591): Terminating (SIGTERM) 21:36:36.927993 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30594): Terminating (SIGTERM) 21:36:36.968188 --- ParallelTerminationStrategy: PID 30582 died... 21:36:36.987451 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30582): Terminated: ok {rc=0} 21:36:37.031569 --- ParallelTerminationStrategy: PID 30583 died... 21:36:37.050234 run iperf3-srv_10.42.42.10(pid=30583): Terminated {rc=256} 21:36:37.094207 --- ParallelTerminationStrategy: PID 30584 died... 21:36:37.112872 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30584): Terminated: ok {rc=0} 21:36:37.157126 --- ParallelTerminationStrategy: PID 30585 died... 21:36:37.175698 run iperf3-srv_10.42.42.10(pid=30585): Terminated {rc=256} 21:36:37.219720 --- ParallelTerminationStrategy: PID 30588 died... 21:36:37.238515 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30588): Terminated: ok {rc=0} 21:36:37.282477 --- ParallelTerminationStrategy: PID 30591 died... 21:36:37.301140 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30591): Terminated: ok {rc=0} 21:36:37.345275 --- ParallelTerminationStrategy: PID 30594 died... 21:36:37.364044 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30594): Terminated: ok {rc=0} 21:36:37.450972 bus /gobi_0: Setting Powered False 21:36:38.552604 bus /gobi_0: Setting Powered False 21:36:39.669768 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 21:36:40.823363 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:36:40.835626 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 21:36:40.905923 tst iperf3.py: using LAC 31658 21:36:41.037423 tst iperf3.py: using RAC 38 21:36:41.167608 tst iperf3.py: using CellId 31658 21:36:41.291653 tst iperf3.py: using BVCI 31659 21:36:41.406685 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:36:41.418062 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:36:41.429406 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:36:41.440315 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:36:41.451121 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:36:41.462255 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:36:41.473357 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:36:41.484044 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:36:41.494975 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:36:41.614207 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 21:36:41.839083 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:36:42.172059 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30596): Launched 21:36:42.461481 run iperf3-srv_10.42.42.10(pid=30597): Launched 21:36:42.586733 tst iperf3.py:8: start network... 21:36:42.812177 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:36:43.328149 run create_hlr_db(pid=30598): Launched 21:36:43.455580 bus /gobi_6: Setting Powered False 21:36:44.521151 run create_hlr_db(pid=30598): Terminated: ok {rc=0} 21:36:44.961648 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30600): Launched 21:36:45.271425 run osmo-hlr_10.42.42.2(pid=30601): Launched 21:36:45.390449 run osmo-stp_10.42.42.5: Starting osmo-stp 21:36:45.942604 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30603): Launched 21:36:46.335288 run osmo-stp_10.42.42.5(pid=30604): Launched 21:36:46.700723 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:36:47.273712 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30606): Launched 21:36:47.410180 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:36:47.669108 run patchelf(pid=30607): Launched 21:36:47.839784 run osmo-stp_10.42.42.5(pid=30604): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30604)] 21:36:47.969379 run osmo-stp_10.42.42.5(pid=30604): stdout: | (launched: 2022-12-12_21:36:46.256660) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:36:48.100148 run osmo-stp_10.42.42.5(pid=30604): stderr: | 20221212213646597 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213646598 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213646599 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213646599 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213646601 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213646602 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213646602 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:36:48.231311 run osmo-stp_10.42.42.5(pid=30604): stdout: | (launched: 2022-12-12_21:36:46.256660) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:36:48.357230 run osmo-stp_10.42.42.5(pid=30604): stderr: | 20221212213646597 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213646598 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213646599 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213646599 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213646601 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213646602 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213646602 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:36:48.506090 run patchelf(pid=30607): Terminating (SIGINT) 21:36:48.678927 run patchelf(pid=30607): Terminated: ok {rc=0} 21:36:48.803725 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30604): Process ended prematurely: osmo-stp_10.42.42.5(pid=30604) [trial-2382↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30604)] [trial-2382↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8] 21:36:48.813391 tst iperf3.py:8: Test FAILED (8.0 sec) 21:36:48.840922 run osmo-hlr_10.42.42.2(pid=30601): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30601)] 21:36:48.889255 run osmo-hlr_10.42.42.2(pid=30601): stdout: | (launched: 2022-12-12_21:36:45.214300) 21:36:48.939258 run osmo-hlr_10.42.42.2(pid=30601): stderr: | 20221212213645390 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212213645390 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212213645390 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212213645390 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212213645390 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212213645391 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212213645402 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212213645410 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212213645410 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212213645410 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:36:48.989894 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30596): Terminating (SIGTERM) 21:36:49.030140 run iperf3-srv_10.42.42.10(pid=30597): Terminating (SIGTERM) 21:36:49.070360 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30600): Terminating (SIGTERM) 21:36:49.110848 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30603): Terminating (SIGTERM) 21:36:49.151116 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30606): Terminating (SIGTERM) 21:36:49.191716 --- ParallelTerminationStrategy: PID 30596 died... 21:36:49.211077 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30596): Terminated: ok {rc=0} 21:36:49.255614 --- ParallelTerminationStrategy: PID 30597 died... 21:36:49.274338 run iperf3-srv_10.42.42.10(pid=30597): Terminated {rc=256} 21:36:49.318711 --- ParallelTerminationStrategy: PID 30600 died... 21:36:49.337601 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30600): Terminated: ok {rc=0} 21:36:49.382272 --- ParallelTerminationStrategy: PID 30603 died... 21:36:49.401077 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30603): Terminated: ok {rc=0} 21:36:49.445657 --- ParallelTerminationStrategy: PID 30606 died... 21:36:49.464843 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30606): Terminated: ok {rc=0} 21:36:49.552027 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 21:36:50.700381 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:36:50.712037 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 21:36:50.777379 tst iperf3m4.py: using LAC 31659 21:36:50.905972 tst iperf3m4.py: using RAC 39 21:36:51.036701 tst iperf3m4.py: using CellId 31659 21:36:51.166698 tst iperf3m4.py: using BVCI 31660 21:36:51.287192 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:36:51.298952 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:36:51.310466 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:36:51.322190 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:36:51.333849 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:36:51.345514 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:36:51.357244 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:36:51.368740 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:36:51.380535 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:36:51.501957 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:36:51.622805 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:36:51.739350 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:36:51.859902 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 21:36:52.082546 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:36:52.411402 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30608): Launched 21:36:52.696517 run iperf3-srv_10.42.42.10(pid=30609): Launched 21:36:52.820220 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 21:36:53.042403 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:36:53.371550 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30610): Launched 21:36:53.655944 run iperf3-srv_10.42.42.10(pid=30611): Launched 21:36:53.779207 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 21:36:54.000500 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:36:54.329649 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30612): Launched 21:36:54.615394 run iperf3-srv_10.42.42.10(pid=30613): Launched 21:36:54.738239 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 21:36:54.959473 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:36:55.288464 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30614): Launched 21:36:55.572737 run iperf3-srv_10.42.42.10(pid=30615): Launched 21:36:55.695330 tst iperf3m4.py:8: start network... 21:36:55.916554 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:36:56.423884 run create_hlr_db(pid=30616): Launched 21:36:56.549660 bus /gobi_6: Setting Powered False 21:36:57.615021 run create_hlr_db(pid=30616): Terminated: ok {rc=0} 21:36:58.069280 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30618): Launched 21:36:58.395454 run osmo-hlr_10.42.42.2(pid=30619): Launched 21:36:58.521995 run osmo-stp_10.42.42.5: Starting osmo-stp 21:36:59.088610 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30621): Launched 21:36:59.416221 run osmo-stp_10.42.42.5(pid=30622): Launched 21:36:59.542484 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:37:00.108769 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30624): Launched 21:37:00.234357 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:37:00.511114 run patchelf(pid=30625): Launched 21:37:00.692632 run osmo-stp_10.42.42.5(pid=30622): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30622)] 21:37:00.834579 run osmo-stp_10.42.42.5(pid=30622): stdout: | (launched: 2022-12-12_21:36:59.356739) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:37:00.981759 run osmo-stp_10.42.42.5(pid=30622): stderr: | 20221212213659551 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213659551 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213659551 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213659552 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213659554 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213659554 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213659554 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:37:01.128294 run osmo-stp_10.42.42.5(pid=30622): stdout: | (launched: 2022-12-12_21:36:59.356739) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:37:01.267613 run osmo-stp_10.42.42.5(pid=30622): stderr: | 20221212213659551 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213659551 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213659551 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213659552 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213659554 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213659554 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213659554 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:37:01.433456 run patchelf(pid=30625): Terminating (SIGINT) 21:37:01.622549 run patchelf(pid=30625): Terminated: ok {rc=0} 21:37:01.759629 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30622): Process ended prematurely: osmo-stp_10.42.42.5(pid=30622) [trial-2382↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30622)] [trial-2382↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8] 21:37:01.773284 tst iperf3m4.py:8: Test FAILED (11.1 sec) 21:37:01.806562 run osmo-hlr_10.42.42.2(pid=30619): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30619)] 21:37:01.860438 run osmo-hlr_10.42.42.2(pid=30619): stdout: | (launched: 2022-12-12_21:36:58.336226) 21:37:01.915789 run osmo-hlr_10.42.42.2(pid=30619): stderr: | 20221212213658535 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212213658535 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212213658535 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212213658535 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212213658535 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212213658535 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212213658547 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212213658555 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212213658555 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212213658556 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:37:01.971740 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30608): Terminating (SIGTERM) 21:37:02.017310 run iperf3-srv_10.42.42.10(pid=30609): Terminating (SIGTERM) 21:37:02.063176 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30610): Terminating (SIGTERM) 21:37:02.108152 run iperf3-srv_10.42.42.10(pid=30611): Terminating (SIGTERM) 21:37:02.153472 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30612): Terminating (SIGTERM) 21:37:02.196428 run iperf3-srv_10.42.42.10(pid=30613): Terminating (SIGTERM) 21:37:02.238998 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30614): Terminating (SIGTERM) 21:37:02.281978 run iperf3-srv_10.42.42.10(pid=30615): Terminating (SIGTERM) 21:37:02.324489 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30618): Terminating (SIGTERM) 21:37:02.367137 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30621): Terminating (SIGTERM) 21:37:02.409666 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30624): Terminating (SIGTERM) 21:37:02.452781 --- ParallelTerminationStrategy: PID 30608 died... 21:37:02.472850 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30608): Terminated: ok {rc=0} 21:37:02.520477 --- ParallelTerminationStrategy: PID 30609 died... 21:37:02.540364 run iperf3-srv_10.42.42.10(pid=30609): Terminated {rc=256} 21:37:02.587550 --- ParallelTerminationStrategy: PID 30610 died... 21:37:02.607346 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30610): Terminated: ok {rc=0} 21:37:02.654684 --- ParallelTerminationStrategy: PID 30611 died... 21:37:02.674475 run iperf3-srv_10.42.42.10(pid=30611): Terminated {rc=256} 21:37:02.721873 --- ParallelTerminationStrategy: PID 30612 died... 21:37:02.741850 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30612): Terminated: ok {rc=0} 21:37:02.789365 --- ParallelTerminationStrategy: PID 30613 died... 21:37:02.809223 run iperf3-srv_10.42.42.10(pid=30613): Terminated {rc=256} 21:37:02.856626 --- ParallelTerminationStrategy: PID 30614 died... 21:37:02.876449 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30614): Terminated: ok {rc=0} 21:37:02.923937 --- ParallelTerminationStrategy: PID 30615 died... 21:37:02.943783 run iperf3-srv_10.42.42.10(pid=30615): Terminated {rc=256} 21:37:02.991171 --- ParallelTerminationStrategy: PID 30618 died... 21:37:03.011041 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30618): Terminated: ok {rc=0} 21:37:03.058562 --- ParallelTerminationStrategy: PID 30621 died... 21:37:03.078501 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30621): Terminated: ok {rc=0} 21:37:03.126072 --- ParallelTerminationStrategy: PID 30624 died... 21:37:03.146120 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30624): Terminated: ok {rc=0} 21:37:03.235630 bus /gobi_4: Setting Powered False 21:37:04.335812 bus /gobi_4: Setting Powered False 21:37:05.452837 bus /gobi_1: Setting Powered False 21:37:06.551529 bus /gobi_1: Setting Powered False 21:37:07.669255 bus /gobi_0: Setting Powered False 21:37:08.767969 bus /gobi_0: Setting Powered False 21:37:09.886281 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 21:37:10.989978 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:37:11.002085 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 21:37:11.070233 tst ping.py: using LAC 31660 21:37:11.198013 tst ping.py: using RAC 40 21:37:11.325085 tst ping.py: using CellId 31660 21:37:11.453649 tst ping.py: using BVCI 31661 21:37:11.563640 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:37:11.575018 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:37:11.586289 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:37:11.597672 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:37:11.608610 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:37:11.619559 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:37:11.630533 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:37:11.641427 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:37:11.758618 tst ping.py:19: start network... 21:37:11.975691 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:37:12.473852 run create_hlr_db(pid=30626): Launched 21:37:12.597440 bus /gobi_6: Setting Powered False 21:37:13.661758 run create_hlr_db(pid=30626): Terminated: ok {rc=0} 21:37:14.092177 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30628): Launched 21:37:14.394554 run osmo-hlr_10.42.42.2(pid=30629): Launched 21:37:14.509602 run osmo-stp_10.42.42.5: Starting osmo-stp 21:37:15.045124 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30631): Launched 21:37:15.344388 run osmo-stp_10.42.42.5(pid=30632): Launched 21:37:15.458105 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:37:16.022103 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30634): Launched 21:37:16.140478 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:37:16.403519 run patchelf(pid=30635): Launched 21:37:16.589162 run osmo-stp_10.42.42.5(pid=30632): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30632)] 21:37:16.719200 run osmo-stp_10.42.42.5(pid=30632): stdout: | (launched: 2022-12-12_21:37:15.289570) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:37:16.850779 run osmo-stp_10.42.42.5(pid=30632): stderr: | 20221212213715459 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213715460 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213715460 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213715460 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213715461 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213715461 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213715461 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:37:16.982422 run osmo-stp_10.42.42.5(pid=30632): stdout: | (launched: 2022-12-12_21:37:15.289570) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:37:17.108437 run osmo-stp_10.42.42.5(pid=30632): stderr: | 20221212213715459 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213715460 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213715460 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213715460 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213715461 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213715461 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213715461 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:37:17.255885 run patchelf(pid=30635): Terminating (SIGINT) 21:37:17.424911 run patchelf(pid=30635): Terminated: ok {rc=0} 21:37:17.547405 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=30632): Process ended prematurely: osmo-stp_10.42.42.5(pid=30632) [trial-2382↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30632)] [trial-2382↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22] 21:37:17.556470 tst ping.py:22: Test FAILED (6.6 sec) 21:37:17.583690 run osmo-hlr_10.42.42.2(pid=30629): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30629)] 21:37:17.632037 run osmo-hlr_10.42.42.2(pid=30629): stdout: | (launched: 2022-12-12_21:37:14.338828) 21:37:17.682571 run osmo-hlr_10.42.42.2(pid=30629): stderr: | 20221212213714517 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212213714517 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212213714517 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212213714517 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212213714517 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212213714517 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212213714529 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212213714538 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212213714538 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212213714538 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:37:17.733415 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30628): Terminating (SIGTERM) 21:37:17.773937 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30631): Terminating (SIGTERM) 21:37:17.814508 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30634): Terminating (SIGTERM) 21:37:17.855239 --- ParallelTerminationStrategy: PID 30628 died... 21:37:17.874834 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30628): Terminated: ok {rc=0} 21:37:17.919819 --- ParallelTerminationStrategy: PID 30631 died... 21:37:17.938848 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30631): Terminated: ok {rc=0} 21:37:17.983950 --- ParallelTerminationStrategy: PID 30634 died... 21:37:18.002956 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30634): Terminated: ok {rc=0} 21:37:18.090397 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 21:37:19.180886 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:37:19.193071 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 21:37:19.260317 tst ping_idle_ping.py: using LAC 31661 21:37:19.379816 tst ping_idle_ping.py: using RAC 41 21:37:19.500929 tst ping_idle_ping.py: using CellId 31661 21:37:19.621064 tst ping_idle_ping.py: using BVCI 31662 21:37:19.731106 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:37:19.742346 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:37:19.753217 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:37:19.764084 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:37:19.775005 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:37:19.785936 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:37:19.796895 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:37:19.807761 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:37:19.928138 tst ping_idle_ping.py:24: start network... 21:37:20.145329 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:37:20.648820 run create_hlr_db(pid=30636): Launched 21:37:20.771851 bus /gobi_6: Setting Powered False 21:37:21.835585 run create_hlr_db(pid=30636): Terminated: ok {rc=0} 21:37:22.267003 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30638): Launched 21:37:22.568678 run osmo-hlr_10.42.42.2(pid=30639): Launched 21:37:22.683661 run osmo-stp_10.42.42.5: Starting osmo-stp 21:37:23.202068 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30641): Launched 21:37:23.502441 run osmo-stp_10.42.42.5(pid=30642): Launched 21:37:23.617621 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:37:24.138422 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30644): Launched 21:37:24.253186 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:37:24.507569 run patchelf(pid=30645): Launched 21:37:24.674990 run osmo-stp_10.42.42.5(pid=30642): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30642)] 21:37:24.802661 run osmo-stp_10.42.42.5(pid=30642): stdout: | (launched: 2022-12-12_21:37:23.447463) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:37:24.931667 run osmo-stp_10.42.42.5(pid=30642): stderr: | 20221212213723616 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213723616 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213723616 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213723617 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213723617 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213723617 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213723617 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:37:25.060534 run osmo-stp_10.42.42.5(pid=30642): stdout: | (launched: 2022-12-12_21:37:23.447463) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:37:25.184428 run osmo-stp_10.42.42.5(pid=30642): stderr: | 20221212213723616 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213723616 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213723616 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213723617 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213723617 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213723617 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213723617 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:37:25.331448 run patchelf(pid=30645): Terminating (SIGINT) 21:37:25.501236 run patchelf(pid=30645): Terminated: ok {rc=0} 21:37:25.623747 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=30642): Process ended prematurely: osmo-stp_10.42.42.5(pid=30642) [trial-2382↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30642)] [trial-2382↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 21:37:25.632675 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 21:37:25.659668 run osmo-hlr_10.42.42.2(pid=30639): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30639)] 21:37:25.707833 run osmo-hlr_10.42.42.2(pid=30639): stdout: | (launched: 2022-12-12_21:37:22.513505) 21:37:25.757767 run osmo-hlr_10.42.42.2(pid=30639): stderr: | 20221212213722690 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212213722690 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212213722690 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212213722691 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212213722691 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212213722691 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212213722707 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212213722715 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212213722716 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212213722716 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:37:25.808334 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30638): Terminating (SIGTERM) 21:37:25.848747 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30641): Terminating (SIGTERM) 21:37:25.889205 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30644): Terminating (SIGTERM) 21:37:25.930401 --- ParallelTerminationStrategy: PID 30638 died... 21:37:25.949762 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30638): Terminated: ok {rc=0} 21:37:25.994334 --- ParallelTerminationStrategy: PID 30641 died... 21:37:26.012890 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30641): Terminated: ok {rc=0} 21:37:26.057938 --- ParallelTerminationStrategy: PID 30644 died... 21:37:26.076986 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30644): Terminated: ok {rc=0} 21:37:26.163581 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2382 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 21:37:27.469138 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:37:27.475469 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 21:37:27.504794 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 21:37:27.542939 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 21:37:27.629241 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 21:37:27.657909 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 21:37:27.695830 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 21:37:28.292139 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2382 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 21:37:28.341311 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:37:28.352366 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 21:37:28.418246 tst cs_paging_gprs_active.py: using LAC 31662 21:37:28.538858 tst cs_paging_gprs_active.py: using RAC 42 21:37:28.661248 tst cs_paging_gprs_active.py: using CellId 31662 21:37:28.785949 tst cs_paging_gprs_active.py: using BVCI 31663 21:37:28.898289 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:37:28.909507 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:37:28.920341 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:37:28.931251 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:37:28.942244 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:37:28.953246 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:37:28.964271 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:37:28.975077 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:37:28.986119 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 21:37:29.107801 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 21:37:29.231576 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 21:37:29.455333 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:37:29.785688 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30651): Launched 21:37:30.070462 run iperf3-srv_10.42.42.10(pid=30652): Launched 21:37:30.193831 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 21:37:30.416299 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:37:30.747326 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30653): Launched 21:37:31.047439 run iperf3-srv_10.42.42.10(pid=30654): Launched 21:37:31.190024 tst cs_paging_gprs_active.py:38: start network... 21:37:31.427479 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:37:31.964206 run create_hlr_db(pid=30655): Launched 21:37:32.124592 bus /gobi_6: Setting Powered False 21:37:33.189676 run create_hlr_db(pid=30655): Terminated: ok {rc=0} 21:37:33.645895 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30657): Launched 21:37:33.973615 run osmo-hlr_10.42.42.2(pid=30658): Launched 21:37:34.099684 run osmo-stp_10.42.42.5: Starting osmo-stp 21:37:34.666804 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30660): Launched 21:37:34.993545 run osmo-stp_10.42.42.5(pid=30661): Launched 21:37:35.119087 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:37:35.687398 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30663): Launched 21:37:35.812884 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:37:36.098284 run patchelf(pid=30664): Launched 21:37:36.281291 run osmo-stp_10.42.42.5(pid=30661): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30661)] 21:37:36.420394 run osmo-stp_10.42.42.5(pid=30661): stdout: | (launched: 2022-12-12_21:37:34.934025) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:37:36.562083 run osmo-stp_10.42.42.5(pid=30661): stderr: | 20221212213735127 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213735127 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213735128 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213735128 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213735128 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213735129 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213735129 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:37:36.703201 run osmo-stp_10.42.42.5(pid=30661): stdout: | (launched: 2022-12-12_21:37:34.934025) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:37:36.838386 run osmo-stp_10.42.42.5(pid=30661): stderr: | 20221212213735127 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213735127 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213735128 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213735128 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213735128 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213735129 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213735129 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:37:36.998764 run patchelf(pid=30664): Terminating (SIGINT) 21:37:37.184248 run patchelf(pid=30664): Terminated: ok {rc=0} 21:37:37.317867 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=30661): Process ended prematurely: osmo-stp_10.42.42.5(pid=30661) [trial-2382↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30661)] [trial-2382↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 21:37:37.328209 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 21:37:37.358782 run osmo-hlr_10.42.42.2(pid=30658): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30658)] 21:37:37.407970 run osmo-hlr_10.42.42.2(pid=30658): stdout: | (launched: 2022-12-12_21:37:33.913845) 21:37:37.458702 run osmo-hlr_10.42.42.2(pid=30658): stderr: | 20221212213734117 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212213734117 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212213734117 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212213734117 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212213734117 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212213734117 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212213734129 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212213734137 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212213734137 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212213734137 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:37:37.510214 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30651): Terminating (SIGTERM) 21:37:37.551079 run iperf3-srv_10.42.42.10(pid=30652): Terminating (SIGTERM) 21:37:37.591858 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30653): Terminating (SIGTERM) 21:37:37.633066 run iperf3-srv_10.42.42.10(pid=30654): Terminating (SIGTERM) 21:37:37.673915 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30657): Terminating (SIGTERM) 21:37:37.714612 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30660): Terminating (SIGTERM) 21:37:37.755421 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30663): Terminating (SIGTERM) 21:37:37.795845 --- ParallelTerminationStrategy: PID 30651 died... 21:37:37.815341 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30651): Terminated: ok {rc=0} 21:37:37.860071 --- ParallelTerminationStrategy: PID 30652 died... 21:37:37.878857 run iperf3-srv_10.42.42.10(pid=30652): Terminated {rc=256} 21:37:37.923438 --- ParallelTerminationStrategy: PID 30653 died... 21:37:37.942517 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30653): Terminated: ok {rc=0} 21:37:37.987131 --- ParallelTerminationStrategy: PID 30654 died... 21:37:38.006178 run iperf3-srv_10.42.42.10(pid=30654): Terminated {rc=256} 21:37:38.050541 --- ParallelTerminationStrategy: PID 30657 died... 21:37:38.069768 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30657): Terminated: ok {rc=0} 21:37:38.114920 --- ParallelTerminationStrategy: PID 30660 died... 21:37:38.134456 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30660): Terminated: ok {rc=0} 21:37:38.179120 --- ParallelTerminationStrategy: PID 30663 died... 21:37:38.197969 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30663): Terminated: ok {rc=0} 21:37:38.283818 bus /gobi_0: Setting Powered False 21:37:39.385719 bus /gobi_0: Setting Powered False 21:37:40.500171 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 21:37:41.651697 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:37:41.664070 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 21:37:41.735759 tst iperf3.py: using LAC 31663 21:37:41.864910 tst iperf3.py: using RAC 43 21:37:41.992567 tst iperf3.py: using CellId 31663 21:37:42.120708 tst iperf3.py: using BVCI 31664 21:37:42.241303 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:37:42.252934 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:37:42.264393 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:37:42.276194 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:37:42.287966 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:37:42.299618 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:37:42.311432 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:37:42.323057 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:37:42.334907 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 21:37:42.457746 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 21:37:42.679275 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:37:43.007442 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30665): Launched 21:37:43.292025 run iperf3-srv_10.42.42.10(pid=30666): Launched 21:37:43.415077 tst iperf3.py:8: start network... 21:37:43.637485 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:37:44.146294 run create_hlr_db(pid=30667): Launched 21:37:44.271142 bus /gobi_6: Setting Powered False 21:37:45.336871 run create_hlr_db(pid=30667): Terminated: ok {rc=0} 21:37:45.776059 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30669): Launched 21:37:46.125186 run osmo-hlr_10.42.42.2(pid=30670): Launched 21:37:46.354658 run osmo-stp_10.42.42.5: Starting osmo-stp 21:37:47.017802 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30672): Launched 21:37:47.366503 run osmo-stp_10.42.42.5(pid=30673): Launched 21:37:47.494880 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:37:48.062096 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30675): Launched 21:37:48.188404 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:37:48.466366 run patchelf(pid=30676): Launched 21:37:48.648907 run osmo-stp_10.42.42.5(pid=30673): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30673)] 21:37:48.788159 run osmo-stp_10.42.42.5(pid=30673): stdout: | (launched: 2022-12-12_21:37:47.306994) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:37:48.929099 run osmo-stp_10.42.42.5(pid=30673): stderr: | 20221212213747500 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213747500 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213747500 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213747501 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213747501 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213747501 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213747501 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:37:49.070262 run osmo-stp_10.42.42.5(pid=30673): stdout: | (launched: 2022-12-12_21:37:47.306994) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:37:49.205775 run osmo-stp_10.42.42.5(pid=30673): stderr: | 20221212213747500 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213747500 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213747500 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213747501 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213747501 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213747501 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213747501 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:37:49.366298 run patchelf(pid=30676): Terminating (SIGINT) 21:37:49.552113 run patchelf(pid=30676): Terminated: ok {rc=0} 21:37:49.685899 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30673): Process ended prematurely: osmo-stp_10.42.42.5(pid=30673) [trial-2382↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30673)] [trial-2382↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8] 21:37:49.696188 tst iperf3.py:8: Test FAILED (8.1 sec) 21:37:49.725926 run osmo-hlr_10.42.42.2(pid=30670): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30670)] 21:37:49.777470 run osmo-hlr_10.42.42.2(pid=30670): stdout: | (launched: 2022-12-12_21:37:46.062150) 21:37:49.831202 run osmo-hlr_10.42.42.2(pid=30670): stderr: | 20221212213746269 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212213746269 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212213746269 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212213746269 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212213746269 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212213746269 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212213746285 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212213746309 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212213746309 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212213746310 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:37:49.885260 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30665): Terminating (SIGTERM) 21:37:49.928201 run iperf3-srv_10.42.42.10(pid=30666): Terminating (SIGTERM) 21:37:49.971129 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30669): Terminating (SIGTERM) 21:37:50.014090 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30672): Terminating (SIGTERM) 21:37:50.056938 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30675): Terminating (SIGTERM) 21:37:50.100160 --- ParallelTerminationStrategy: PID 30665 died... 21:37:50.120497 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30665): Terminated: ok {rc=0} 21:37:50.168318 --- ParallelTerminationStrategy: PID 30666 died... 21:37:50.188130 run iperf3-srv_10.42.42.10(pid=30666): Terminated {rc=256} 21:37:50.235524 --- ParallelTerminationStrategy: PID 30669 died... 21:37:50.255433 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30669): Terminated: ok {rc=0} 21:37:50.303081 --- ParallelTerminationStrategy: PID 30672 died... 21:37:50.323025 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30672): Terminated: ok {rc=0} 21:37:50.370969 --- ParallelTerminationStrategy: PID 30675 died... 21:37:50.390938 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30675): Terminated: ok {rc=0} 21:37:50.481598 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 21:37:51.635459 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:37:51.647940 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 21:37:51.715228 tst iperf3m4.py: using LAC 31664 21:37:51.842416 tst iperf3m4.py: using RAC 44 21:37:51.970778 tst iperf3m4.py: using CellId 31664 21:37:52.098023 tst iperf3m4.py: using BVCI 31665 21:37:52.217847 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:37:52.229510 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:37:52.240897 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:37:52.252681 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:37:52.264528 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:37:52.276303 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:37:52.287963 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:37:52.299543 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:37:52.311396 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 21:37:52.428631 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 21:37:52.553668 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 21:37:52.673239 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 21:37:52.794959 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 21:37:53.018080 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:37:53.348512 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30677): Launched 21:37:53.634731 run iperf3-srv_10.42.42.10(pid=30678): Launched 21:37:53.758530 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 21:37:53.981021 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:37:54.295132 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30679): Launched 21:37:54.561642 run iperf3-srv_10.42.42.10(pid=30680): Launched 21:37:54.676906 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 21:37:54.883687 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:37:55.192093 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30681): Launched 21:37:55.458048 run iperf3-srv_10.42.42.10(pid=30682): Launched 21:37:55.572396 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 21:37:55.777381 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:37:56.084646 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30683): Launched 21:37:56.351408 run iperf3-srv_10.42.42.10(pid=30684): Launched 21:37:56.466318 tst iperf3m4.py:8: start network... 21:37:56.671703 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:37:57.146239 run create_hlr_db(pid=30685): Launched 21:37:57.272398 bus /gobi_6: Setting Powered False 21:37:58.335300 run create_hlr_db(pid=30685): Terminated: ok {rc=0} 21:37:58.762196 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30687): Launched 21:37:59.068780 run osmo-hlr_10.42.42.2(pid=30688): Launched 21:37:59.185452 run osmo-stp_10.42.42.5: Starting osmo-stp 21:37:59.713318 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30690): Launched 21:38:00.020273 run osmo-stp_10.42.42.5(pid=30691): Launched 21:38:00.137293 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:38:00.685294 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30693): Launched 21:38:00.801964 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:38:01.118828 run patchelf(pid=30694): Launched 21:38:01.314532 run osmo-stp_10.42.42.5(pid=30691): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30691)] 21:38:01.458422 run osmo-stp_10.42.42.5(pid=30691): stdout: | (launched: 2022-12-12_21:37:59.963946) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:38:01.605395 run osmo-stp_10.42.42.5(pid=30691): stderr: | 20221212213800137 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213800137 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213800138 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213800138 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213800139 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213800139 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213800139 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:38:01.751409 run osmo-stp_10.42.42.5(pid=30691): stdout: | (launched: 2022-12-12_21:37:59.963946) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:38:01.892485 run osmo-stp_10.42.42.5(pid=30691): stderr: | 20221212213800137 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213800137 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213800138 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213800138 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213800139 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213800139 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213800139 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:38:02.056917 run patchelf(pid=30694): Terminating (SIGINT) 21:38:02.248215 run patchelf(pid=30694): Terminated: ok {rc=0} 21:38:02.383679 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30691): Process ended prematurely: osmo-stp_10.42.42.5(pid=30691) [trial-2382↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30691)] [trial-2382↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8] 21:38:02.394462 tst iperf3m4.py:8: Test FAILED (10.8 sec) 21:38:02.426070 run osmo-hlr_10.42.42.2(pid=30688): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30688)] 21:38:02.478874 run osmo-hlr_10.42.42.2(pid=30688): stdout: | (launched: 2022-12-12_21:37:59.012396) 21:38:02.533258 run osmo-hlr_10.42.42.2(pid=30688): stderr: | 20221212213759192 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212213759192 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212213759192 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212213759192 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212213759192 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212213759192 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212213759206 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212213759215 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212213759215 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212213759215 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:38:02.588073 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30677): Terminating (SIGTERM) 21:38:02.632194 run iperf3-srv_10.42.42.10(pid=30678): Terminating (SIGTERM) 21:38:02.675959 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30679): Terminating (SIGTERM) 21:38:02.719832 run iperf3-srv_10.42.42.10(pid=30680): Terminating (SIGTERM) 21:38:02.763496 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30681): Terminating (SIGTERM) 21:38:02.807219 run iperf3-srv_10.42.42.10(pid=30682): Terminating (SIGTERM) 21:38:02.850980 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30683): Terminating (SIGTERM) 21:38:02.894841 run iperf3-srv_10.42.42.10(pid=30684): Terminating (SIGTERM) 21:38:02.938823 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30687): Terminating (SIGTERM) 21:38:02.982654 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30690): Terminating (SIGTERM) 21:38:03.026495 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30693): Terminating (SIGTERM) 21:38:03.070637 --- ParallelTerminationStrategy: PID 30677 died... 21:38:03.091210 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30677): Terminated: ok {rc=0} 21:38:03.140554 --- ParallelTerminationStrategy: PID 30678 died... 21:38:03.160716 run iperf3-srv_10.42.42.10(pid=30678): Terminated {rc=256} 21:38:03.209869 --- ParallelTerminationStrategy: PID 30679 died... 21:38:03.230131 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30679): Terminated: ok {rc=0} 21:38:03.279231 --- ParallelTerminationStrategy: PID 30680 died... 21:38:03.299425 run iperf3-srv_10.42.42.10(pid=30680): Terminated {rc=256} 21:38:03.348345 --- ParallelTerminationStrategy: PID 30681 died... 21:38:03.368676 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30681): Terminated: ok {rc=0} 21:38:03.417451 --- ParallelTerminationStrategy: PID 30682 died... 21:38:03.437675 run iperf3-srv_10.42.42.10(pid=30682): Terminated {rc=256} 21:38:03.487181 --- ParallelTerminationStrategy: PID 30683 died... 21:38:03.507760 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30683): Terminated: ok {rc=0} 21:38:03.556896 --- ParallelTerminationStrategy: PID 30684 died... 21:38:03.577191 run iperf3-srv_10.42.42.10(pid=30684): Terminated {rc=256} 21:38:03.626054 --- ParallelTerminationStrategy: PID 30687 died... 21:38:03.646249 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30687): Terminated: ok {rc=0} 21:38:03.695305 --- ParallelTerminationStrategy: PID 30690 died... 21:38:03.715505 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30690): Terminated: ok {rc=0} 21:38:03.764574 --- ParallelTerminationStrategy: PID 30693 died... 21:38:03.784820 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30693): Terminated: ok {rc=0} 21:38:03.875985 bus /gobi_4: Setting Powered False 21:38:04.976115 bus /gobi_4: Setting Powered False 21:38:06.093349 bus /gobi_1: Setting Powered False 21:38:07.195130 bus /gobi_1: Setting Powered False 21:38:08.313302 bus /gobi_0: Setting Powered False 21:38:09.409899 bus /gobi_0: Setting Powered False 21:38:10.525975 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 21:38:11.629532 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:38:11.641094 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 21:38:11.707954 tst ping.py: using LAC 31665 21:38:11.827333 tst ping.py: using RAC 45 21:38:11.948637 tst ping.py: using CellId 31665 21:38:12.068434 tst ping.py: using BVCI 31666 21:38:12.180440 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:38:12.191584 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:38:12.202430 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:38:12.213336 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:38:12.224216 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:38:12.235081 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:38:12.246049 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:38:12.256925 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 21:38:12.376156 tst ping.py:19: start network... 21:38:12.577839 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:38:13.043771 run create_hlr_db(pid=30695): Launched 21:38:13.166406 bus /gobi_6: Setting Powered False 21:38:14.227328 run create_hlr_db(pid=30695): Terminated: ok {rc=0} 21:38:14.647623 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30697): Launched 21:38:14.948544 run osmo-hlr_10.42.42.2(pid=30698): Launched 21:38:15.062861 run osmo-stp_10.42.42.5: Starting osmo-stp 21:38:15.597436 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30700): Launched 21:38:15.908713 run osmo-stp_10.42.42.5(pid=30701): Launched 21:38:16.183630 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:38:16.745859 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30703): Launched 21:38:16.865228 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:38:17.133782 run patchelf(pid=30704): Launched 21:38:17.342320 run osmo-stp_10.42.42.5(pid=30701): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30701)] 21:38:17.470895 run osmo-stp_10.42.42.5(pid=30701): stdout: | (launched: 2022-12-12_21:38:15.847248) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:38:17.599796 run osmo-stp_10.42.42.5(pid=30701): stderr: | 20221212213816073 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213816073 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213816073 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213816074 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213816074 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213816074 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213816074 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:38:17.729426 run osmo-stp_10.42.42.5(pid=30701): stdout: | (launched: 2022-12-12_21:38:15.847248) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:38:17.852837 run osmo-stp_10.42.42.5(pid=30701): stderr: | 20221212213816073 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213816073 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213816073 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213816074 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213816074 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213816074 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213816074 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:38:17.999760 run patchelf(pid=30704): Terminating (SIGINT) 21:38:18.170729 run patchelf(pid=30704): Terminated: ok {rc=0} 21:38:18.293344 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=30701): Process ended prematurely: osmo-stp_10.42.42.5(pid=30701) [trial-2382↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30701)] [trial-2382↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22] 21:38:18.302194 tst ping.py:22: Test FAILED (6.7 sec) 21:38:18.329409 run osmo-hlr_10.42.42.2(pid=30698): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30698)] 21:38:18.378004 run osmo-hlr_10.42.42.2(pid=30698): stdout: | (launched: 2022-12-12_21:38:14.893443) 21:38:18.428407 run osmo-hlr_10.42.42.2(pid=30698): stderr: | 20221212213815069 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212213815069 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212213815070 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212213815070 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212213815070 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212213815070 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212213815087 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212213815096 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212213815097 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212213815097 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:38:18.479642 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30697): Terminating (SIGTERM) 21:38:18.520020 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30700): Terminating (SIGTERM) 21:38:18.560459 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30703): Terminating (SIGTERM) 21:38:18.601252 --- ParallelTerminationStrategy: PID 30697 died... 21:38:18.620705 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30697): Terminated: ok {rc=0} 21:38:18.665433 --- ParallelTerminationStrategy: PID 30700 died... 21:38:18.684242 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30700): Terminated: ok {rc=0} 21:38:18.729205 --- ParallelTerminationStrategy: PID 30703 died... 21:38:18.748073 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30703): Terminated: ok {rc=0} 21:38:18.834495 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 21:38:19.924807 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:38:19.937192 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 21:38:20.005716 tst ping_idle_ping.py: using LAC 31666 21:38:20.126356 tst ping_idle_ping.py: using RAC 46 21:38:20.246413 tst ping_idle_ping.py: using CellId 31666 21:38:20.367607 tst ping_idle_ping.py: using BVCI 31667 21:38:20.480352 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:38:20.491579 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:38:20.502773 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:38:20.513712 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:38:20.524474 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:38:20.535515 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:38:20.546507 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:38:20.557352 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 21:38:20.674596 tst ping_idle_ping.py:24: start network... 21:38:20.877242 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:38:21.347971 run create_hlr_db(pid=30705): Launched 21:38:21.471584 bus /gobi_6: Setting Powered False 21:38:22.534235 run create_hlr_db(pid=30705): Terminated: ok {rc=0} 21:38:22.957700 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30707): Launched 21:38:23.260671 run osmo-hlr_10.42.42.2(pid=30708): Launched 21:38:23.375417 run osmo-stp_10.42.42.5: Starting osmo-stp 21:38:23.895343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30710): Launched 21:38:24.196394 run osmo-stp_10.42.42.5(pid=30711): Launched 21:38:24.311317 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:38:24.832781 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30713): Launched 21:38:24.948416 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:38:25.203807 run patchelf(pid=30714): Launched 21:38:25.371778 run osmo-stp_10.42.42.5(pid=30711): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30711)] 21:38:25.499367 run osmo-stp_10.42.42.5(pid=30711): stdout: | (launched: 2022-12-12_21:38:24.141178) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:38:25.628734 run osmo-stp_10.42.42.5(pid=30711): stderr: | 20221212213824311 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213824311 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213824312 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213824312 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213824312 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213824313 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213824313 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:38:25.758273 run osmo-stp_10.42.42.5(pid=30711): stdout: | (launched: 2022-12-12_21:38:24.141178) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:38:25.882037 run osmo-stp_10.42.42.5(pid=30711): stderr: | 20221212213824311 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213824311 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213824312 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213824312 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213824312 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213824313 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213824313 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:38:26.028411 run patchelf(pid=30714): Terminating (SIGINT) 21:38:26.198514 run patchelf(pid=30714): Terminated: ok {rc=0} 21:38:26.320917 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=30711): Process ended prematurely: osmo-stp_10.42.42.5(pid=30711) [trial-2382↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30711)] [trial-2382↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 21:38:26.329987 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 21:38:26.357065 run osmo-hlr_10.42.42.2(pid=30708): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30708)] 21:38:26.405769 run osmo-hlr_10.42.42.2(pid=30708): stdout: | (launched: 2022-12-12_21:38:23.205148) 21:38:26.456144 run osmo-hlr_10.42.42.2(pid=30708): stderr: | 20221212213823384 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212213823384 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212213823384 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212213823384 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212213823385 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212213823385 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212213823397 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212213823406 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212213823406 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212213823406 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:38:26.507464 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30707): Terminating (SIGTERM) 21:38:26.548542 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30710): Terminating (SIGTERM) 21:38:26.589246 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30713): Terminating (SIGTERM) 21:38:26.630179 --- ParallelTerminationStrategy: PID 30707 died... 21:38:26.649290 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30707): Terminated: ok {rc=0} 21:38:26.694098 --- ParallelTerminationStrategy: PID 30710 died... 21:38:26.713266 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30710): Terminated: ok {rc=0} 21:38:26.758308 --- ParallelTerminationStrategy: PID 30713 died... 21:38:26.777320 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30713): Terminated: ok {rc=0} 21:38:26.865410 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2382 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 21:38:28.168300 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:38:28.174747 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 21:38:28.203726 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 21:38:28.237831 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 21:38:28.291206 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 21:38:28.320258 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 21:38:28.354493 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 21:38:28.912272 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2382 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 21:38:28.917387 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:38:28.928609 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 21:38:28.994548 tst switch_tch_pdch.py: using LAC 31667 21:38:29.114611 tst switch_tch_pdch.py: using RAC 47 21:38:29.233923 tst switch_tch_pdch.py: using CellId 31667 21:38:29.353118 tst switch_tch_pdch.py: using BVCI 31668 21:38:29.463493 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:38:29.474936 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:38:29.486247 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:38:29.497511 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:38:29.508724 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:38:29.520013 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:38:29.531390 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:38:29.542617 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:38:29.661784 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:38:29.784607 tst switch_tch_pdch.py:51: start network... 21:38:30.001462 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:38:30.501633 run create_hlr_db(pid=30718): Launched 21:38:30.627136 bus /gobi_6: Setting Powered False 21:38:31.687063 run create_hlr_db(pid=30718): Terminated: ok {rc=0} 21:38:32.175177 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30720): Launched 21:38:32.502473 run osmo-hlr_10.42.42.2(pid=30721): Launched 21:38:32.627572 run osmo-stp_10.42.42.5: Starting osmo-stp 21:38:33.187635 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30723): Launched 21:38:33.509774 run osmo-stp_10.42.42.5(pid=30724): Launched 21:38:33.634811 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:38:34.194565 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30726): Launched 21:38:34.317252 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:38:34.589857 run patchelf(pid=30727): Launched 21:38:34.769242 run osmo-stp_10.42.42.5(pid=30724): ERR: Terminated: ERROR {rc=1} [trial-2382↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30724)] 21:38:34.905712 run osmo-stp_10.42.42.5(pid=30724): stdout: | (launched: 2022-12-12_21:38:33.450794) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:38:35.044050 run osmo-stp_10.42.42.5(pid=30724): stderr: | 20221212213833642 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213833642 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213833642 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213833643 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213833645 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213833645 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213833645 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:38:35.182583 run osmo-stp_10.42.42.5(pid=30724): stdout: | (launched: 2022-12-12_21:38:33.450794) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:38:35.315212 run osmo-stp_10.42.42.5(pid=30724): stderr: | 20221212213833642 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213833642 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213833642 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213833643 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213833645 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213833645 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213833645 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:38:35.472324 run patchelf(pid=30727): Terminating (SIGINT) 21:38:35.654162 run patchelf(pid=30727): Terminated: ok {rc=0} 21:38:35.784822 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=30724): Process ended prematurely: osmo-stp_10.42.42.5(pid=30724) [trial-2382↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30724)] [trial-2382↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 21:38:35.794546 tst switch_tch_pdch.py:54: Test FAILED (6.9 sec) 21:38:35.823642 run osmo-hlr_10.42.42.2(pid=30721): ERR: Terminated: ERROR {rc=237} [trial-2382↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30721)] 21:38:35.874816 run osmo-hlr_10.42.42.2(pid=30721): stdout: | (launched: 2022-12-12_21:38:32.443602) 21:38:35.928090 run osmo-hlr_10.42.42.2(pid=30721): stderr: | 20221212213832639 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212213832639 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212213832639 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212213832639 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212213832639 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212213832639 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212213832656 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212213832665 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212213832665 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212213832666 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:38:35.981753 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30720): Terminating (SIGTERM) 21:38:36.024461 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30723): Terminating (SIGTERM) 21:38:36.067293 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30726): Terminating (SIGTERM) 21:38:36.110289 --- ParallelTerminationStrategy: PID 30720 died... 21:38:36.130667 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30720): Terminated: ok {rc=0} 21:38:36.178739 --- ParallelTerminationStrategy: PID 30723 died... 21:38:36.198692 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30723): Terminated: ok {rc=0} 21:38:36.245955 --- ParallelTerminationStrategy: PID 30726 died... 21:38:36.265896 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30726): Terminated: ok {rc=0} 21:38:36.355368 bus /gobi_0: Setting Powered False 21:38:37.455136 bus /gobi_0: Setting Powered False 21:38:38.571995 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2382 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 21:38:39.836170 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:38:39.843860 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 21:38:39.876039 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 21:38:39.912026 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 21:38:39.965728 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 21:38:39.994983 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 21:38:40.028797 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 21:38:40.590706 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2382 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 21:38:40.597064 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 21:38:40.609538 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 21:38:40.677321 tst switch_tch_pdch.py: using LAC 31668 21:38:40.810173 tst switch_tch_pdch.py: using RAC 48 21:38:40.945834 tst switch_tch_pdch.py: using CellId 31668 21:38:41.073357 tst switch_tch_pdch.py: using BVCI 31669 21:38:41.193397 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 21:38:41.205411 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 21:38:41.216865 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 21:38:41.228788 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 21:38:41.240565 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 21:38:41.252587 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 21:38:41.264586 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 21:38:41.276516 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 21:38:41.394132 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 21:38:41.510090 tst switch_tch_pdch.py:51: start network... 21:38:41.712490 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:38:42.154356 run create_hlr_db(pid=30732): Launched 21:38:42.277747 bus /gobi_6: Setting Powered False 21:38:43.338821 run create_hlr_db(pid=30732): Terminated: ok {rc=0} 21:38:43.752187 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30734): Launched 21:38:44.074135 run osmo-hlr_10.42.42.2(pid=30735): Launched 21:38:44.197752 run osmo-stp_10.42.42.5: Starting osmo-stp 21:38:44.731762 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30737): Launched 21:38:45.053982 run osmo-stp_10.42.42.5(pid=30738): Launched 21:38:45.176820 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:38:45.705108 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30740): Launched 21:38:45.828130 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:38:46.117737 run patchelf(pid=30741): Launched 21:38:46.304786 run osmo-stp_10.42.42.5(pid=30738): ERR: Terminated: ERROR {rc=1} [trial-2382↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30738)] 21:38:46.472606 run osmo-stp_10.42.42.5(pid=30738): stdout: | (launched: 2022-12-12_21:38:44.995269) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:38:46.618774 run osmo-stp_10.42.42.5(pid=30738): stderr: | 20221212213845190 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213845190 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213845190 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213845191 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213845191 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213845191 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213845191 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:38:46.779980 run osmo-stp_10.42.42.5(pid=30738): stdout: | (launched: 2022-12-12_21:38:44.995269) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:38:46.929659 run osmo-stp_10.42.42.5(pid=30738): stderr: | 20221212213845190 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213845190 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213845190 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213845191 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213845191 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213845191 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213845191 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:38:47.108413 run patchelf(pid=30741): Terminating (SIGINT) 21:38:47.304224 run patchelf(pid=30741): Terminated: ok {rc=0} 21:38:47.469657 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=30738): Process ended prematurely: osmo-stp_10.42.42.5(pid=30738) [trial-2382↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30738)] [trial-2382↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 21:38:47.480264 tst switch_tch_pdch.py:54: Test FAILED (6.9 sec) 21:38:47.512559 run osmo-hlr_10.42.42.2(pid=30735): ERR: Terminated: ERROR {rc=237} [trial-2382↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30735)] 21:38:47.566322 run osmo-hlr_10.42.42.2(pid=30735): stdout: | (launched: 2022-12-12_21:38:44.015890) 21:38:47.621788 run osmo-hlr_10.42.42.2(pid=30735): stderr: | 20221212213844214 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212213844214 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212213844214 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212213844214 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212213844214 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212213844214 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212213844227 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212213844235 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212213844235 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212213844236 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:38:47.677472 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30734): Terminating (SIGTERM) 21:38:47.724132 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30737): Terminating (SIGTERM) 21:38:47.777023 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30740): Terminating (SIGTERM) 21:38:47.823970 --- ParallelTerminationStrategy: PID 30734 died... 21:38:47.847880 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30734): Terminated: ok {rc=0} 21:38:47.913645 --- ParallelTerminationStrategy: PID 30737 died... 21:38:47.935082 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30737): Terminated: ok {rc=0} 21:38:47.986590 --- ParallelTerminationStrategy: PID 30740 died... 21:38:48.012116 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30740): Terminated: ok {rc=0} 21:38:48.122157 bus /gobi_0: Setting Powered False 21:38:49.238331 bus /gobi_0: Setting Powered False 21:38:50.361112 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2382 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 nitb_sms:nanobts --------------------------------------------------------------------- 21:38:51.611250 tst nitb_sms:nanobts: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:38:51.614947 tst nitb_sms:nanobts: Verifying 1 x bts (candidates: 11) 21:38:51.639387 tst nitb_sms:nanobts: Verifying 1 x ip_address (candidates: 9) 21:38:51.647473 tst nitb_sms:nanobts: Verifying 2 x modem (candidates: 12) 21:38:51.699845 tst nitb_sms:nanobts: Reserving 1 x bts (candidates: 11) 21:38:51.725450 tst nitb_sms:nanobts: Reserving 1 x ip_address (candidates: 9) 21:38:51.733493 tst nitb_sms:nanobts: Reserving 2 x modem (candidates: 12) 21:38:52.266717 tst nitb_sms:nanobts: RESERVED RESOURCES for nitb_sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 nitb_sms:nanobts mo_mt_sms.py ---------------------------------------------- 21:38:52.273244 tst nitb_sms:nanobts: Using 1 x ip_address (candidates: 1) 21:38:52.285201 tst nitb_sms:nanobts: Using 1 x bts (candidates: 1) 21:38:52.323703 tst mo_mt_sms.py: using LAC 31669 21:38:52.446928 tst mo_mt_sms.py: using RAC 49 21:38:52.571663 tst mo_mt_sms.py: using CellId 31669 21:38:52.696099 tst mo_mt_sms.py: using BVCI 31670 21:38:52.807702 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 21:38:52.927573 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 21:38:53.044398 tst mo_mt_sms.py:9: start nitb and bts... 21:38:53.250820 run osmo-nitb_10.42.42.2: Starting osmo-nitb 21:38:53.884490 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=31016): Launched 21:38:54.226001 run osmo-nitb_10.42.42.2(pid=31017): Launched 21:38:54.426673 run osmo-nitb_10.42.42.2(pid=31017): ERR: Terminated: ERROR {rc=2} [trial-2382↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31017)] 21:38:54.575976 run osmo-nitb_10.42.42.2(pid=31017): stdout: | (launched: 2022-12-12_21:38:54.164739) 21:38:54.726650 run osmo-nitb_10.42.42.2(pid=31017): stderr: | (launched: 2022-12-12_21:38:54.213832) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 21:38:54.877146 run osmo-nitb_10.42.42.2(pid=31017): stdout: | (launched: 2022-12-12_21:38:54.164739) 21:38:55.021531 run osmo-nitb_10.42.42.2(pid=31017): stderr: | (launched: 2022-12-12_21:38:54.213832) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7ff6b86c2268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=31017): Process ended prematurely: osmo-nitb_10.42.42.2(pid=31017) [trial-2382↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31017)] 21:38:55.368769 tst osmo-nitb_10.42.42.2(pid=31017): stdout: | (launched: 2022-12-12_21:38:54.164739) 21:38:55.505376 tst osmo-nitb_10.42.42.2(pid=31017): stderr: | (launched: 2022-12-12_21:38:54.213832) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 21:38:55.665365 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=31017): Process ended prematurely: osmo-nitb_10.42.42.2(pid=31017) [trial-2382↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31017)] [trial-2382↪nitb_sms:nanobts↪mo_mt_sms.py:11] 21:38:55.675446 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 21:38:55.683585 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=31016): Terminating (SIGTERM) 21:38:55.900562 --- ParallelTerminationStrategy: PID 31016 died... 21:38:55.924231 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=31016): Terminated: ok {rc=0} 21:38:56.018786 bus /sierra_3: Setting Powered False 21:38:57.128022 bus /sierra_3: Setting Powered False 21:38:58.254014 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 nitb_sms:nanobts FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 sms:nanobts+band-1900 --------------------------------------------------------------------- 21:38:59.452941 tst sms:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:38:59.459265 tst sms:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 21:38:59.489375 tst sms:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 21:38:59.519490 tst sms:nanobts+band-1900: Verifying 2 x modem (candidates: 12) 21:38:59.575180 tst sms:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 21:38:59.600893 tst sms:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 21:38:59.630265 tst sms:nanobts+band-1900: Reserving 2 x modem (candidates: 12) 21:39:00.178847 tst sms:nanobts+band-1900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 sms:nanobts+band-1900 mo_mt_sms.py ---------------------------------------------- 21:39:00.185792 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 21:39:00.198507 tst sms:nanobts+band-1900: Using 1 x bts (candidates: 1) 21:39:00.242120 tst mo_mt_sms.py: using LAC 31670 21:39:00.374377 tst mo_mt_sms.py: using RAC 50 21:39:00.507197 tst mo_mt_sms.py: using CellId 31670 21:39:00.638984 tst mo_mt_sms.py: using BVCI 31671 21:39:00.762479 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 21:39:00.774868 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 21:39:00.788347 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 21:39:00.800448 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 21:39:00.813328 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 21:39:00.828631 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 21:39:00.958137 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 21:39:01.096351 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:39:01.689964 run create_hlr_db(pid=31021): Launched 21:39:01.878913 bus /sierra_2: Setting Powered False 21:39:02.955159 run create_hlr_db(pid=31021): Terminated: ok {rc=0} 21:39:03.455116 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31023): Launched 21:39:03.802350 run osmo-hlr_10.42.42.2(pid=31024): Launched 21:39:04.048314 run osmo-stp_10.42.42.5: Starting osmo-stp 21:39:04.737215 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31026): Launched 21:39:05.080454 run osmo-stp_10.42.42.5(pid=31027): Launched 21:39:05.334420 run osmo-msc_10.42.42.6: Starting osmo-msc 21:39:06.025774 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31029): Launched 21:39:06.381681 run osmo-msc_10.42.42.6(pid=31030): Launched 21:39:06.749280 run osmo-stp_10.42.42.5(pid=31027): ERR: Terminated: ERROR {rc=1} [trial-2382↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31027)] 21:39:07.037967 run osmo-stp_10.42.42.5(pid=31027): stdout: | (launched: 2022-12-12_21:39:05.019610) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:39:07.210229 run osmo-stp_10.42.42.5(pid=31027): stderr: | 20221212213905322 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213905323 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213905323 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213905323 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213905324 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213905324 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213905324 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:39:07.351463 run osmo-stp_10.42.42.5(pid=31027): stdout: | (launched: 2022-12-12_21:39:05.019610) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:39:07.487527 run osmo-stp_10.42.42.5(pid=31027): stderr: | 20221212213905322 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213905323 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213905323 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213905323 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213905324 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213905324 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213905324 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:39:07.649428 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=31027): Process ended prematurely: osmo-stp_10.42.42.5(pid=31027) [trial-2382↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31027)] [trial-2382↪sms:nanobts+band-1900↪mo_mt_sms.py:16] 21:39:07.659519 tst mo_mt_sms.py:16: Test FAILED (7.5 sec) 21:39:07.694634 run osmo-hlr_10.42.42.2(pid=31024): ERR: Terminated: ERROR {rc=237} [trial-2382↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31024)] 21:39:07.749238 run osmo-hlr_10.42.42.2(pid=31024): stdout: | (launched: 2022-12-12_21:39:03.740679) 21:39:07.805201 run osmo-hlr_10.42.42.2(pid=31024): stderr: | 20221212213904055 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212213904055 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212213904055 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212213904055 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212213904055 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212213904055 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212213904071 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/sms:nanobts+band-1900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212213904087 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212213904087 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212213904087 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:39:07.882129 run osmo-msc_10.42.42.6(pid=31030): ERR: Terminated: ERROR {rc=2} [trial-2382↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31030)] 21:39:07.937125 run osmo-msc_10.42.42.6(pid=31030): stdout: | (launched: 2022-12-12_21:39:06.306658) 21:39:07.994302 run osmo-msc_10.42.42.6(pid=31030): stderr: | 20221212213906822 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212213906823 DLGLOBAL DEBUG validating counter group 0x7f638b4a6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212213906823 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212213906823 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212213906823 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212213906823 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212213906827 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212213906827 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212213906827 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212213906827 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:39:08.050907 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31023): Terminating (SIGTERM) 21:39:08.097623 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31026): Terminating (SIGTERM) 21:39:08.146414 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31029): Terminating (SIGTERM) 21:39:08.193895 --- ParallelTerminationStrategy: PID 31023 died... 21:39:08.215670 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31023): Terminated: ok {rc=0} 21:39:08.268542 --- ParallelTerminationStrategy: PID 31026 died... 21:39:08.289877 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31026): Terminated: ok {rc=0} 21:39:08.342446 --- ParallelTerminationStrategy: PID 31029 died... 21:39:08.363815 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31029): Terminated: ok {rc=0} 21:39:08.458605 bus /sierra_3: Setting Powered False 21:39:09.562365 bus /sierra_3: Setting Powered False 21:39:10.678764 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 sms:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 nitb_ussd:nanobts+band-1900 --------------------------------------------------------------------- 21:39:11.905890 tst nitb_ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:39:11.911478 tst nitb_ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 21:39:11.937062 tst nitb_ussd:nanobts+band-1900: Verifying 1 x ip_address (candidates: 9) 21:39:11.944418 tst nitb_ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 21:39:11.982022 tst nitb_ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 21:39:12.006085 tst nitb_ussd:nanobts+band-1900: Reserving 1 x ip_address (candidates: 9) 21:39:12.012575 tst nitb_ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 21:39:12.531408 tst nitb_ussd:nanobts+band-1900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2382 nitb_ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 21:39:12.536230 tst nitb_ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 1) 21:39:12.546995 tst nitb_ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 21:39:12.583922 tst assert_extension.py: using LAC 31671 21:39:12.702877 tst assert_extension.py: using RAC 51 21:39:12.824244 tst assert_extension.py: using CellId 31671 21:39:12.952534 tst assert_extension.py: using BVCI 31672 21:39:13.063607 tst nitb_ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 21:39:13.180117 tst assert_extension.py:10: start nitb and bts... 21:39:13.397706 run osmo-nitb_10.42.42.2: Starting osmo-nitb 21:39:14.055371 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=31036): Launched 21:39:14.362202 run osmo-nitb_10.42.42.2(pid=31037): Launched 21:39:14.529454 run osmo-nitb_10.42.42.2(pid=31037): ERR: Terminated: ERROR {rc=2} [trial-2382↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31037)] 21:39:14.665399 run osmo-nitb_10.42.42.2(pid=31037): stdout: | (launched: 2022-12-12_21:39:14.306494) 21:39:14.802438 run osmo-nitb_10.42.42.2(pid=31037): stderr: | (launched: 2022-12-12_21:39:14.352072) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 21:39:14.940031 run osmo-nitb_10.42.42.2(pid=31037): stdout: | (launched: 2022-12-12_21:39:14.306494) 21:39:15.071437 run osmo-nitb_10.42.42.2(pid=31037): stderr: | (launched: 2022-12-12_21:39:14.352072) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7ff6b86c2268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=31037): Process ended prematurely: osmo-nitb_10.42.42.2(pid=31037) [trial-2382↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31037)] 21:39:15.475559 tst osmo-nitb_10.42.42.2(pid=31037): stdout: | (launched: 2022-12-12_21:39:14.306494) 21:39:15.598028 tst osmo-nitb_10.42.42.2(pid=31037): stderr: | (launched: 2022-12-12_21:39:14.352072) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 21:39:15.742409 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=31037): Process ended prematurely: osmo-nitb_10.42.42.2(pid=31037) [trial-2382↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31037)] [trial-2382↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12] 21:39:15.750812 tst assert_extension.py:12: Test FAILED (3.2 sec) 21:39:15.757326 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=31036): Terminating (SIGTERM) 21:39:15.965873 --- ParallelTerminationStrategy: PID 31036 died... 21:39:15.985930 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=31036): Terminated: ok {rc=0} 21:39:16.091392 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 nitb_ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 ussd:nanobts+band-1900 --------------------------------------------------------------------- 21:39:17.276235 tst ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:39:17.281815 tst ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 21:39:17.306637 tst ussd:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 21:39:17.334951 tst ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 21:39:17.370684 tst ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 21:39:17.395331 tst ussd:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 21:39:17.423436 tst ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 21:39:17.953482 tst ussd:nanobts+band-1900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2382 ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 21:39:17.958896 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 21:39:17.970293 tst ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 21:39:18.010854 tst assert_extension.py: using LAC 31672 21:39:18.144717 tst assert_extension.py: using RAC 52 21:39:18.273459 tst assert_extension.py: using CellId 31672 21:39:18.392303 tst assert_extension.py: using BVCI 31673 21:39:18.502792 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 21:39:18.513530 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 21:39:18.524080 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 21:39:18.534673 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 21:39:18.545164 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 21:39:18.555654 tst ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 21:39:18.673169 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:39:19.173503 run create_hlr_db(pid=31041): Launched 21:39:19.297722 bus /sierra_2: Setting Powered False 21:39:20.361534 run create_hlr_db(pid=31041): Terminated: ok {rc=0} 21:39:20.794425 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31043): Launched 21:39:21.098122 run osmo-hlr_10.42.42.2(pid=31044): Launched 21:39:21.212852 run osmo-stp_10.42.42.5: Starting osmo-stp 21:39:21.734512 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31046): Launched 21:39:22.035605 run osmo-stp_10.42.42.5(pid=31047): Launched 21:39:22.150799 run osmo-msc_10.42.42.6: Starting osmo-msc 21:39:22.695437 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31049): Launched 21:39:22.996318 run osmo-msc_10.42.42.6(pid=31050): Launched 21:39:23.165427 run osmo-stp_10.42.42.5(pid=31047): ERR: Terminated: ERROR {rc=1} [trial-2382↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31047)] 21:39:23.293499 run osmo-stp_10.42.42.5(pid=31047): stdout: | (launched: 2022-12-12_21:39:21.980548) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:39:23.422169 run osmo-stp_10.42.42.5(pid=31047): stderr: | 20221212213922149 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213922149 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213922149 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213922150 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213922152 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213922152 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213922152 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:39:23.547975 run osmo-stp_10.42.42.5(pid=31047): stdout: | (launched: 2022-12-12_21:39:21.980548) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:39:23.667598 run osmo-stp_10.42.42.5(pid=31047): stderr: | 20221212213922149 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213922149 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213922149 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213922150 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213922152 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213922152 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213922152 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:39:23.810669 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=31047): Process ended prematurely: osmo-stp_10.42.42.5(pid=31047) [trial-2382↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31047)] [trial-2382↪ussd:nanobts+band-1900↪assert_extension.py:17] 21:39:23.818954 tst assert_extension.py:17: Test FAILED (5.9 sec) 21:39:23.845169 run osmo-hlr_10.42.42.2(pid=31044): ERR: Terminated: ERROR {rc=237} [trial-2382↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31044)] 21:39:23.893462 run osmo-hlr_10.42.42.2(pid=31044): stdout: | (launched: 2022-12-12_21:39:21.042357) 21:39:23.944124 run osmo-hlr_10.42.42.2(pid=31044): stderr: | 20221212213921218 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212213921218 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212213921218 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212213921218 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212213921218 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212213921218 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212213921249 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/ussd:nanobts+band-1900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212213921258 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212213921258 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212213921258 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:39:24.014665 run osmo-msc_10.42.42.6(pid=31050): ERR: Terminated: ERROR {rc=2} [trial-2382↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31050)] 21:39:24.063437 run osmo-msc_10.42.42.6(pid=31050): stdout: | (launched: 2022-12-12_21:39:22.940582) 21:39:24.114025 run osmo-msc_10.42.42.6(pid=31050): stderr: | 20221212213923213 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212213923213 DLGLOBAL DEBUG validating counter group 0x7f80b23fcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212213923214 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212213923214 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212213923214 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212213923214 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212213923216 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212213923217 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212213923217 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212213923217 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:39:24.164888 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31043): Terminating (SIGTERM) 21:39:24.205142 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31046): Terminating (SIGTERM) 21:39:24.245504 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31049): Terminating (SIGTERM) 21:39:24.285984 --- ParallelTerminationStrategy: PID 31043 died... 21:39:24.305423 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31043): Terminated: ok {rc=0} 21:39:24.350507 --- ParallelTerminationStrategy: PID 31046 died... 21:39:24.369542 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31046): Terminated: ok {rc=0} 21:39:24.414805 --- ParallelTerminationStrategy: PID 31049 died... 21:39:24.433695 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31049): Terminated: ok {rc=0} 21:39:24.518236 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 21:39:25.717739 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:39:25.724797 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 21:39:25.748272 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 21:39:25.775104 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 21:39:25.827813 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 21:39:25.851467 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 21:39:25.877530 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 21:39:26.428044 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 21:39:26.477661 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:39:26.488879 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 21:39:26.554716 tst mo_mt_call.py: using LAC 31673 21:39:26.675922 tst mo_mt_call.py: using RAC 53 21:39:26.799408 tst mo_mt_call.py: using CellId 31673 21:39:26.921428 tst mo_mt_call.py: using BVCI 31674 21:39:27.032940 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:39:27.044294 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:39:27.055388 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:39:27.066446 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:39:27.077595 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:39:27.088772 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 21:39:27.207656 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 21:39:27.324040 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:39:27.798326 run create_hlr_db(pid=31056): Launched 21:39:27.925568 bus /sierra_2: Setting Powered False 21:39:28.987156 run create_hlr_db(pid=31056): Terminated: ok {rc=0} 21:39:29.434665 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31058): Launched 21:39:29.765038 run osmo-hlr_10.42.42.2(pid=31059): Launched 21:39:29.891184 run osmo-stp_10.42.42.5: Starting osmo-stp 21:39:30.459979 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31061): Launched 21:39:30.787614 run osmo-stp_10.42.42.5(pid=31062): Launched 21:39:31.021966 run osmo-msc_10.42.42.6: Starting osmo-msc 21:39:31.838646 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31064): Launched 21:39:32.251358 run osmo-msc_10.42.42.6(pid=31065): Launched 21:39:32.501026 run osmo-stp_10.42.42.5(pid=31062): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31062)] 21:39:32.641174 run osmo-stp_10.42.42.5(pid=31062): stdout: | (launched: 2022-12-12_21:39:30.728281) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:39:32.781380 run osmo-stp_10.42.42.5(pid=31062): stderr: | 20221212213931011 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213931011 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213931011 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213931012 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213931014 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213931014 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213931014 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:39:32.918855 run osmo-stp_10.42.42.5(pid=31062): stdout: | (launched: 2022-12-12_21:39:30.728281) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:39:33.050596 run osmo-stp_10.42.42.5(pid=31062): stderr: | 20221212213931011 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213931011 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213931011 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213931012 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213931014 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213931014 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213931014 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:39:33.208073 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31062): Process ended prematurely: osmo-stp_10.42.42.5(pid=31062) [trial-2382↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31062)] [trial-2382↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 21:39:33.217734 tst mo_mt_call.py:8: Test FAILED (6.8 sec) 21:39:33.247069 run osmo-hlr_10.42.42.2(pid=31059): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31059)] 21:39:33.299025 run osmo-hlr_10.42.42.2(pid=31059): stdout: | (launched: 2022-12-12_21:39:29.705489) 21:39:33.352874 run osmo-hlr_10.42.42.2(pid=31059): stderr: | 20221212213929903 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212213929903 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212213929903 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212213929903 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212213929903 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212213929903 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212213929919 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212213929938 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212213929939 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212213929939 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:39:33.427648 run osmo-msc_10.42.42.6(pid=31065): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31065)] 21:39:33.479489 run osmo-msc_10.42.42.6(pid=31065): stdout: | (launched: 2022-12-12_21:39:32.186385) 21:39:33.533252 run osmo-msc_10.42.42.6(pid=31065): stderr: | 20221212213932564 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212213932564 DLGLOBAL DEBUG validating counter group 0x7f3a913bec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212213932564 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212213932564 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212213932565 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212213932565 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212213932566 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212213932567 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212213932567 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212213932567 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:39:33.587061 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31058): Terminating (SIGTERM) 21:39:33.630116 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31061): Terminating (SIGTERM) 21:39:33.673122 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31064): Terminating (SIGTERM) 21:39:33.716331 --- ParallelTerminationStrategy: PID 31058 died... 21:39:33.736925 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31058): Terminated: ok {rc=0} 21:39:33.785137 --- ParallelTerminationStrategy: PID 31061 died... 21:39:33.805420 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31061): Terminated: ok {rc=0} 21:39:33.853296 --- ParallelTerminationStrategy: PID 31064 died... 21:39:33.873089 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31064): Terminated: ok {rc=0} 21:39:33.963355 bus /sierra_3: Setting Powered False 21:39:35.063102 bus /sierra_3: Setting Powered False 21:39:36.180769 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2382 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 21:39:37.331916 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:39:37.344247 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 21:39:37.406284 tst mo_mt_call_osmux.py: using LAC 31674 21:39:37.539456 tst mo_mt_call_osmux.py: using RAC 54 21:39:37.667425 tst mo_mt_call_osmux.py: using CellId 31674 21:39:37.796301 tst mo_mt_call_osmux.py: using BVCI 31675 21:39:37.915637 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:39:37.927306 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:39:37.938757 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:39:37.950471 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:39:37.962478 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:39:37.974302 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 21:39:38.094827 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 21:39:38.212636 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:39:38.688481 run create_hlr_db(pid=31067): Launched 21:39:38.814722 bus /sierra_2: Setting Powered False 21:39:39.876402 run create_hlr_db(pid=31067): Terminated: ok {rc=0} 21:39:40.324281 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31069): Launched 21:39:40.653936 run osmo-hlr_10.42.42.2(pid=31070): Launched 21:39:40.779715 run osmo-stp_10.42.42.5: Starting osmo-stp 21:39:41.344363 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31073): Launched 21:39:41.673214 run osmo-stp_10.42.42.5(pid=31074): Launched 21:39:41.798651 run osmo-msc_10.42.42.6: Starting osmo-msc 21:39:42.393965 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31076): Launched 21:39:42.723604 run osmo-msc_10.42.42.6(pid=31077): Launched 21:39:42.907085 run osmo-stp_10.42.42.5(pid=31074): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31074)] 21:39:43.046673 run osmo-stp_10.42.42.5(pid=31074): stdout: | (launched: 2022-12-12_21:39:41.613624) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:39:43.186643 run osmo-stp_10.42.42.5(pid=31074): stderr: | 20221212213941807 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213941807 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213941808 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213941808 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213941809 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213941809 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213941809 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:39:43.325690 run osmo-stp_10.42.42.5(pid=31074): stdout: | (launched: 2022-12-12_21:39:41.613624) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:39:43.457421 run osmo-stp_10.42.42.5(pid=31074): stderr: | 20221212213941807 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213941807 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213941808 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213941808 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213941809 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213941809 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213941809 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:39:43.615445 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31074): Process ended prematurely: osmo-stp_10.42.42.5(pid=31074) [trial-2382↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31074)] [trial-2382↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 21:39:43.625351 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 21:39:43.654328 run osmo-hlr_10.42.42.2(pid=31070): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31070)] 21:39:43.705501 run osmo-hlr_10.42.42.2(pid=31070): stdout: | (launched: 2022-12-12_21:39:40.594288) 21:39:43.758524 run osmo-hlr_10.42.42.2(pid=31070): stderr: | 20221212213940793 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212213940793 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212213940793 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212213940793 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212213940793 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212213940793 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212213940805 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212213940814 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212213940814 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212213940814 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:39:43.832003 run osmo-msc_10.42.42.6(pid=31077): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31077)] 21:39:43.882816 run osmo-msc_10.42.42.6(pid=31077): stdout: | (launched: 2022-12-12_21:39:42.663625) 21:39:43.935392 run osmo-msc_10.42.42.6(pid=31077): stderr: | 20221212213942987 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212213942987 DLGLOBAL DEBUG validating counter group 0x7f23954ccc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212213942988 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212213942988 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212213942988 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212213942988 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212213942990 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212213942990 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212213942990 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212213942990 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:39:43.988445 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31069): Terminating (SIGTERM) 21:39:44.031219 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31073): Terminating (SIGTERM) 21:39:44.073849 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31076): Terminating (SIGTERM) 21:39:44.116570 --- ParallelTerminationStrategy: PID 31069 died... 21:39:44.137037 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31069): Terminated: ok {rc=0} 21:39:44.184654 --- ParallelTerminationStrategy: PID 31073 died... 21:39:44.204654 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31073): Terminated: ok {rc=0} 21:39:44.251998 --- ParallelTerminationStrategy: PID 31076 died... 21:39:44.271795 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31076): Terminated: ok {rc=0} 21:39:44.361947 bus /sierra_3: Setting Powered False 21:39:45.461919 bus /sierra_3: Setting Powered False 21:39:46.582760 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 21:39:47.830951 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:39:47.838622 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 21:39:47.862022 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 21:39:47.888324 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 21:39:47.939433 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 21:39:47.962778 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 21:39:47.988794 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 21:39:48.541823 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 21:39:48.590772 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:39:48.601971 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 21:39:48.664589 tst mo_mt_call.py: using LAC 31675 21:39:48.784247 tst mo_mt_call.py: using RAC 55 21:39:48.903761 tst mo_mt_call.py: using CellId 31675 21:39:49.024163 tst mo_mt_call.py: using BVCI 31676 21:39:49.146159 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:39:49.158084 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:39:49.169876 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:39:49.182192 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:39:49.194496 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:39:49.206678 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 21:39:49.326102 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 21:39:49.446132 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:39:49.955061 run create_hlr_db(pid=31082): Launched 21:39:50.080266 bus /sierra_2: Setting Powered False 21:39:51.145737 run create_hlr_db(pid=31082): Terminated: ok {rc=0} 21:39:51.584432 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31084): Launched 21:39:51.891353 run osmo-hlr_10.42.42.2(pid=31085): Launched 21:39:52.007988 run osmo-stp_10.42.42.5: Starting osmo-stp 21:39:52.536001 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31087): Launched 21:39:52.841913 run osmo-stp_10.42.42.5(pid=31088): Launched 21:39:52.958828 run osmo-msc_10.42.42.6: Starting osmo-msc 21:39:53.514584 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31090): Launched 21:39:53.821870 run osmo-msc_10.42.42.6(pid=31091): Launched 21:39:53.992398 run osmo-stp_10.42.42.5(pid=31088): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31088)] 21:39:54.122463 run osmo-stp_10.42.42.5(pid=31088): stdout: | (launched: 2022-12-12_21:39:52.786213) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:39:54.251781 run osmo-stp_10.42.42.5(pid=31088): stderr: | 20221212213952957 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213952958 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213952958 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213952958 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213952959 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213952959 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213952959 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:39:54.379111 run osmo-stp_10.42.42.5(pid=31088): stdout: | (launched: 2022-12-12_21:39:52.786213) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:39:54.500777 run osmo-stp_10.42.42.5(pid=31088): stderr: | 20221212213952957 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212213952958 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212213952958 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212213952958 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212213952959 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212213952959 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212213952959 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:39:54.646739 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31088): Process ended prematurely: osmo-stp_10.42.42.5(pid=31088) [trial-2382↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31088)] [trial-2382↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 21:39:54.655426 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 21:39:54.681903 run osmo-hlr_10.42.42.2(pid=31085): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31085)] 21:39:54.730153 run osmo-hlr_10.42.42.2(pid=31085): stdout: | (launched: 2022-12-12_21:39:51.835672) 21:39:54.779969 run osmo-hlr_10.42.42.2(pid=31085): stderr: | 20221212213952014 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212213952014 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212213952014 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212213952014 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212213952014 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212213952014 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212213952030 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212213952040 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212213952040 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212213952040 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:39:54.849933 run osmo-msc_10.42.42.6(pid=31091): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31091)] 21:39:54.898027 run osmo-msc_10.42.42.6(pid=31091): stdout: | (launched: 2022-12-12_21:39:53.765342) 21:39:54.947640 run osmo-msc_10.42.42.6(pid=31091): stderr: | 20221212213954038 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212213954038 DLGLOBAL DEBUG validating counter group 0x7f0ccba88c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212213954038 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212213954039 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212213954039 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212213954039 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212213954042 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212213954043 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212213954043 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212213954043 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:39:54.997743 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31084): Terminating (SIGTERM) 21:39:55.037661 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31087): Terminating (SIGTERM) 21:39:55.077517 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31090): Terminating (SIGTERM) 21:39:55.117893 --- ParallelTerminationStrategy: PID 31084 died... 21:39:55.137342 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31084): Terminated: ok {rc=0} 21:39:55.182289 --- ParallelTerminationStrategy: PID 31087 died... 21:39:55.201124 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31087): Terminated: ok {rc=0} 21:39:55.246442 --- ParallelTerminationStrategy: PID 31090 died... 21:39:55.265308 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31090): Terminated: ok {rc=0} 21:39:55.351955 bus /sierra_3: Setting Powered False 21:39:56.453136 bus /sierra_3: Setting Powered False 21:39:57.569875 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2382 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 21:39:58.716521 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:39:58.728323 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 21:39:58.788138 tst mo_mt_call_osmux.py: using LAC 31676 21:39:58.911487 tst mo_mt_call_osmux.py: using RAC 56 21:39:59.033323 tst mo_mt_call_osmux.py: using CellId 31676 21:39:59.158398 tst mo_mt_call_osmux.py: using BVCI 31677 21:39:59.271433 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:39:59.282701 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:39:59.293683 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:39:59.305133 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:39:59.316116 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:39:59.327001 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 21:39:59.442645 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 21:39:59.563970 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:40:00.076096 run create_hlr_db(pid=31093): Launched 21:40:00.202805 bus /sierra_2: Setting Powered False 21:40:01.267861 run create_hlr_db(pid=31093): Terminated: ok {rc=0} 21:40:01.727974 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31098): Launched 21:40:02.137696 run osmo-hlr_10.42.42.2(pid=31099): Launched 21:40:02.330355 run osmo-stp_10.42.42.5: Starting osmo-stp 21:40:02.876012 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31101): Launched 21:40:03.183552 run osmo-stp_10.42.42.5(pid=31102): Launched 21:40:03.301171 run osmo-msc_10.42.42.6: Starting osmo-msc 21:40:03.855051 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31104): Launched 21:40:04.162843 run osmo-msc_10.42.42.6(pid=31105): Launched 21:40:04.333525 run osmo-stp_10.42.42.5(pid=31102): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31102)] 21:40:04.463633 run osmo-stp_10.42.42.5(pid=31102): stdout: | (launched: 2022-12-12_21:40:03.127811) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:40:04.593286 run osmo-stp_10.42.42.5(pid=31102): stderr: | 20221212214003298 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214003298 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214003298 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214003299 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214003301 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214003301 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214003301 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:40:04.720189 run osmo-stp_10.42.42.5(pid=31102): stdout: | (launched: 2022-12-12_21:40:03.127811) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:40:04.842382 run osmo-stp_10.42.42.5(pid=31102): stderr: | 20221212214003298 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214003298 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214003298 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214003299 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214003301 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214003301 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214003301 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:40:04.988316 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31102): Process ended prematurely: osmo-stp_10.42.42.5(pid=31102) [trial-2382↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31102)] [trial-2382↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 21:40:04.997326 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 21:40:05.024098 run osmo-hlr_10.42.42.2(pid=31099): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31099)] 21:40:05.072585 run osmo-hlr_10.42.42.2(pid=31099): stdout: | (launched: 2022-12-12_21:40:02.071686) 21:40:05.122894 run osmo-hlr_10.42.42.2(pid=31099): stderr: | 20221212214002336 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212214002336 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212214002336 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212214002336 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212214002336 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212214002336 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212214002349 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212214002357 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212214002357 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212214002358 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:40:05.193140 run osmo-msc_10.42.42.6(pid=31105): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31105)] 21:40:05.241732 run osmo-msc_10.42.42.6(pid=31105): stdout: | (launched: 2022-12-12_21:40:04.106414) 21:40:05.292224 run osmo-msc_10.42.42.6(pid=31105): stderr: | 20221212214004381 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212214004381 DLGLOBAL DEBUG validating counter group 0x7fc6424afc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212214004381 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212214004381 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212214004381 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212214004382 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212214004383 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212214004384 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212214004384 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212214004384 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:40:05.343128 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31098): Terminating (SIGTERM) 21:40:05.383291 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31101): Terminating (SIGTERM) 21:40:05.423295 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31104): Terminating (SIGTERM) 21:40:05.463604 --- ParallelTerminationStrategy: PID 31098 died... 21:40:05.482933 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31098): Terminated: ok {rc=0} 21:40:05.527459 --- ParallelTerminationStrategy: PID 31101 died... 21:40:05.546296 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31101): Terminated: ok {rc=0} 21:40:05.590834 --- ParallelTerminationStrategy: PID 31104 died... 21:40:05.609749 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31104): Terminated: ok {rc=0} 21:40:05.696761 bus /sierra_3: Setting Powered False 21:40:06.798310 bus /sierra_3: Setting Powered False 21:40:07.916519 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 21:40:09.157253 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:40:09.164853 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 21:40:09.188451 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 21:40:09.214735 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 21:40:09.267629 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 21:40:09.291282 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 21:40:09.317401 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 21:40:09.868089 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 21:40:09.917418 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:40:09.928607 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 21:40:09.987954 tst mo_mt_call.py: using LAC 31677 21:40:10.119698 tst mo_mt_call.py: using RAC 57 21:40:10.249774 tst mo_mt_call.py: using CellId 31677 21:40:10.382016 tst mo_mt_call.py: using BVCI 31678 21:40:10.504311 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:40:10.516433 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:40:10.528052 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:40:10.540390 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:40:10.552803 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:40:10.565601 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 21:40:10.685222 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 21:40:10.802223 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:40:11.277608 run create_hlr_db(pid=31110): Launched 21:40:11.406149 bus /sierra_2: Setting Powered False 21:40:12.471669 run create_hlr_db(pid=31110): Terminated: ok {rc=0} 21:40:12.926827 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31112): Launched 21:40:13.254805 run osmo-hlr_10.42.42.2(pid=31113): Launched 21:40:13.380299 run osmo-stp_10.42.42.5: Starting osmo-stp 21:40:13.942691 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31115): Launched 21:40:14.270465 run osmo-stp_10.42.42.5(pid=31116): Launched 21:40:14.396174 run osmo-msc_10.42.42.6: Starting osmo-msc 21:40:14.988398 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31118): Launched 21:40:15.316328 run osmo-msc_10.42.42.6(pid=31119): Launched 21:40:15.499374 run osmo-stp_10.42.42.5(pid=31116): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31116)] 21:40:15.638595 run osmo-stp_10.42.42.5(pid=31116): stdout: | (launched: 2022-12-12_21:40:14.211212) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:40:15.777274 run osmo-stp_10.42.42.5(pid=31116): stderr: | 20221212214014403 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214014403 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214014404 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214014404 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214014406 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214014407 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214014407 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:40:15.918917 run osmo-stp_10.42.42.5(pid=31116): stdout: | (launched: 2022-12-12_21:40:14.211212) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:40:16.044519 run osmo-stp_10.42.42.5(pid=31116): stderr: | 20221212214014403 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214014403 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214014404 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214014404 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214014406 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214014407 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214014407 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:40:16.197341 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31116): Process ended prematurely: osmo-stp_10.42.42.5(pid=31116) [trial-2382↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31116)] [trial-2382↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 21:40:16.206906 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 21:40:16.235176 run osmo-hlr_10.42.42.2(pid=31113): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31113)] 21:40:16.286377 run osmo-hlr_10.42.42.2(pid=31113): stdout: | (launched: 2022-12-12_21:40:13.195464) 21:40:16.339971 run osmo-hlr_10.42.42.2(pid=31113): stderr: | 20221212214013394 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212214013394 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212214013394 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212214013394 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212214013394 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212214013394 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212214013406 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212214013415 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212214013415 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212214013415 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:40:16.413574 run osmo-msc_10.42.42.6(pid=31119): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31119)] 21:40:16.464031 run osmo-msc_10.42.42.6(pid=31119): stdout: | (launched: 2022-12-12_21:40:15.256560) 21:40:16.517309 run osmo-msc_10.42.42.6(pid=31119): stderr: | 20221212214015580 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212214015580 DLGLOBAL DEBUG validating counter group 0x7f0d4c19cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212214015580 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212214015580 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212214015581 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212214015581 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212214015582 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212214015583 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212214015583 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212214015583 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:40:16.570152 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31112): Terminating (SIGTERM) 21:40:16.613223 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31115): Terminating (SIGTERM) 21:40:16.657982 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31118): Terminating (SIGTERM) 21:40:16.704361 --- ParallelTerminationStrategy: PID 31112 died... 21:40:16.724546 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31112): Terminated: ok {rc=0} 21:40:16.773172 --- ParallelTerminationStrategy: PID 31115 died... 21:40:16.792581 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31115): Terminated: ok {rc=0} 21:40:16.839589 --- ParallelTerminationStrategy: PID 31118 died... 21:40:16.860167 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31118): Terminated: ok {rc=0} 21:40:16.949515 bus /sierra_3: Setting Powered False 21:40:18.049248 bus /sierra_3: Setting Powered False 21:40:19.165832 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2382 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 21:40:20.318753 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:40:20.331348 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 21:40:20.392462 tst mo_mt_call_osmux.py: using LAC 31678 21:40:20.525172 tst mo_mt_call_osmux.py: using RAC 58 21:40:20.655003 tst mo_mt_call_osmux.py: using CellId 31678 21:40:20.784105 tst mo_mt_call_osmux.py: using BVCI 31679 21:40:20.903556 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:40:20.915294 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:40:20.926742 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:40:20.938614 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:40:20.950633 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:40:20.962482 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 21:40:21.080196 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 21:40:21.201278 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:40:21.710002 run create_hlr_db(pid=31121): Launched 21:40:21.834492 bus /sierra_2: Setting Powered False 21:40:22.899719 run create_hlr_db(pid=31121): Terminated: ok {rc=0} 21:40:23.337288 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31123): Launched 21:40:23.645589 run osmo-hlr_10.42.42.2(pid=31124): Launched 21:40:23.763828 run osmo-stp_10.42.42.5: Starting osmo-stp 21:40:24.309267 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31126): Launched 21:40:24.616664 run osmo-stp_10.42.42.5(pid=31127): Launched 21:40:24.733873 run osmo-msc_10.42.42.6: Starting osmo-msc 21:40:25.293714 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31129): Launched 21:40:25.604324 run osmo-msc_10.42.42.6(pid=31130): Launched 21:40:25.778290 run osmo-stp_10.42.42.5(pid=31127): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31127)] 21:40:25.909105 run osmo-stp_10.42.42.5(pid=31127): stdout: | (launched: 2022-12-12_21:40:24.560222) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:40:26.040009 run osmo-stp_10.42.42.5(pid=31127): stderr: | 20221212214024734 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214024734 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214024735 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214024735 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214024735 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214024735 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214024736 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:40:26.168440 run osmo-stp_10.42.42.5(pid=31127): stdout: | (launched: 2022-12-12_21:40:24.560222) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:40:26.291402 run osmo-stp_10.42.42.5(pid=31127): stderr: | 20221212214024734 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214024734 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214024735 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214024735 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214024735 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214024735 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214024736 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:40:26.439206 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31127): Process ended prematurely: osmo-stp_10.42.42.5(pid=31127) [trial-2382↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31127)] [trial-2382↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 21:40:26.448394 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 21:40:26.475248 run osmo-hlr_10.42.42.2(pid=31124): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31124)] 21:40:26.523716 run osmo-hlr_10.42.42.2(pid=31124): stdout: | (launched: 2022-12-12_21:40:23.589797) 21:40:26.574042 run osmo-hlr_10.42.42.2(pid=31124): stderr: | 20221212214023769 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212214023769 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212214023769 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212214023769 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212214023769 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212214023769 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212214023781 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212214023790 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212214023790 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212214023790 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:40:26.644389 run osmo-msc_10.42.42.6(pid=31130): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31130)] 21:40:26.692587 run osmo-msc_10.42.42.6(pid=31130): stdout: | (launched: 2022-12-12_21:40:25.547238) 21:40:26.742621 run osmo-msc_10.42.42.6(pid=31130): stderr: | 20221212214025822 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212214025822 DLGLOBAL DEBUG validating counter group 0x7f40fe14dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212214025822 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212214025822 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212214025823 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212214025823 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212214025824 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212214025825 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212214025825 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212214025825 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:40:26.792821 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31123): Terminating (SIGTERM) 21:40:26.833157 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31126): Terminating (SIGTERM) 21:40:26.873639 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31129): Terminating (SIGTERM) 21:40:26.914404 --- ParallelTerminationStrategy: PID 31123 died... 21:40:26.933936 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31123): Terminated: ok {rc=0} 21:40:26.978919 --- ParallelTerminationStrategy: PID 31126 died... 21:40:26.998057 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31126): Terminated: ok {rc=0} 21:40:27.043601 --- ParallelTerminationStrategy: PID 31129 died... 21:40:27.062770 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31129): Terminated: ok {rc=0} 21:40:27.150342 bus /sierra_3: Setting Powered False 21:40:28.250182 bus /sierra_3: Setting Powered False 21:40:29.365336 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 21:40:30.605024 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:40:30.612179 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 21:40:30.636178 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 21:40:30.662682 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 21:40:30.715994 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 21:40:30.740587 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 21:40:30.768170 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 21:40:31.328739 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 21:40:31.384599 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:40:31.397472 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 21:40:31.460891 tst mo_mt_call.py: using LAC 31679 21:40:31.594408 tst mo_mt_call.py: using RAC 59 21:40:31.727653 tst mo_mt_call.py: using CellId 31679 21:40:31.896224 tst mo_mt_call.py: using BVCI 31680 21:40:32.048740 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:40:32.061702 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:40:32.073881 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:40:32.086801 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:40:32.102012 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:40:32.115572 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 21:40:32.241063 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 21:40:32.359264 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:40:32.835400 run create_hlr_db(pid=31135): Launched 21:40:32.960551 bus /sierra_2: Setting Powered False 21:40:34.022916 run create_hlr_db(pid=31135): Terminated: ok {rc=0} 21:40:34.469652 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31137): Launched 21:40:34.798759 run osmo-hlr_10.42.42.2(pid=31138): Launched 21:40:34.924168 run osmo-stp_10.42.42.5: Starting osmo-stp 21:40:35.494072 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31140): Launched 21:40:35.822936 run osmo-stp_10.42.42.5(pid=31141): Launched 21:40:35.948201 run osmo-msc_10.42.42.6: Starting osmo-msc 21:40:36.540542 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31143): Launched 21:40:36.869087 run osmo-msc_10.42.42.6(pid=31144): Launched 21:40:37.052173 run osmo-stp_10.42.42.5(pid=31141): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31141)] 21:40:37.191255 run osmo-stp_10.42.42.5(pid=31141): stdout: | (launched: 2022-12-12_21:40:35.763526) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:40:37.330515 run osmo-stp_10.42.42.5(pid=31141): stderr: | 20221212214035957 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214035957 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214035958 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214035958 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214035958 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214035959 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214035959 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:40:37.468539 run osmo-stp_10.42.42.5(pid=31141): stdout: | (launched: 2022-12-12_21:40:35.763526) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:40:37.600180 run osmo-stp_10.42.42.5(pid=31141): stderr: | 20221212214035957 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214035957 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214035958 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214035958 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214035958 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214035959 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214035959 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:40:37.756773 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31141): Process ended prematurely: osmo-stp_10.42.42.5(pid=31141) [trial-2382↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31141)] [trial-2382↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 21:40:37.766456 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 21:40:37.795223 run osmo-hlr_10.42.42.2(pid=31138): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31138)] 21:40:37.846225 run osmo-hlr_10.42.42.2(pid=31138): stdout: | (launched: 2022-12-12_21:40:34.739224) 21:40:37.899161 run osmo-hlr_10.42.42.2(pid=31138): stderr: | 20221212214034939 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212214034939 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212214034939 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212214034939 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212214034939 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212214034939 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212214034953 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212214034961 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212214034961 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212214034961 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:40:37.972525 run osmo-msc_10.42.42.6(pid=31144): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31144)] 21:40:38.023368 run osmo-msc_10.42.42.6(pid=31144): stdout: | (launched: 2022-12-12_21:40:36.809575) 21:40:38.075937 run osmo-msc_10.42.42.6(pid=31144): stderr: | 20221212214037134 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212214037134 DLGLOBAL DEBUG validating counter group 0x7f044746bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212214037134 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212214037134 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212214037134 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212214037134 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212214037136 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212214037137 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212214037137 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212214037137 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:40:38.129092 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31137): Terminating (SIGTERM) 21:40:38.171604 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31140): Terminating (SIGTERM) 21:40:38.214384 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31143): Terminating (SIGTERM) 21:40:38.257153 --- ParallelTerminationStrategy: PID 31137 died... 21:40:38.277601 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31137): Terminated: ok {rc=0} 21:40:38.325273 --- ParallelTerminationStrategy: PID 31140 died... 21:40:38.345278 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31140): Terminated: ok {rc=0} 21:40:38.392362 --- ParallelTerminationStrategy: PID 31143 died... 21:40:38.412147 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31143): Terminated: ok {rc=0} 21:40:38.502625 bus /sierra_3: Setting Powered False 21:40:39.603412 bus /sierra_3: Setting Powered False 21:40:40.722188 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2382 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 21:40:41.869990 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:40:41.881894 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 21:40:41.943563 tst mo_mt_call_osmux.py: using LAC 31680 21:40:42.064678 tst mo_mt_call_osmux.py: using RAC 60 21:40:42.187169 tst mo_mt_call_osmux.py: using CellId 31680 21:40:42.310374 tst mo_mt_call_osmux.py: using BVCI 31681 21:40:42.423945 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:40:42.435446 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:40:42.446679 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:40:42.457807 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:40:42.468933 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:40:42.480047 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 21:40:42.599963 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 21:40:42.719573 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:40:43.196445 run create_hlr_db(pid=31146): Launched 21:40:43.322055 bus /sierra_2: Setting Powered False 21:40:44.384260 run create_hlr_db(pid=31146): Terminated: ok {rc=0} 21:40:44.831060 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31148): Launched 21:40:45.159475 run osmo-hlr_10.42.42.2(pid=31149): Launched 21:40:45.285998 run osmo-stp_10.42.42.5: Starting osmo-stp 21:40:45.858679 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31151): Launched 21:40:46.189725 run osmo-stp_10.42.42.5(pid=31152): Launched 21:40:46.436064 run osmo-msc_10.42.42.6: Starting osmo-msc 21:40:47.040724 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31154): Launched 21:40:47.433219 run osmo-msc_10.42.42.6(pid=31155): Launched 21:40:47.617979 run osmo-stp_10.42.42.5(pid=31152): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31152)] 21:40:47.756894 run osmo-stp_10.42.42.5(pid=31152): stdout: | (launched: 2022-12-12_21:40:46.129921) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:40:47.895791 run osmo-stp_10.42.42.5(pid=31152): stderr: | 20221212214046402 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214046402 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214046402 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214046403 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214046403 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214046403 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214046403 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:40:48.034129 run osmo-stp_10.42.42.5(pid=31152): stdout: | (launched: 2022-12-12_21:40:46.129921) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:40:48.165232 run osmo-stp_10.42.42.5(pid=31152): stderr: | 20221212214046402 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214046402 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214046402 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214046403 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214046403 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214046403 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214046403 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:40:48.321920 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31152): Process ended prematurely: osmo-stp_10.42.42.5(pid=31152) [trial-2382↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31152)] [trial-2382↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 21:40:48.331689 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 21:40:48.360268 run osmo-hlr_10.42.42.2(pid=31149): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31149)] 21:40:48.411902 run osmo-hlr_10.42.42.2(pid=31149): stdout: | (launched: 2022-12-12_21:40:45.099856) 21:40:48.465575 run osmo-hlr_10.42.42.2(pid=31149): stderr: | 20221212214045299 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212214045299 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212214045299 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212214045299 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212214045299 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212214045299 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212214045312 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212214045321 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212214045321 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212214045321 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:40:48.539993 run osmo-msc_10.42.42.6(pid=31155): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31155)] 21:40:48.591395 run osmo-msc_10.42.42.6(pid=31155): stdout: | (launched: 2022-12-12_21:40:47.372725) 21:40:48.644347 run osmo-msc_10.42.42.6(pid=31155): stderr: | 20221212214047701 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212214047701 DLGLOBAL DEBUG validating counter group 0x7f9e53f8fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212214047701 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212214047701 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212214047702 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212214047702 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212214047703 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212214047704 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212214047704 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212214047704 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:40:48.697628 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31148): Terminating (SIGTERM) 21:40:48.740276 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31151): Terminating (SIGTERM) 21:40:48.782853 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31154): Terminating (SIGTERM) 21:40:48.825498 --- ParallelTerminationStrategy: PID 31148 died... 21:40:48.845806 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31148): Terminated: ok {rc=0} 21:40:48.893427 --- ParallelTerminationStrategy: PID 31151 died... 21:40:48.913209 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31151): Terminated: ok {rc=0} 21:40:48.960541 --- ParallelTerminationStrategy: PID 31154 died... 21:40:48.980468 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31154): Terminated: ok {rc=0} 21:40:49.070584 bus /sierra_3: Setting Powered False 21:40:50.170752 bus /sierra_3: Setting Powered False 21:40:51.287762 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 21:40:52.531066 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:40:52.539370 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 21:40:52.564759 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 21:40:52.592533 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 21:40:52.645919 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 21:40:52.670434 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 21:40:52.697686 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 21:40:53.251680 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 21:40:53.305102 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:40:53.317054 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 21:40:53.378163 tst mo_mt_call.py: using LAC 31681 21:40:53.506577 tst mo_mt_call.py: using RAC 61 21:40:53.637294 tst mo_mt_call.py: using CellId 31681 21:40:53.767582 tst mo_mt_call.py: using BVCI 31682 21:40:53.886916 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:40:53.898705 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:40:53.910280 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:40:53.922270 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:40:53.934108 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:40:53.945956 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:40:54.066504 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:40:54.184930 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:40:54.660330 run create_hlr_db(pid=31160): Launched 21:40:54.786589 bus /sierra_2: Setting Powered False 21:40:55.848683 run create_hlr_db(pid=31160): Terminated: ok {rc=0} 21:40:56.296653 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31162): Launched 21:40:56.626477 run osmo-hlr_10.42.42.2(pid=31163): Launched 21:40:56.752382 run osmo-stp_10.42.42.5: Starting osmo-stp 21:40:57.322743 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31165): Launched 21:40:57.651218 run osmo-stp_10.42.42.5(pid=31166): Launched 21:40:57.776438 run osmo-msc_10.42.42.6: Starting osmo-msc 21:40:58.374047 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31168): Launched 21:40:58.703212 run osmo-msc_10.42.42.6(pid=31169): Launched 21:40:58.887817 run osmo-stp_10.42.42.5(pid=31166): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31166)] 21:40:59.027397 run osmo-stp_10.42.42.5(pid=31166): stdout: | (launched: 2022-12-12_21:40:57.591489) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:40:59.167437 run osmo-stp_10.42.42.5(pid=31166): stderr: | 20221212214057786 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214057786 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214057786 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214057786 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214057787 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214057787 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214057787 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:40:59.305717 run osmo-stp_10.42.42.5(pid=31166): stdout: | (launched: 2022-12-12_21:40:57.591489) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:40:59.437310 run osmo-stp_10.42.42.5(pid=31166): stderr: | 20221212214057786 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214057786 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214057786 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214057786 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214057787 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214057787 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214057787 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:40:59.595445 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31166): Process ended prematurely: osmo-stp_10.42.42.5(pid=31166) [trial-2382↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31166)] [trial-2382↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 21:40:59.605449 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 21:40:59.634047 run osmo-hlr_10.42.42.2(pid=31163): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31163)] 21:40:59.685967 run osmo-hlr_10.42.42.2(pid=31163): stdout: | (launched: 2022-12-12_21:40:56.566693) 21:40:59.739498 run osmo-hlr_10.42.42.2(pid=31163): stderr: | 20221212214056766 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212214056766 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212214056766 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212214056766 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212214056766 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212214056766 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212214056780 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212214056790 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212214056790 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212214056790 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:40:59.814271 run osmo-msc_10.42.42.6(pid=31169): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31169)] 21:40:59.865921 run osmo-msc_10.42.42.6(pid=31169): stdout: | (launched: 2022-12-12_21:40:58.643665) 21:40:59.919026 run osmo-msc_10.42.42.6(pid=31169): stderr: | 20221212214058965 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212214058966 DLGLOBAL DEBUG validating counter group 0x7f3661d19c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212214058966 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212214058966 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212214058966 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212214058966 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212214058968 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212214058969 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212214058969 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212214058969 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:40:59.972849 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31162): Terminating (SIGTERM) 21:41:00.015862 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31165): Terminating (SIGTERM) 21:41:00.058958 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31168): Terminating (SIGTERM) 21:41:00.101992 --- ParallelTerminationStrategy: PID 31162 died... 21:41:00.122446 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31162): Terminated: ok {rc=0} 21:41:00.170325 --- ParallelTerminationStrategy: PID 31165 died... 21:41:00.190301 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31165): Terminated: ok {rc=0} 21:41:00.238264 --- ParallelTerminationStrategy: PID 31168 died... 21:41:00.258406 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31168): Terminated: ok {rc=0} 21:41:00.348737 bus /sierra_3: Setting Powered False 21:41:01.457854 bus /sierra_3: Setting Powered False 21:41:02.586839 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2382 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 21:41:03.739239 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:41:03.751686 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 21:41:03.815061 tst mo_mt_call_osmux.py: using LAC 31682 21:41:03.944781 tst mo_mt_call_osmux.py: using RAC 62 21:41:04.073359 tst mo_mt_call_osmux.py: using CellId 31682 21:41:04.207589 tst mo_mt_call_osmux.py: using BVCI 31683 21:41:04.322159 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:41:04.333585 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:41:04.344775 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:41:04.356440 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:41:04.368269 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:41:04.380034 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:41:04.498239 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:41:04.619304 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:41:05.130565 run create_hlr_db(pid=31171): Launched 21:41:05.256124 bus /sierra_2: Setting Powered False 21:41:06.322167 run create_hlr_db(pid=31171): Terminated: ok {rc=0} 21:41:06.760794 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31173): Launched 21:41:07.068824 run osmo-hlr_10.42.42.2(pid=31174): Launched 21:41:07.186981 run osmo-stp_10.42.42.5: Starting osmo-stp 21:41:07.732809 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31176): Launched 21:41:08.041087 run osmo-stp_10.42.42.5(pid=31177): Launched 21:41:08.157815 run osmo-msc_10.42.42.6: Starting osmo-msc 21:41:08.729861 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31179): Launched 21:41:09.038203 run osmo-msc_10.42.42.6(pid=31180): Launched 21:41:09.210718 run osmo-stp_10.42.42.5(pid=31177): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31177)] 21:41:09.340375 run osmo-stp_10.42.42.5(pid=31177): stdout: | (launched: 2022-12-12_21:41:07.985090) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:41:09.469820 run osmo-stp_10.42.42.5(pid=31177): stderr: | 20221212214108157 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214108157 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214108158 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214108158 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214108158 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214108158 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214108158 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:41:09.597886 run osmo-stp_10.42.42.5(pid=31177): stdout: | (launched: 2022-12-12_21:41:07.985090) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:41:09.720425 run osmo-stp_10.42.42.5(pid=31177): stderr: | 20221212214108157 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214108157 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214108158 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214108158 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214108158 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214108158 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214108158 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:41:09.868351 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31177): Process ended prematurely: osmo-stp_10.42.42.5(pid=31177) [trial-2382↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31177)] [trial-2382↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 21:41:09.877378 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 21:41:09.904342 run osmo-hlr_10.42.42.2(pid=31174): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31174)] 21:41:09.952928 run osmo-hlr_10.42.42.2(pid=31174): stdout: | (launched: 2022-12-12_21:41:07.012777) 21:41:10.003141 run osmo-hlr_10.42.42.2(pid=31174): stderr: | 20221212214107188 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212214107188 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212214107188 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212214107188 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212214107189 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212214107189 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212214107201 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212214107210 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212214107210 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212214107210 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:41:10.073450 run osmo-msc_10.42.42.6(pid=31180): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31180)] 21:41:10.121982 run osmo-msc_10.42.42.6(pid=31180): stdout: | (launched: 2022-12-12_21:41:08.981863) 21:41:10.171972 run osmo-msc_10.42.42.6(pid=31180): stderr: | 20221212214109256 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212214109256 DLGLOBAL DEBUG validating counter group 0x7f644f7c8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212214109256 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212214109256 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212214109256 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212214109257 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212214109258 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212214109259 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212214109259 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212214109259 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:41:10.222324 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31173): Terminating (SIGTERM) 21:41:10.262080 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31176): Terminating (SIGTERM) 21:41:10.302179 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31179): Terminating (SIGTERM) 21:41:10.342684 --- ParallelTerminationStrategy: PID 31173 died... 21:41:10.362137 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31173): Terminated: ok {rc=0} 21:41:10.406914 --- ParallelTerminationStrategy: PID 31176 died... 21:41:10.425948 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31176): Terminated: ok {rc=0} 21:41:10.470842 --- ParallelTerminationStrategy: PID 31179 died... 21:41:10.489961 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31179): Terminated: ok {rc=0} 21:41:10.576851 bus /sierra_3: Setting Powered False 21:41:11.678023 bus /sierra_3: Setting Powered False 21:41:12.795739 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 emergency:nanobts+band-1900 --------------------------------------------------------------------- 21:41:14.043440 tst emergency:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:41:14.049494 tst emergency:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 21:41:14.074473 tst emergency:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 21:41:14.102148 tst emergency:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 21:41:14.187296 tst emergency:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 21:41:14.211623 tst emergency:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 21:41:14.239308 tst emergency:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 21:41:14.828253 tst emergency:nanobts+band-1900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2382 emergency:nanobts+band-1900 emergency_mo_mt_call.py ---------------------------------------------- 21:41:14.833607 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 21:41:14.844750 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 21:41:14.885856 tst emergency_mo_mt_call.py: using LAC 31683 21:41:15.013240 tst emergency_mo_mt_call.py: using RAC 63 21:41:15.140616 tst emergency_mo_mt_call.py: using CellId 31683 21:41:15.260183 tst emergency_mo_mt_call.py: using BVCI 31684 21:41:15.369581 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 21:41:15.380221 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 21:41:15.390938 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 21:41:15.401537 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 21:41:15.412121 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 21:41:15.422660 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 21:41:15.542509 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 21:41:15.659564 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:41:16.155317 run create_hlr_db(pid=31186): Launched 21:41:16.310828 bus /sierra_2: Setting Powered False 21:41:17.371411 run create_hlr_db(pid=31186): Terminated: ok {rc=0} 21:41:17.813668 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31188): Launched 21:41:18.137573 run osmo-hlr_10.42.42.2(pid=31189): Launched 21:41:18.262047 run osmo-stp_10.42.42.5: Starting osmo-stp 21:41:18.821430 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31191): Launched 21:41:19.145511 run osmo-stp_10.42.42.5(pid=31192): Launched 21:41:19.278585 tst emergency_mo_mt_call.py: using MSISDN 7979 21:41:19.448580 run osmo-msc_10.42.42.6: Starting osmo-msc 21:41:20.029201 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31194): Launched 21:41:20.351131 run osmo-msc_10.42.42.6(pid=31195): Launched 21:41:20.531492 run osmo-stp_10.42.42.5(pid=31192): ERR: Terminated: ERROR {rc=1} [trial-2382↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31192)] 21:41:20.669417 run osmo-stp_10.42.42.5(pid=31192): stdout: | (launched: 2022-12-12_21:41:19.086726) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:41:20.807468 run osmo-stp_10.42.42.5(pid=31192): stderr: | 20221212214119280 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214119280 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214119281 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214119281 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214119282 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214119282 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214119282 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:41:20.945630 run osmo-stp_10.42.42.5(pid=31192): stdout: | (launched: 2022-12-12_21:41:19.086726) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:41:21.074295 run osmo-stp_10.42.42.5(pid=31192): stderr: | 20221212214119280 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214119280 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214119281 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214119281 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214119282 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214119282 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214119282 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:41:21.228356 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=31192): Process ended prematurely: osmo-stp_10.42.42.5(pid=31192) [trial-2382↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31192)] [trial-2382↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19] 21:41:21.237450 tst emergency_mo_mt_call.py:19: Test FAILED (6.4 sec) 21:41:21.266104 run osmo-hlr_10.42.42.2(pid=31189): ERR: Terminated: ERROR {rc=237} [trial-2382↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31189)] 21:41:21.317068 run osmo-hlr_10.42.42.2(pid=31189): stdout: | (launched: 2022-12-12_21:41:18.078976) 21:41:21.369956 run osmo-hlr_10.42.42.2(pid=31189): stderr: | 20221212214118277 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212214118277 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212214118277 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212214118277 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212214118277 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212214118277 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212214118289 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/emergency:nanobts+band-1900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212214118298 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212214118299 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212214118299 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:41:21.443727 run osmo-msc_10.42.42.6(pid=31195): ERR: Terminated: ERROR {rc=2} [trial-2382↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31195)] 21:41:21.494584 run osmo-msc_10.42.42.6(pid=31195): stdout: | (launched: 2022-12-12_21:41:20.292172) 21:41:21.547876 run osmo-msc_10.42.42.6(pid=31195): stderr: | 20221212214120614 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212214120614 DLGLOBAL DEBUG validating counter group 0x7f0429a5dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212214120614 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212214120614 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212214120614 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212214120614 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212214120616 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212214120616 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212214120617 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212214120617 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:41:21.601355 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31188): Terminating (SIGTERM) 21:41:21.644035 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31191): Terminating (SIGTERM) 21:41:21.686882 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31194): Terminating (SIGTERM) 21:41:21.729776 --- ParallelTerminationStrategy: PID 31188 died... 21:41:21.750120 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31188): Terminated: ok {rc=0} 21:41:21.797492 --- ParallelTerminationStrategy: PID 31191 died... 21:41:21.817338 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31191): Terminated: ok {rc=0} 21:41:21.864604 --- ParallelTerminationStrategy: PID 31194 died... 21:41:21.884582 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31194): Terminated: ok {rc=0} 21:41:21.974635 bus /sierra_3: Setting Powered False 21:41:23.074742 bus /sierra_3: Setting Powered False 21:41:24.190961 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2382 emergency:nanobts+band-1900 emergency_preemptive_call.py ---------------------------------------------- 21:41:25.277876 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 21:41:25.289780 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 21:41:25.335143 tst emergency_preemptive_call.py: using LAC 31684 21:41:25.461210 tst emergency_preemptive_call.py: using RAC 64 21:41:25.588298 tst emergency_preemptive_call.py: using CellId 31684 21:41:25.713341 tst emergency_preemptive_call.py: using BVCI 31685 21:41:25.830298 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 21:41:25.841797 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 21:41:25.852924 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 21:41:25.864368 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 21:41:25.875902 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 21:41:25.887414 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 21:41:26.007068 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 21:41:26.124424 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 21:41:26.238783 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 21:41:26.358332 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:41:26.861653 run create_hlr_db(pid=31197): Launched 21:41:26.985557 bus /sierra_2: Setting Powered False 21:41:28.049779 run create_hlr_db(pid=31197): Terminated: ok {rc=0} 21:41:28.481949 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31199): Launched 21:41:28.783856 run osmo-hlr_10.42.42.2(pid=31200): Launched 21:41:28.898315 run osmo-stp_10.42.42.5: Starting osmo-stp 21:41:29.420317 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31202): Launched 21:41:29.721693 run osmo-stp_10.42.42.5(pid=31203): Launched 21:41:29.846754 tst emergency_preemptive_call.py: using MSISDN 7980 21:41:30.002204 run osmo-msc_10.42.42.6: Starting osmo-msc 21:41:30.546051 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31205): Launched 21:41:30.856081 run osmo-msc_10.42.42.6(pid=31206): Launched 21:41:31.230129 run osmo-stp_10.42.42.5(pid=31203): ERR: Terminated: ERROR {rc=1} [trial-2382↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31203)] 21:41:31.416776 run osmo-stp_10.42.42.5(pid=31203): stdout: | (launched: 2022-12-12_21:41:29.666466) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:41:31.627743 run osmo-stp_10.42.42.5(pid=31203): stderr: | 20221212214129836 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214129836 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214129836 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214129836 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214129837 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214129837 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214129837 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:41:31.795579 run osmo-stp_10.42.42.5(pid=31203): stdout: | (launched: 2022-12-12_21:41:29.666466) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:41:31.931225 run osmo-stp_10.42.42.5(pid=31203): stderr: | 20221212214129836 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214129836 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214129836 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214129836 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214129837 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214129837 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214129837 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:41:32.091148 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=31203): Process ended prematurely: osmo-stp_10.42.42.5(pid=31203) [trial-2382↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31203)] [trial-2382↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32] 21:41:32.102353 tst emergency_preemptive_call.py:32: Test FAILED (6.8 sec) 21:41:32.134541 run osmo-hlr_10.42.42.2(pid=31200): ERR: Terminated: ERROR {rc=237} [trial-2382↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31200)] 21:41:32.188873 run osmo-hlr_10.42.42.2(pid=31200): stdout: | (launched: 2022-12-12_21:41:28.728749) 21:41:32.246104 run osmo-hlr_10.42.42.2(pid=31200): stderr: | 20221212214128906 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212214128906 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212214128906 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212214128906 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212214128906 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212214128906 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212214128918 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/emergency:nanobts+band-1900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212214128927 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212214128927 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212214128927 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:41:32.324357 run osmo-msc_10.42.42.6(pid=31206): ERR: Terminated: ERROR {rc=2} [trial-2382↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31206)] 21:41:32.377153 run osmo-msc_10.42.42.6(pid=31206): stdout: | (launched: 2022-12-12_21:41:30.792169) 21:41:32.430845 run osmo-msc_10.42.42.6(pid=31206): stderr: | 20221212214131288 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212214131288 DLGLOBAL DEBUG validating counter group 0x7f2b76f0fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212214131288 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212214131288 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212214131288 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212214131293 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212214131296 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212214131296 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212214131296 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212214131296 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:41:32.485626 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31199): Terminating (SIGTERM) 21:41:32.529574 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31202): Terminating (SIGTERM) 21:41:32.573720 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31205): Terminating (SIGTERM) 21:41:32.617593 --- ParallelTerminationStrategy: PID 31199 died... 21:41:32.638193 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31199): Terminated: ok {rc=0} 21:41:32.687641 --- ParallelTerminationStrategy: PID 31202 died... 21:41:32.707836 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31202): Terminated: ok {rc=0} 21:41:32.757265 --- ParallelTerminationStrategy: PID 31205 died... 21:41:32.777397 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31205): Terminated: ok {rc=0} 21:41:32.869381 bus /sierra_9: Setting Powered False 21:41:33.968675 bus /sierra_9: Setting Powered False 21:41:35.087795 bus /sierra_8: Setting Powered False 21:41:36.187030 bus /sierra_8: Setting Powered False 21:41:37.305439 bus /sierra_3: Setting Powered False 21:41:38.405230 bus /sierra_3: Setting Powered False 21:41:39.525731 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 emergency:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 gprs:nanobts+band-1900 --------------------------------------------------------------------- 21:41:40.797147 tst gprs:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:41:40.802276 tst gprs:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 21:41:40.825655 tst gprs:nanobts+band-1900: Verifying 9 x ip_address (candidates: 9) 21:41:40.863744 tst gprs:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 21:41:40.949661 tst gprs:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 21:41:40.972927 tst gprs:nanobts+band-1900: Reserving 9 x ip_address (candidates: 9) 21:41:41.010584 tst gprs:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 21:41:41.603180 tst gprs:nanobts+band-1900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2382 gprs:nanobts+band-1900 cs_paging_gprs_active.py ---------------------------------------------- 21:41:41.653107 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:41:41.663775 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 21:41:41.701954 tst cs_paging_gprs_active.py: using LAC 31685 21:41:41.827694 tst cs_paging_gprs_active.py: using RAC 65 21:41:41.948340 tst cs_paging_gprs_active.py: using CellId 31685 21:41:42.069372 tst cs_paging_gprs_active.py: using BVCI 31686 21:41:42.184052 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:41:42.194866 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:41:42.205401 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:41:42.215888 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:41:42.226521 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:41:42.236939 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:41:42.247620 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:41:42.258455 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:41:42.269063 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 21:41:42.387432 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 21:41:42.503339 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 21:41:42.711986 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:41:43.021474 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31212): Launched 21:41:43.290183 run iperf3-srv_10.42.42.10(pid=31213): Launched 21:41:43.405584 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 21:41:43.612789 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:41:43.922798 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31214): Launched 21:41:44.190906 run iperf3-srv_10.42.42.10(pid=31215): Launched 21:41:44.305906 tst cs_paging_gprs_active.py:38: start network... 21:41:44.512494 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:41:44.989590 run create_hlr_db(pid=31216): Launched 21:41:45.116087 bus /sierra_2: Setting Powered False 21:41:46.176490 run create_hlr_db(pid=31216): Terminated: ok {rc=0} 21:41:46.618066 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31218): Launched 21:41:46.961814 run osmo-hlr_10.42.42.2(pid=31219): Launched 21:41:47.168256 run osmo-stp_10.42.42.5: Starting osmo-stp 21:41:47.753639 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31221): Launched 21:41:48.084161 run osmo-stp_10.42.42.5(pid=31222): Launched 21:41:48.210642 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:41:48.782461 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31224): Launched 21:41:48.909054 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:41:49.189516 run patchelf(pid=31225): Launched 21:41:49.374431 run osmo-stp_10.42.42.5(pid=31222): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31222)] 21:41:49.514845 run osmo-stp_10.42.42.5(pid=31222): stdout: | (launched: 2022-12-12_21:41:48.024186) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:41:49.657507 run osmo-stp_10.42.42.5(pid=31222): stderr: | 20221212214148220 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214148220 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214148220 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214148221 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214148221 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214148221 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214148221 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:41:49.799646 run osmo-stp_10.42.42.5(pid=31222): stdout: | (launched: 2022-12-12_21:41:48.024186) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:41:49.936092 run osmo-stp_10.42.42.5(pid=31222): stderr: | 20221212214148220 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214148220 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214148220 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214148221 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214148221 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214148221 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214148221 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:41:50.097899 run patchelf(pid=31225): Terminating (SIGINT) 21:41:50.285968 run patchelf(pid=31225): Terminated: ok {rc=0} 21:41:50.421428 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=31222): Process ended prematurely: osmo-stp_10.42.42.5(pid=31222) [trial-2382↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31222)] [trial-2382↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38] 21:41:50.431672 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 21:41:50.461559 run osmo-hlr_10.42.42.2(pid=31219): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31219)] 21:41:50.512923 run osmo-hlr_10.42.42.2(pid=31219): stdout: | (launched: 2022-12-12_21:41:46.887081) 21:41:50.566347 run osmo-hlr_10.42.42.2(pid=31219): stderr: | 20221212214147218 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212214147218 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212214147218 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212214147218 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212214147218 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212214147218 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212214147231 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:nanobts+band-1900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212214147240 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212214147240 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212214147240 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:41:50.620024 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31212): Terminating (SIGTERM) 21:41:50.663599 run iperf3-srv_10.42.42.10(pid=31213): Terminating (SIGTERM) 21:41:50.706748 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31214): Terminating (SIGTERM) 21:41:50.749714 run iperf3-srv_10.42.42.10(pid=31215): Terminating (SIGTERM) 21:41:50.792566 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31218): Terminating (SIGTERM) 21:41:50.835950 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31221): Terminating (SIGTERM) 21:41:50.878808 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31224): Terminating (SIGTERM) 21:41:50.921826 --- ParallelTerminationStrategy: PID 31212 died... 21:41:50.942288 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31212): Terminated: ok {rc=0} 21:41:50.990197 --- ParallelTerminationStrategy: PID 31213 died... 21:41:51.010214 run iperf3-srv_10.42.42.10(pid=31213): Terminated {rc=256} 21:41:51.057473 --- ParallelTerminationStrategy: PID 31214 died... 21:41:51.077497 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31214): Terminated: ok {rc=0} 21:41:51.124856 --- ParallelTerminationStrategy: PID 31215 died... 21:41:51.145180 run iperf3-srv_10.42.42.10(pid=31215): Terminated {rc=256} 21:41:51.192589 --- ParallelTerminationStrategy: PID 31218 died... 21:41:51.212540 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31218): Terminated: ok {rc=0} 21:41:51.259884 --- ParallelTerminationStrategy: PID 31221 died... 21:41:51.279694 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31221): Terminated: ok {rc=0} 21:41:51.327138 --- ParallelTerminationStrategy: PID 31224 died... 21:41:51.347245 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31224): Terminated: ok {rc=0} 21:41:51.436554 bus /gobi_0: Setting Powered False 21:41:52.536424 bus /gobi_0: Setting Powered False 21:41:53.653990 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:nanobts+band-1900 iperf3.py ---------------------------------------------- 21:41:54.806599 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:41:54.818527 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 21:41:54.859227 tst iperf3.py: using LAC 31686 21:41:54.990253 tst iperf3.py: using RAC 66 21:41:55.119998 tst iperf3.py: using CellId 31686 21:41:55.249133 tst iperf3.py: using BVCI 31687 21:41:55.362395 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:41:55.373474 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:41:55.383994 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:41:55.394493 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:41:55.404839 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:41:55.415271 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:41:55.425995 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:41:55.436449 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:41:55.447066 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 21:41:55.569588 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 21:41:55.792273 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:41:56.122130 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31226): Launched 21:41:56.408587 run iperf3-srv_10.42.42.10(pid=31227): Launched 21:41:56.531927 tst iperf3.py:8: start network... 21:41:56.755283 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:41:57.266491 run create_hlr_db(pid=31228): Launched 21:41:57.392523 bus /gobi_6: Setting Powered False 21:41:58.458171 run create_hlr_db(pid=31228): Terminated: ok {rc=0} 21:41:58.900199 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31230): Launched 21:41:59.208432 run osmo-hlr_10.42.42.2(pid=31231): Launched 21:41:59.326248 run osmo-stp_10.42.42.5: Starting osmo-stp 21:41:59.852889 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31233): Launched 21:42:00.159452 run osmo-stp_10.42.42.5(pid=31234): Launched 21:42:00.276879 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:42:00.808861 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31236): Launched 21:42:00.989252 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:42:01.464549 run patchelf(pid=31239): Launched 21:42:01.648194 run osmo-stp_10.42.42.5(pid=31234): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31234)] 21:42:01.782955 run osmo-stp_10.42.42.5(pid=31234): stdout: | (launched: 2022-12-12_21:42:00.103156) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:42:01.918145 run osmo-stp_10.42.42.5(pid=31234): stderr: | 20221212214200275 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214200275 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214200276 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214200276 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214200277 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214200277 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214200277 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:42:02.052799 run osmo-stp_10.42.42.5(pid=31234): stdout: | (launched: 2022-12-12_21:42:00.103156) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:42:02.181935 run osmo-stp_10.42.42.5(pid=31234): stderr: | 20221212214200275 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214200275 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214200276 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214200276 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214200277 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214200277 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214200277 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:42:02.334898 run patchelf(pid=31239): Terminating (SIGINT) 21:42:02.510041 run patchelf(pid=31239): Terminated: ok {rc=0} 21:42:02.635658 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31234): Process ended prematurely: osmo-stp_10.42.42.5(pid=31234) [trial-2382↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31234)] [trial-2382↪gprs:nanobts+band-1900↪iperf3.py:8] 21:42:02.645443 tst iperf3.py:8: Test FAILED (7.9 sec) 21:42:02.673310 run osmo-hlr_10.42.42.2(pid=31231): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:nanobts+band-1900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31231)] 21:42:02.721846 run osmo-hlr_10.42.42.2(pid=31231): stdout: | (launched: 2022-12-12_21:41:59.152039) 21:42:02.772152 run osmo-hlr_10.42.42.2(pid=31231): stderr: | 20221212214159330 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212214159330 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212214159330 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212214159331 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212214159331 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212214159331 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212214159343 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:nanobts+band-1900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212214159352 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212214159352 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212214159352 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:42:02.822971 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31226): Terminating (SIGTERM) 21:42:02.863663 run iperf3-srv_10.42.42.10(pid=31227): Terminating (SIGTERM) 21:42:02.903967 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31230): Terminating (SIGTERM) 21:42:02.944403 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31233): Terminating (SIGTERM) 21:42:02.984723 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31236): Terminating (SIGTERM) 21:42:03.025509 --- ParallelTerminationStrategy: PID 31226 died... 21:42:03.045067 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31226): Terminated: ok {rc=0} 21:42:03.090603 --- ParallelTerminationStrategy: PID 31227 died... 21:42:03.109829 run iperf3-srv_10.42.42.10(pid=31227): Terminated {rc=256} 21:42:03.154834 --- ParallelTerminationStrategy: PID 31230 died... 21:42:03.173818 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31230): Terminated: ok {rc=0} 21:42:03.218487 --- ParallelTerminationStrategy: PID 31233 died... 21:42:03.237691 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31233): Terminated: ok {rc=0} 21:42:03.282448 --- ParallelTerminationStrategy: PID 31236 died... 21:42:03.301624 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31236): Terminated: ok {rc=0} 21:42:03.387732 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:nanobts+band-1900 iperf3m4.py ---------------------------------------------- 21:42:04.532495 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:42:04.543861 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 21:42:04.587448 tst iperf3m4.py: using LAC 31687 21:42:04.708189 tst iperf3m4.py: using RAC 67 21:42:04.827342 tst iperf3m4.py: using CellId 31687 21:42:04.952094 tst iperf3m4.py: using BVCI 31688 21:42:05.065146 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:42:05.075928 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:42:05.086696 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:42:05.097518 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:42:05.108080 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:42:05.118710 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:42:05.129609 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:42:05.140064 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:42:05.150872 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 21:42:05.270195 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 21:42:05.395052 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 21:42:05.517134 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 21:42:05.632628 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 21:42:05.840342 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:42:06.150545 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31240): Launched 21:42:06.419632 run iperf3-srv_10.42.42.10(pid=31241): Launched 21:42:06.535638 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 21:42:06.741282 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:42:07.051302 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31242): Launched 21:42:07.319119 run iperf3-srv_10.42.42.10(pid=31243): Launched 21:42:07.434497 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 21:42:07.640261 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:42:07.949368 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31244): Launched 21:42:08.218502 run iperf3-srv_10.42.42.10(pid=31245): Launched 21:42:08.334776 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 21:42:08.540634 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:42:08.850198 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31246): Launched 21:42:09.118322 run iperf3-srv_10.42.42.10(pid=31247): Launched 21:42:09.233585 tst iperf3m4.py:8: start network... 21:42:09.440113 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:42:09.915904 run create_hlr_db(pid=31248): Launched 21:42:10.041854 bus /gobi_6: Setting Powered False 21:42:11.103377 run create_hlr_db(pid=31248): Terminated: ok {rc=0} 21:42:11.551532 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31250): Launched 21:42:11.882584 run osmo-hlr_10.42.42.2(pid=31251): Launched 21:42:12.008818 run osmo-stp_10.42.42.5: Starting osmo-stp 21:42:12.583046 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31253): Launched 21:42:12.895843 run osmo-stp_10.42.42.5(pid=31254): Launched 21:42:13.012636 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:42:13.543068 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31256): Launched 21:42:13.660183 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:42:13.919465 run patchelf(pid=31257): Launched 21:42:14.092198 run osmo-stp_10.42.42.5(pid=31254): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31254)] 21:42:14.222457 run osmo-stp_10.42.42.5(pid=31254): stdout: | (launched: 2022-12-12_21:42:12.839055) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:42:14.354614 run osmo-stp_10.42.42.5(pid=31254): stderr: | 20221212214213011 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214213011 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214213011 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214213012 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214213012 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214213012 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214213012 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:42:14.486168 run osmo-stp_10.42.42.5(pid=31254): stdout: | (launched: 2022-12-12_21:42:12.839055) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:42:14.612456 run osmo-stp_10.42.42.5(pid=31254): stderr: | 20221212214213011 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214213011 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214213011 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214213012 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214213012 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214213012 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214213012 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:42:14.761938 run patchelf(pid=31257): Terminating (SIGINT) 21:42:14.935011 run patchelf(pid=31257): Terminated: ok {rc=0} 21:42:15.059633 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31254): Process ended prematurely: osmo-stp_10.42.42.5(pid=31254) [trial-2382↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31254)] [trial-2382↪gprs:nanobts+band-1900↪iperf3m4.py:8] 21:42:15.069094 tst iperf3m4.py:8: Test FAILED (10.6 sec) 21:42:15.096776 run osmo-hlr_10.42.42.2(pid=31251): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:nanobts+band-1900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31251)] 21:42:15.144933 run osmo-hlr_10.42.42.2(pid=31251): stdout: | (launched: 2022-12-12_21:42:11.822766) 21:42:15.194747 run osmo-hlr_10.42.42.2(pid=31251): stderr: | 20221212214212025 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212214212025 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212214212025 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212214212025 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212214212025 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212214212025 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212214212037 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:nanobts+band-1900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212214212046 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212214212046 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212214212046 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:42:15.245442 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31240): Terminating (SIGTERM) 21:42:15.285806 run iperf3-srv_10.42.42.10(pid=31241): Terminating (SIGTERM) 21:42:15.326229 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31242): Terminating (SIGTERM) 21:42:15.366666 run iperf3-srv_10.42.42.10(pid=31243): Terminating (SIGTERM) 21:42:15.406813 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31244): Terminating (SIGTERM) 21:42:15.447255 run iperf3-srv_10.42.42.10(pid=31245): Terminating (SIGTERM) 21:42:15.487478 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31246): Terminating (SIGTERM) 21:42:15.527825 run iperf3-srv_10.42.42.10(pid=31247): Terminating (SIGTERM) 21:42:15.567857 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31250): Terminating (SIGTERM) 21:42:15.608169 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31253): Terminating (SIGTERM) 21:42:15.648364 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31256): Terminating (SIGTERM) 21:42:15.689079 --- ParallelTerminationStrategy: PID 31240 died... 21:42:15.708481 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31240): Terminated: ok {rc=0} 21:42:15.753392 --- ParallelTerminationStrategy: PID 31241 died... 21:42:15.772287 run iperf3-srv_10.42.42.10(pid=31241): Terminated {rc=256} 21:42:15.816914 --- ParallelTerminationStrategy: PID 31242 died... 21:42:15.836539 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31242): Terminated: ok {rc=0} 21:42:15.882372 --- ParallelTerminationStrategy: PID 31243 died... 21:42:15.901944 run iperf3-srv_10.42.42.10(pid=31243): Terminated {rc=256} 21:42:15.947695 --- ParallelTerminationStrategy: PID 31244 died... 21:42:15.967142 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31244): Terminated: ok {rc=0} 21:42:16.012773 --- ParallelTerminationStrategy: PID 31245 died... 21:42:16.032400 run iperf3-srv_10.42.42.10(pid=31245): Terminated {rc=256} 21:42:16.077583 --- ParallelTerminationStrategy: PID 31246 died... 21:42:16.097301 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31246): Terminated: ok {rc=0} 21:42:16.142927 --- ParallelTerminationStrategy: PID 31247 died... 21:42:16.162574 run iperf3-srv_10.42.42.10(pid=31247): Terminated {rc=256} 21:42:16.207862 --- ParallelTerminationStrategy: PID 31250 died... 21:42:16.227434 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31250): Terminated: ok {rc=0} 21:42:16.272798 --- ParallelTerminationStrategy: PID 31253 died... 21:42:16.292342 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31253): Terminated: ok {rc=0} 21:42:16.338021 --- ParallelTerminationStrategy: PID 31256 died... 21:42:16.357807 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31256): Terminated: ok {rc=0} 21:42:16.448653 bus /gobi_4: Setting Powered False 21:42:17.555202 bus /gobi_4: Setting Powered False 21:42:18.671882 bus /gobi_1: Setting Powered False 21:42:19.772001 bus /gobi_1: Setting Powered False 21:42:20.889290 bus /gobi_0: Setting Powered False 21:42:21.989415 bus /gobi_0: Setting Powered False 21:42:23.103717 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:nanobts+band-1900 ping.py ---------------------------------------------- 21:42:24.206229 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:42:24.217475 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 21:42:24.256325 tst ping.py: using LAC 31688 21:42:24.377888 tst ping.py: using RAC 68 21:42:24.497322 tst ping.py: using CellId 31688 21:42:24.617404 tst ping.py: using BVCI 31689 21:42:24.727984 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:42:24.738728 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:42:24.749482 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:42:24.759904 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:42:24.770361 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:42:24.780838 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:42:24.791462 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:42:24.802041 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 21:42:24.915912 tst ping.py:19: start network... 21:42:25.117467 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:42:25.583718 run create_hlr_db(pid=31258): Launched 21:42:25.706600 bus /gobi_6: Setting Powered False 21:42:26.766702 run create_hlr_db(pid=31258): Terminated: ok {rc=0} 21:42:27.208872 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31260): Launched 21:42:27.533164 run osmo-hlr_10.42.42.2(pid=31261): Launched 21:42:27.658423 run osmo-stp_10.42.42.5: Starting osmo-stp 21:42:28.223433 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31263): Launched 21:42:28.548324 run osmo-stp_10.42.42.5(pid=31264): Launched 21:42:28.674277 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:42:29.235098 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31266): Launched 21:42:29.359801 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:42:29.634575 run patchelf(pid=31267): Launched 21:42:29.814534 run osmo-stp_10.42.42.5(pid=31264): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31264)] 21:42:29.951867 run osmo-stp_10.42.42.5(pid=31264): stdout: | (launched: 2022-12-12_21:42:28.489349) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:42:30.091233 run osmo-stp_10.42.42.5(pid=31264): stderr: | 20221212214228683 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214228683 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214228683 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214228683 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214228684 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214228684 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214228684 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:42:30.230136 run osmo-stp_10.42.42.5(pid=31264): stdout: | (launched: 2022-12-12_21:42:28.489349) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:42:30.363591 run osmo-stp_10.42.42.5(pid=31264): stderr: | 20221212214228683 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214228683 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214228683 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214228683 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214228684 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214228684 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214228684 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:42:30.521620 run patchelf(pid=31267): Terminating (SIGINT) 21:42:30.704795 run patchelf(pid=31267): Terminated: ok {rc=0} 21:42:30.840398 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=31264): Process ended prematurely: osmo-stp_10.42.42.5(pid=31264) [trial-2382↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31264)] [trial-2382↪gprs:nanobts+band-1900↪ping.py:22] 21:42:30.850719 tst ping.py:22: Test FAILED (6.6 sec) 21:42:30.879654 run osmo-hlr_10.42.42.2(pid=31261): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:nanobts+band-1900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31261)] 21:42:30.953569 run osmo-hlr_10.42.42.2(pid=31261): stdout: | (launched: 2022-12-12_21:42:27.474034) 21:42:31.008894 run osmo-hlr_10.42.42.2(pid=31261): stderr: | 20221212214227671 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212214227671 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212214227671 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212214227671 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212214227671 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212214227671 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212214227684 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:nanobts+band-1900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212214227692 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212214227692 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212214227693 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:42:31.066917 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31260): Terminating (SIGTERM) 21:42:31.111999 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31263): Terminating (SIGTERM) 21:42:31.157130 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31266): Terminating (SIGTERM) 21:42:31.202638 --- ParallelTerminationStrategy: PID 31260 died... 21:42:31.223828 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31260): Terminated: ok {rc=0} 21:42:31.274610 --- ParallelTerminationStrategy: PID 31263 died... 21:42:31.295693 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31263): Terminated: ok {rc=0} 21:42:31.346359 --- ParallelTerminationStrategy: PID 31266 died... 21:42:31.367391 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31266): Terminated: ok {rc=0} 21:42:31.460307 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:nanobts+band-1900 ping_idle_ping.py ---------------------------------------------- 21:42:32.551457 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:42:32.563718 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 21:42:32.606336 tst ping_idle_ping.py: using LAC 31689 21:42:32.735015 tst ping_idle_ping.py: using RAC 69 21:42:32.864034 tst ping_idle_ping.py: using CellId 31689 21:42:32.993220 tst ping_idle_ping.py: using BVCI 31690 21:42:33.111549 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:42:33.122901 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:42:33.134103 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:42:33.145610 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:42:33.156885 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:42:33.168122 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:42:33.179573 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:42:33.191111 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 21:42:33.308363 tst ping_idle_ping.py:24: start network... 21:42:33.513102 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:42:33.986420 run create_hlr_db(pid=31268): Launched 21:42:34.112683 bus /gobi_6: Setting Powered False 21:42:35.174150 run create_hlr_db(pid=31268): Terminated: ok {rc=0} 21:42:35.619711 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31270): Launched 21:42:35.944874 run osmo-hlr_10.42.42.2(pid=31271): Launched 21:42:36.069916 run osmo-stp_10.42.42.5: Starting osmo-stp 21:42:36.636887 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31273): Launched 21:42:36.962680 run osmo-stp_10.42.42.5(pid=31274): Launched 21:42:37.087105 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:42:37.650311 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31276): Launched 21:42:37.773882 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:42:38.048572 run patchelf(pid=31277): Launched 21:42:38.229562 run osmo-stp_10.42.42.5(pid=31274): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31274)] 21:42:38.367569 run osmo-stp_10.42.42.5(pid=31274): stdout: | (launched: 2022-12-12_21:42:36.903474) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:42:38.507421 run osmo-stp_10.42.42.5(pid=31274): stderr: | 20221212214237094 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214237094 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214237095 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214237095 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214237098 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214237099 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214237099 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:42:38.648001 run osmo-stp_10.42.42.5(pid=31274): stdout: | (launched: 2022-12-12_21:42:36.903474) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:42:38.782027 run osmo-stp_10.42.42.5(pid=31274): stderr: | 20221212214237094 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214237094 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214237095 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214237095 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214237098 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214237099 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214237099 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:42:38.940351 run patchelf(pid=31277): Terminating (SIGINT) 21:42:39.123595 run patchelf(pid=31277): Terminated: ok {rc=0} 21:42:39.255093 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=31274): Process ended prematurely: osmo-stp_10.42.42.5(pid=31274) [trial-2382↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31274)] [trial-2382↪gprs:nanobts+band-1900↪ping_idle_ping.py:27] 21:42:39.264676 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 21:42:39.293843 run osmo-hlr_10.42.42.2(pid=31271): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:nanobts+band-1900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31271)] 21:42:39.345089 run osmo-hlr_10.42.42.2(pid=31271): stdout: | (launched: 2022-12-12_21:42:35.885680) 21:42:39.398211 run osmo-hlr_10.42.42.2(pid=31271): stderr: | 20221212214236084 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212214236084 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212214236084 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212214236085 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212214236085 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212214236085 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212214236098 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:nanobts+band-1900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212214236106 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212214236107 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212214236107 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:42:39.451118 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31270): Terminating (SIGTERM) 21:42:39.493712 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31273): Terminating (SIGTERM) 21:42:39.536210 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31276): Terminating (SIGTERM) 21:42:39.579186 --- ParallelTerminationStrategy: PID 31270 died... 21:42:39.599837 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31270): Terminated: ok {rc=0} 21:42:39.647754 --- ParallelTerminationStrategy: PID 31273 died... 21:42:39.667690 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31273): Terminated: ok {rc=0} 21:42:39.715054 --- ParallelTerminationStrategy: PID 31276 died... 21:42:39.735060 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31276): Terminated: ok {rc=0} 21:42:39.825042 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2382 gprs:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 gprs:nanobts+band-1900+mod-bts0-egprs --------------------------------------------------------------------- 21:42:41.121206 tst gprs:nanobts+band-1900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:42:41.127300 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 21:42:41.150896 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 21:42:41.188995 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 21:42:41.274942 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 21:42:41.298402 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 21:42:41.336165 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 21:42:41.932253 tst gprs:nanobts+band-1900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2382 gprs:nanobts+band-1900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 21:42:41.981629 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:42:41.992473 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:42:42.033075 tst cs_paging_gprs_active.py: using LAC 31690 21:42:42.156571 tst cs_paging_gprs_active.py: using RAC 70 21:42:42.278785 tst cs_paging_gprs_active.py: using CellId 31690 21:42:42.402584 tst cs_paging_gprs_active.py: using BVCI 31691 21:42:42.515508 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:42:42.526680 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:42:42.537817 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:42:42.549211 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:42:42.560001 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:42:42.570775 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:42:42.581794 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:42:42.592396 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:42:42.603277 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:42:42.724005 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:42:42.844816 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 21:42:43.068792 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:42:43.400435 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31281): Launched 21:42:43.687936 run iperf3-srv_10.42.42.10(pid=31282): Launched 21:42:43.812099 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 21:42:44.036068 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:42:44.368250 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31283): Launched 21:42:44.655125 run iperf3-srv_10.42.42.10(pid=31284): Launched 21:42:44.779249 tst cs_paging_gprs_active.py:38: start network... 21:42:45.002409 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:42:45.515032 run create_hlr_db(pid=31285): Launched 21:42:45.642372 bus /gobi_6: Setting Powered False 21:42:46.708736 run create_hlr_db(pid=31285): Terminated: ok {rc=0} 21:42:47.193737 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31287): Launched 21:42:47.507453 run osmo-hlr_10.42.42.2(pid=31288): Launched 21:42:47.625934 run osmo-stp_10.42.42.5: Starting osmo-stp 21:42:48.156205 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31290): Launched 21:42:48.463222 run osmo-stp_10.42.42.5(pid=31291): Launched 21:42:48.581194 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:42:49.113839 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31293): Launched 21:42:49.232072 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:42:49.494654 run patchelf(pid=31294): Launched 21:42:49.665629 run osmo-stp_10.42.42.5(pid=31291): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31291)] 21:42:49.795725 run osmo-stp_10.42.42.5(pid=31291): stdout: | (launched: 2022-12-12_21:42:48.406882) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:42:49.927215 run osmo-stp_10.42.42.5(pid=31291): stderr: | 20221212214248580 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214248580 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214248581 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214248581 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214248582 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214248582 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214248582 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:42:50.058763 run osmo-stp_10.42.42.5(pid=31291): stdout: | (launched: 2022-12-12_21:42:48.406882) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:42:50.184851 run osmo-stp_10.42.42.5(pid=31291): stderr: | 20221212214248580 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214248580 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214248581 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214248581 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214248582 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214248582 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214248582 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:42:50.334198 run patchelf(pid=31294): Terminating (SIGINT) 21:42:50.507123 run patchelf(pid=31294): Terminated: ok {rc=0} 21:42:50.632511 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=31291): Process ended prematurely: osmo-stp_10.42.42.5(pid=31291) [trial-2382↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31291)] [trial-2382↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 21:42:50.642203 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 21:42:50.669631 run osmo-hlr_10.42.42.2(pid=31288): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31288)] 21:42:50.717629 run osmo-hlr_10.42.42.2(pid=31288): stdout: | (launched: 2022-12-12_21:42:47.451746) 21:42:50.767378 run osmo-hlr_10.42.42.2(pid=31288): stderr: | 20221212214247626 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212214247626 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212214247626 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212214247626 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212214247626 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212214247626 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212214247665 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:nanobts+band-1900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212214247675 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212214247675 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212214247675 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:42:50.817700 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31281): Terminating (SIGTERM) 21:42:50.857806 run iperf3-srv_10.42.42.10(pid=31282): Terminating (SIGTERM) 21:42:50.897994 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31283): Terminating (SIGTERM) 21:42:50.938208 run iperf3-srv_10.42.42.10(pid=31284): Terminating (SIGTERM) 21:42:50.978264 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31287): Terminating (SIGTERM) 21:42:51.018470 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31290): Terminating (SIGTERM) 21:42:51.058615 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31293): Terminating (SIGTERM) 21:42:51.099116 --- ParallelTerminationStrategy: PID 31281 died... 21:42:51.118601 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31281): Terminated: ok {rc=0} 21:42:51.163100 --- ParallelTerminationStrategy: PID 31282 died... 21:42:51.181976 run iperf3-srv_10.42.42.10(pid=31282): Terminated {rc=256} 21:42:51.226337 --- ParallelTerminationStrategy: PID 31283 died... 21:42:51.245281 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31283): Terminated: ok {rc=0} 21:42:51.289604 --- ParallelTerminationStrategy: PID 31284 died... 21:42:51.308367 run iperf3-srv_10.42.42.10(pid=31284): Terminated {rc=256} 21:42:51.352538 --- ParallelTerminationStrategy: PID 31287 died... 21:42:51.371376 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31287): Terminated: ok {rc=0} 21:42:51.415533 --- ParallelTerminationStrategy: PID 31290 died... 21:42:51.434742 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31290): Terminated: ok {rc=0} 21:42:51.479077 --- ParallelTerminationStrategy: PID 31293 died... 21:42:51.498124 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31293): Terminated: ok {rc=0} 21:42:51.584475 bus /gobi_0: Setting Powered False 21:42:52.686188 bus /gobi_0: Setting Powered False 21:42:53.802973 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:nanobts+band-1900+mod-bts0-egprs iperf3.py ---------------------------------------------- 21:42:54.951449 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:42:54.963142 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:42:55.005781 tst iperf3.py: using LAC 31691 21:42:55.137193 tst iperf3.py: using RAC 71 21:42:55.268788 tst iperf3.py: using CellId 31691 21:42:55.399426 tst iperf3.py: using BVCI 31692 21:42:55.519823 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:42:55.531412 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:42:55.542764 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:42:55.554363 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:42:55.565910 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:42:55.577425 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:42:55.589160 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:42:55.600898 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:42:55.613115 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:42:55.734640 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 21:42:55.957921 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:42:56.288660 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31295): Launched 21:42:56.575810 run iperf3-srv_10.42.42.10(pid=31296): Launched 21:42:56.700272 tst iperf3.py:8: start network... 21:42:56.923623 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:42:57.435111 run create_hlr_db(pid=31297): Launched 21:42:57.562146 bus /gobi_6: Setting Powered False 21:42:58.628274 run create_hlr_db(pid=31297): Terminated: ok {rc=0} 21:42:59.069234 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31299): Launched 21:42:59.378471 run osmo-hlr_10.42.42.2(pid=31300): Launched 21:42:59.497768 run osmo-stp_10.42.42.5: Starting osmo-stp 21:43:00.029330 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31302): Launched 21:43:00.337117 run osmo-stp_10.42.42.5(pid=31303): Launched 21:43:00.454740 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:43:01.023319 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31305): Launched 21:43:01.145430 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:43:01.413866 run patchelf(pid=31306): Launched 21:43:01.600275 run osmo-stp_10.42.42.5(pid=31303): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31303)] 21:43:01.733440 run osmo-stp_10.42.42.5(pid=31303): stdout: | (launched: 2022-12-12_21:43:00.280896) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:43:01.867724 run osmo-stp_10.42.42.5(pid=31303): stderr: | 20221212214300452 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214300452 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214300452 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214300453 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214300453 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214300453 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214300453 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:43:02.002350 run osmo-stp_10.42.42.5(pid=31303): stdout: | (launched: 2022-12-12_21:43:00.280896) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:43:02.131428 run osmo-stp_10.42.42.5(pid=31303): stderr: | 20221212214300452 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214300452 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214300452 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214300453 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214300453 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214300453 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214300453 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:43:02.282248 run patchelf(pid=31306): Terminating (SIGINT) 21:43:02.456160 run patchelf(pid=31306): Terminated: ok {rc=0} 21:43:02.581813 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31303): Process ended prematurely: osmo-stp_10.42.42.5(pid=31303) [trial-2382↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31303)] [trial-2382↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8] 21:43:02.591446 tst iperf3.py:8: Test FAILED (7.7 sec) 21:43:02.619297 run osmo-hlr_10.42.42.2(pid=31300): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31300)] 21:43:02.667793 run osmo-hlr_10.42.42.2(pid=31300): stdout: | (launched: 2022-12-12_21:42:59.322023) 21:43:02.718995 run osmo-hlr_10.42.42.2(pid=31300): stderr: | 20221212214259499 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212214259499 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212214259499 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212214259499 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212214259499 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212214259499 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212214259514 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212214259524 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212214259524 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212214259524 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:43:02.769947 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31295): Terminating (SIGTERM) 21:43:02.810801 run iperf3-srv_10.42.42.10(pid=31296): Terminating (SIGTERM) 21:43:02.851489 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31299): Terminating (SIGTERM) 21:43:02.892006 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31302): Terminating (SIGTERM) 21:43:02.932698 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31305): Terminating (SIGTERM) 21:43:02.973808 --- ParallelTerminationStrategy: PID 31295 died... 21:43:02.993409 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31295): Terminated: ok {rc=0} 21:43:03.038757 --- ParallelTerminationStrategy: PID 31296 died... 21:43:03.057974 run iperf3-srv_10.42.42.10(pid=31296): Terminated {rc=256} 21:43:03.102489 --- ParallelTerminationStrategy: PID 31299 died... 21:43:03.121514 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31299): Terminated: ok {rc=0} 21:43:03.166195 --- ParallelTerminationStrategy: PID 31302 died... 21:43:03.185306 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31302): Terminated: ok {rc=0} 21:43:03.230126 --- ParallelTerminationStrategy: PID 31305 died... 21:43:03.249295 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31305): Terminated: ok {rc=0} 21:43:03.336523 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:nanobts+band-1900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 21:43:04.486788 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:43:04.498332 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:43:04.545175 tst iperf3m4.py: using LAC 31692 21:43:04.667679 tst iperf3m4.py: using RAC 72 21:43:04.799313 tst iperf3m4.py: using CellId 31692 21:43:04.928587 tst iperf3m4.py: using BVCI 31693 21:43:05.050093 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:43:05.061885 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:43:05.073411 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:43:05.085331 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:43:05.097319 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:43:05.108791 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:43:05.120806 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:43:05.132539 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:43:05.144536 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:43:05.264349 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:43:05.387559 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:43:05.507110 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:43:05.629726 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 21:43:05.853973 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:43:06.185948 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31307): Launched 21:43:06.474763 run iperf3-srv_10.42.42.10(pid=31308): Launched 21:43:06.600016 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 21:43:06.824860 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:43:07.157520 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31309): Launched 21:43:07.446705 run iperf3-srv_10.42.42.10(pid=31310): Launched 21:43:07.571028 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 21:43:07.795763 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:43:08.127794 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31311): Launched 21:43:08.414773 run iperf3-srv_10.42.42.10(pid=31312): Launched 21:43:08.539205 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 21:43:08.763455 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:43:09.096497 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31313): Launched 21:43:09.383287 run iperf3-srv_10.42.42.10(pid=31314): Launched 21:43:09.507329 tst iperf3m4.py:8: start network... 21:43:09.732127 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:43:10.245344 run create_hlr_db(pid=31315): Launched 21:43:10.371576 bus /gobi_6: Setting Powered False 21:43:11.437226 run create_hlr_db(pid=31315): Terminated: ok {rc=0} 21:43:11.878510 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31317): Launched 21:43:12.187937 run osmo-hlr_10.42.42.2(pid=31318): Launched 21:43:12.305973 run osmo-stp_10.42.42.5: Starting osmo-stp 21:43:12.853193 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31320): Launched 21:43:13.161749 run osmo-stp_10.42.42.5(pid=31321): Launched 21:43:13.278930 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:43:13.810657 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31323): Launched 21:43:13.928144 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:43:14.188897 run patchelf(pid=31324): Launched 21:43:14.360301 run osmo-stp_10.42.42.5(pid=31321): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31321)] 21:43:14.490455 run osmo-stp_10.42.42.5(pid=31321): stdout: | (launched: 2022-12-12_21:43:13.105319) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:43:14.621842 run osmo-stp_10.42.42.5(pid=31321): stderr: | 20221212214313278 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214313278 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214313278 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214313279 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214313279 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214313279 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214313279 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:43:14.753346 run osmo-stp_10.42.42.5(pid=31321): stdout: | (launched: 2022-12-12_21:43:13.105319) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:43:14.880348 run osmo-stp_10.42.42.5(pid=31321): stderr: | 20221212214313278 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214313278 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214313278 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214313279 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214313279 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214313279 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214313279 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:43:15.029781 run patchelf(pid=31324): Terminating (SIGINT) 21:43:15.203523 run patchelf(pid=31324): Terminated: ok {rc=0} 21:43:15.328492 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31321): Process ended prematurely: osmo-stp_10.42.42.5(pid=31321) [trial-2382↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31321)] [trial-2382↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8] 21:43:15.338057 tst iperf3m4.py:8: Test FAILED (10.9 sec) 21:43:15.365855 run osmo-hlr_10.42.42.2(pid=31318): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31318)] 21:43:15.414622 run osmo-hlr_10.42.42.2(pid=31318): stdout: | (launched: 2022-12-12_21:43:12.131459) 21:43:15.465148 run osmo-hlr_10.42.42.2(pid=31318): stderr: | 20221212214312310 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212214312310 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212214312310 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212214312310 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212214312310 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212214312310 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212214312323 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212214312333 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212214312334 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212214312334 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:43:15.515986 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31307): Terminating (SIGTERM) 21:43:15.556554 run iperf3-srv_10.42.42.10(pid=31308): Terminating (SIGTERM) 21:43:15.597227 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31309): Terminating (SIGTERM) 21:43:15.637978 run iperf3-srv_10.42.42.10(pid=31310): Terminating (SIGTERM) 21:43:15.678336 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31311): Terminating (SIGTERM) 21:43:15.718834 run iperf3-srv_10.42.42.10(pid=31312): Terminating (SIGTERM) 21:43:15.759191 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31313): Terminating (SIGTERM) 21:43:15.799451 run iperf3-srv_10.42.42.10(pid=31314): Terminating (SIGTERM) 21:43:15.841664 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31317): Terminating (SIGTERM) 21:43:15.883952 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31320): Terminating (SIGTERM) 21:43:15.930238 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31323): Terminating (SIGTERM) 21:43:15.971821 --- ParallelTerminationStrategy: PID 31307 died... 21:43:15.991678 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31307): Terminated: ok {rc=0} 21:43:16.037580 --- ParallelTerminationStrategy: PID 31308 died... 21:43:16.057200 run iperf3-srv_10.42.42.10(pid=31308): Terminated {rc=256} 21:43:16.102862 --- ParallelTerminationStrategy: PID 31309 died... 21:43:16.122496 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31309): Terminated: ok {rc=0} 21:43:16.167774 --- ParallelTerminationStrategy: PID 31310 died... 21:43:16.187247 run iperf3-srv_10.42.42.10(pid=31310): Terminated {rc=256} 21:43:16.232841 --- ParallelTerminationStrategy: PID 31311 died... 21:43:16.252370 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31311): Terminated: ok {rc=0} 21:43:16.298159 --- ParallelTerminationStrategy: PID 31312 died... 21:43:16.317373 run iperf3-srv_10.42.42.10(pid=31312): Terminated {rc=256} 21:43:16.363194 --- ParallelTerminationStrategy: PID 31313 died... 21:43:16.382772 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31313): Terminated: ok {rc=0} 21:43:16.428452 --- ParallelTerminationStrategy: PID 31314 died... 21:43:16.448006 run iperf3-srv_10.42.42.10(pid=31314): Terminated {rc=256} 21:43:16.493650 --- ParallelTerminationStrategy: PID 31317 died... 21:43:16.512792 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31317): Terminated: ok {rc=0} 21:43:16.558625 --- ParallelTerminationStrategy: PID 31320 died... 21:43:16.578190 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31320): Terminated: ok {rc=0} 21:43:16.623875 --- ParallelTerminationStrategy: PID 31323 died... 21:43:16.643481 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31323): Terminated: ok {rc=0} 21:43:16.729350 bus /gobi_4: Setting Powered False 21:43:17.826413 bus /gobi_4: Setting Powered False 21:43:18.942563 bus /gobi_1: Setting Powered False 21:43:20.042855 bus /gobi_1: Setting Powered False 21:43:21.156331 bus /gobi_0: Setting Powered False 21:43:22.255791 bus /gobi_0: Setting Powered False 21:43:23.373810 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:nanobts+band-1900+mod-bts0-egprs ping.py ---------------------------------------------- 21:43:24.478445 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:43:24.490479 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:43:24.532902 tst ping.py: using LAC 31693 21:43:24.662956 tst ping.py: using RAC 73 21:43:24.785082 tst ping.py: using CellId 31693 21:43:24.906242 tst ping.py: using BVCI 31694 21:43:25.017688 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:43:25.028787 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:43:25.040000 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:43:25.051185 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:43:25.062522 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:43:25.073685 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:43:25.084895 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:43:25.096016 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:43:25.217181 tst ping.py:19: start network... 21:43:25.419050 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:43:25.886670 run create_hlr_db(pid=31325): Launched 21:43:26.009826 bus /gobi_6: Setting Powered False 21:43:27.071122 run create_hlr_db(pid=31325): Terminated: ok {rc=0} 21:43:27.513093 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31327): Launched 21:43:27.836782 run osmo-hlr_10.42.42.2(pid=31328): Launched 21:43:27.960593 run osmo-stp_10.42.42.5: Starting osmo-stp 21:43:28.486630 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31330): Launched 21:43:28.788418 run osmo-stp_10.42.42.5(pid=31331): Launched 21:43:28.902990 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:43:29.423946 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31333): Launched 21:43:29.539296 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:43:29.794275 run patchelf(pid=31334): Launched 21:43:29.962511 run osmo-stp_10.42.42.5(pid=31331): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31331)] 21:43:30.090595 run osmo-stp_10.42.42.5(pid=31331): stdout: | (launched: 2022-12-12_21:43:28.733175) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:43:30.220334 run osmo-stp_10.42.42.5(pid=31331): stderr: | 20221212214328906 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214328906 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214328906 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214328907 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214328907 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214328907 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214328907 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:43:30.350572 run osmo-stp_10.42.42.5(pid=31331): stdout: | (launched: 2022-12-12_21:43:28.733175) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:43:30.474810 run osmo-stp_10.42.42.5(pid=31331): stderr: | 20221212214328906 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214328906 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214328906 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214328907 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214328907 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214328907 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214328907 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:43:30.621543 run patchelf(pid=31334): Terminating (SIGINT) 21:43:30.791636 run patchelf(pid=31334): Terminated: ok {rc=0} 21:43:30.937847 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=31331): Process ended prematurely: osmo-stp_10.42.42.5(pid=31331) [trial-2382↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31331)] [trial-2382↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22] 21:43:30.947528 tst ping.py:22: Test FAILED (6.5 sec) 21:43:30.976368 run osmo-hlr_10.42.42.2(pid=31328): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31328)] 21:43:31.026524 run osmo-hlr_10.42.42.2(pid=31328): stdout: | (launched: 2022-12-12_21:43:27.778297) 21:43:31.078536 run osmo-hlr_10.42.42.2(pid=31328): stderr: | 20221212214327979 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212214327979 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212214327979 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212214327979 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212214327979 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212214327979 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212214327991 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:nanobts+band-1900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212214327999 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212214327999 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212214327999 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:43:31.130917 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31327): Terminating (SIGTERM) 21:43:31.173288 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31330): Terminating (SIGTERM) 21:43:31.217388 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31333): Terminating (SIGTERM) 21:43:31.262153 --- ParallelTerminationStrategy: PID 31327 died... 21:43:31.290340 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31327): Terminated: ok {rc=0} 21:43:31.359955 --- ParallelTerminationStrategy: PID 31330 died... 21:43:31.388856 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31330): Terminated: ok {rc=0} 21:43:31.449804 --- ParallelTerminationStrategy: PID 31333 died... 21:43:31.477316 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31333): Terminated: ok {rc=0} 21:43:31.594814 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:nanobts+band-1900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 21:43:32.696778 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:43:32.710392 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:43:32.752672 tst ping_idle_ping.py: using LAC 31694 21:43:32.874228 tst ping_idle_ping.py: using RAC 74 21:43:32.996114 tst ping_idle_ping.py: using CellId 31694 21:43:33.116659 tst ping_idle_ping.py: using BVCI 31695 21:43:33.228681 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:43:33.239882 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:43:33.250819 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:43:33.261702 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:43:33.272437 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:43:33.283130 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:43:33.294090 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:43:33.304768 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:43:33.423097 tst ping_idle_ping.py:24: start network... 21:43:33.642492 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:43:34.153619 run create_hlr_db(pid=31336): Launched 21:43:34.279843 bus /gobi_6: Setting Powered False 21:43:35.345738 run create_hlr_db(pid=31336): Terminated: ok {rc=0} 21:43:35.783134 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31338): Launched 21:43:36.086792 run osmo-hlr_10.42.42.2(pid=31339): Launched 21:43:36.202634 run osmo-stp_10.42.42.5: Starting osmo-stp 21:43:36.727205 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31341): Launched 21:43:37.030862 run osmo-stp_10.42.42.5(pid=31342): Launched 21:43:37.146804 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:43:37.670672 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31344): Launched 21:43:37.785933 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:43:38.041329 run patchelf(pid=31345): Launched 21:43:38.209702 run osmo-stp_10.42.42.5(pid=31342): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31342)] 21:43:38.337842 run osmo-stp_10.42.42.5(pid=31342): stdout: | (launched: 2022-12-12_21:43:36.975264) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:43:38.468051 run osmo-stp_10.42.42.5(pid=31342): stderr: | 20221212214337146 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214337146 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214337146 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214337147 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214337147 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214337147 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214337147 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:43:38.598206 run osmo-stp_10.42.42.5(pid=31342): stdout: | (launched: 2022-12-12_21:43:36.975264) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:43:38.723040 run osmo-stp_10.42.42.5(pid=31342): stderr: | 20221212214337146 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214337146 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214337146 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214337147 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214337147 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214337147 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214337147 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:43:38.870279 run patchelf(pid=31345): Terminating (SIGINT) 21:43:39.041630 run patchelf(pid=31345): Terminated: ok {rc=0} 21:43:39.165195 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=31342): Process ended prematurely: osmo-stp_10.42.42.5(pid=31342) [trial-2382↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31342)] [trial-2382↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27] 21:43:39.173809 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 21:43:39.200686 run osmo-hlr_10.42.42.2(pid=31339): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31339)] 21:43:39.248759 run osmo-hlr_10.42.42.2(pid=31339): stdout: | (launched: 2022-12-12_21:43:36.031228) 21:43:39.298788 run osmo-hlr_10.42.42.2(pid=31339): stderr: | 20221212214336208 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212214336208 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212214336208 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212214336208 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212214336208 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212214336208 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212214336225 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:nanobts+band-1900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212214336235 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212214336235 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212214336235 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:43:39.349243 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31338): Terminating (SIGTERM) 21:43:39.389149 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31341): Terminating (SIGTERM) 21:43:39.429098 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31344): Terminating (SIGTERM) 21:43:39.469319 --- ParallelTerminationStrategy: PID 31338 died... 21:43:39.488601 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31338): Terminated: ok {rc=0} 21:43:39.533765 --- ParallelTerminationStrategy: PID 31341 died... 21:43:39.552521 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31341): Terminated: ok {rc=0} 21:43:39.597135 --- ParallelTerminationStrategy: PID 31344 died... 21:43:39.616012 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31344): Terminated: ok {rc=0} 21:43:39.702978 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2382 gprs:nanobts+band-1900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 gprs:nanobts+band-1900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 21:43:40.999801 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:43:41.007499 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 21:43:41.031732 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 21:43:41.069337 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 21:43:41.154917 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 21:43:41.178289 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 21:43:41.215855 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 21:43:41.811872 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2382 gprs:nanobts+band-1900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 21:43:41.860860 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:43:41.871859 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 21:43:41.931140 tst cs_paging_gprs_active.py: using LAC 31695 21:43:42.051788 tst cs_paging_gprs_active.py: using RAC 75 21:43:42.183299 tst cs_paging_gprs_active.py: using CellId 31695 21:43:42.314663 tst cs_paging_gprs_active.py: using BVCI 31696 21:43:42.435585 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:43:42.447305 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:43:42.458910 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:43:42.470847 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:43:42.482784 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:43:42.494721 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:43:42.506749 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:43:42.518479 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:43:42.530470 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:43:42.649182 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:43:42.770637 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 21:43:42.995971 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:43:43.328441 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31350): Launched 21:43:43.614967 run iperf3-srv_10.42.42.10(pid=31351): Launched 21:43:43.739376 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 21:43:43.963222 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:43:44.295227 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31352): Launched 21:43:44.581359 run iperf3-srv_10.42.42.10(pid=31353): Launched 21:43:44.706358 tst cs_paging_gprs_active.py:38: start network... 21:43:44.929765 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:43:45.442807 run create_hlr_db(pid=31354): Launched 21:43:45.568887 bus /gobi_6: Setting Powered False 21:43:46.633365 run create_hlr_db(pid=31354): Terminated: ok {rc=0} 21:43:47.093296 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31356): Launched 21:43:47.407417 run osmo-hlr_10.42.42.2(pid=31357): Launched 21:43:47.526210 run osmo-stp_10.42.42.5: Starting osmo-stp 21:43:48.062418 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31359): Launched 21:43:48.368843 run osmo-stp_10.42.42.5(pid=31360): Launched 21:43:48.485731 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:43:49.017350 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31362): Launched 21:43:49.135562 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:43:49.395997 run patchelf(pid=31363): Launched 21:43:49.567370 run osmo-stp_10.42.42.5(pid=31360): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31360)] 21:43:49.697234 run osmo-stp_10.42.42.5(pid=31360): stdout: | (launched: 2022-12-12_21:43:48.312730) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:43:49.828715 run osmo-stp_10.42.42.5(pid=31360): stderr: | 20221212214348485 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214348485 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214348485 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214348486 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214348486 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214348486 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214348486 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:43:49.959976 run osmo-stp_10.42.42.5(pid=31360): stdout: | (launched: 2022-12-12_21:43:48.312730) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:43:50.086579 run osmo-stp_10.42.42.5(pid=31360): stderr: | 20221212214348485 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214348485 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214348485 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214348486 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214348486 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214348486 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214348486 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:43:50.235377 run patchelf(pid=31363): Terminating (SIGINT) 21:43:50.408532 run patchelf(pid=31363): Terminated: ok {rc=0} 21:43:50.533658 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=31360): Process ended prematurely: osmo-stp_10.42.42.5(pid=31360) [trial-2382↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31360)] [trial-2382↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 21:43:50.542954 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 21:43:50.570311 run osmo-hlr_10.42.42.2(pid=31357): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31357)] 21:43:50.618265 run osmo-hlr_10.42.42.2(pid=31357): stdout: | (launched: 2022-12-12_21:43:47.351024) 21:43:50.667852 run osmo-hlr_10.42.42.2(pid=31357): stderr: | 20221212214347530 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212214347531 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212214347531 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212214347531 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212214347531 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212214347531 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212214347543 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212214347552 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212214347552 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212214347552 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:43:50.718090 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31350): Terminating (SIGTERM) 21:43:50.758708 run iperf3-srv_10.42.42.10(pid=31351): Terminating (SIGTERM) 21:43:50.799180 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31352): Terminating (SIGTERM) 21:43:50.839297 run iperf3-srv_10.42.42.10(pid=31353): Terminating (SIGTERM) 21:43:50.879207 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31356): Terminating (SIGTERM) 21:43:50.919355 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31359): Terminating (SIGTERM) 21:43:50.959149 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31362): Terminating (SIGTERM) 21:43:51.000023 --- ParallelTerminationStrategy: PID 31350 died... 21:43:51.019521 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31350): Terminated: ok {rc=0} 21:43:51.064057 --- ParallelTerminationStrategy: PID 31351 died... 21:43:51.083232 run iperf3-srv_10.42.42.10(pid=31351): Terminated {rc=256} 21:43:51.128045 --- ParallelTerminationStrategy: PID 31352 died... 21:43:51.146990 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31352): Terminated: ok {rc=0} 21:43:51.191962 --- ParallelTerminationStrategy: PID 31353 died... 21:43:51.210765 run iperf3-srv_10.42.42.10(pid=31353): Terminated {rc=256} 21:43:51.255017 --- ParallelTerminationStrategy: PID 31356 died... 21:43:51.273897 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31356): Terminated: ok {rc=0} 21:43:51.317940 --- ParallelTerminationStrategy: PID 31359 died... 21:43:51.336493 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31359): Terminated: ok {rc=0} 21:43:51.380876 --- ParallelTerminationStrategy: PID 31362 died... 21:43:51.400189 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31362): Terminated: ok {rc=0} 21:43:51.484024 bus /gobi_0: Setting Powered False 21:43:52.583549 bus /gobi_0: Setting Powered False 21:43:53.701137 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 21:43:54.852162 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:43:54.864299 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 21:43:54.929130 tst iperf3.py: using LAC 31696 21:43:55.059597 tst iperf3.py: using RAC 76 21:43:55.189367 tst iperf3.py: using CellId 31696 21:43:55.320584 tst iperf3.py: using BVCI 31697 21:43:55.433957 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:43:55.445096 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:43:55.455798 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:43:55.466586 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:43:55.477404 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:43:55.488162 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:43:55.500068 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:43:55.510741 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:43:55.521759 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:43:55.642264 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 21:43:55.865416 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:43:56.194968 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31364): Launched 21:43:56.481035 run iperf3-srv_10.42.42.10(pid=31365): Launched 21:43:56.604642 tst iperf3.py:8: start network... 21:43:56.827775 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:43:57.338492 run create_hlr_db(pid=31366): Launched 21:43:57.464807 bus /gobi_6: Setting Powered False 21:43:58.530346 run create_hlr_db(pid=31366): Terminated: ok {rc=0} 21:43:58.987357 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31368): Launched 21:43:59.316308 run osmo-hlr_10.42.42.2(pid=31369): Launched 21:43:59.442663 run osmo-stp_10.42.42.5: Starting osmo-stp 21:44:00.010612 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31371): Launched 21:44:00.340465 run osmo-stp_10.42.42.5(pid=31372): Launched 21:44:00.466818 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:44:01.056560 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31374): Launched 21:44:01.194654 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:44:01.482648 run patchelf(pid=31375): Launched 21:44:01.678125 run osmo-stp_10.42.42.5(pid=31372): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31372)] 21:44:01.820909 run osmo-stp_10.42.42.5(pid=31372): stdout: | (launched: 2022-12-12_21:44:00.280275) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:44:01.966140 run osmo-stp_10.42.42.5(pid=31372): stderr: | 20221212214400473 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214400473 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214400473 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214400474 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214400474 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214400474 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214400474 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:44:02.111220 run osmo-stp_10.42.42.5(pid=31372): stdout: | (launched: 2022-12-12_21:44:00.280275) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:44:02.249916 run osmo-stp_10.42.42.5(pid=31372): stderr: | 20221212214400473 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214400473 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214400473 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214400474 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214400474 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214400474 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214400474 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:44:02.410725 run patchelf(pid=31375): Terminating (SIGINT) 21:44:02.596550 run patchelf(pid=31375): Terminated: ok {rc=0} 21:44:02.731283 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31372): Process ended prematurely: osmo-stp_10.42.42.5(pid=31372) [trial-2382↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31372)] [trial-2382↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8] 21:44:02.741640 tst iperf3.py:8: Test FAILED (7.9 sec) 21:44:02.771613 run osmo-hlr_10.42.42.2(pid=31369): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31369)] 21:44:02.823195 run osmo-hlr_10.42.42.2(pid=31369): stdout: | (launched: 2022-12-12_21:43:59.256491) 21:44:02.876659 run osmo-hlr_10.42.42.2(pid=31369): stderr: | 20221212214359460 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212214359460 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212214359460 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212214359460 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212214359460 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212214359460 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212214359472 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212214359480 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212214359481 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212214359481 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:44:02.930482 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31364): Terminating (SIGTERM) 21:44:02.973715 run iperf3-srv_10.42.42.10(pid=31365): Terminating (SIGTERM) 21:44:03.016806 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31368): Terminating (SIGTERM) 21:44:03.060202 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31371): Terminating (SIGTERM) 21:44:03.103232 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31374): Terminating (SIGTERM) 21:44:03.146543 --- ParallelTerminationStrategy: PID 31364 died... 21:44:03.167002 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31364): Terminated: ok {rc=0} 21:44:03.215589 --- ParallelTerminationStrategy: PID 31365 died... 21:44:03.235787 run iperf3-srv_10.42.42.10(pid=31365): Terminated {rc=256} 21:44:03.283665 --- ParallelTerminationStrategy: PID 31368 died... 21:44:03.303840 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31368): Terminated: ok {rc=0} 21:44:03.351672 --- ParallelTerminationStrategy: PID 31371 died... 21:44:03.371808 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31371): Terminated: ok {rc=0} 21:44:03.419401 --- ParallelTerminationStrategy: PID 31374 died... 21:44:03.439582 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31374): Terminated: ok {rc=0} 21:44:03.529451 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 21:44:04.678796 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:44:04.690544 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 21:44:04.749116 tst iperf3m4.py: using LAC 31697 21:44:04.869475 tst iperf3m4.py: using RAC 77 21:44:04.990893 tst iperf3m4.py: using CellId 31697 21:44:05.111595 tst iperf3m4.py: using BVCI 31698 21:44:05.225885 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:44:05.236937 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:44:05.247838 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:44:05.258666 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:44:05.269449 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:44:05.280267 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:44:05.291276 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:44:05.302040 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:44:05.313118 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:44:05.427841 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:44:05.551812 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:44:05.672019 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:44:05.792562 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 21:44:06.000896 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:44:06.309683 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31376): Launched 21:44:06.578512 run iperf3-srv_10.42.42.10(pid=31377): Launched 21:44:06.693982 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 21:44:06.900327 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:44:07.209904 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31378): Launched 21:44:07.478653 run iperf3-srv_10.42.42.10(pid=31379): Launched 21:44:07.594935 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 21:44:07.800923 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:44:08.109207 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31380): Launched 21:44:08.376582 run iperf3-srv_10.42.42.10(pid=31381): Launched 21:44:08.492084 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 21:44:08.698360 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:44:09.007124 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31382): Launched 21:44:09.274631 run iperf3-srv_10.42.42.10(pid=31383): Launched 21:44:09.390045 tst iperf3m4.py:8: start network... 21:44:09.595741 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:44:10.071734 run create_hlr_db(pid=31384): Launched 21:44:10.197251 bus /gobi_6: Setting Powered False 21:44:11.259307 run create_hlr_db(pid=31384): Terminated: ok {rc=0} 21:44:11.710302 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31386): Launched 21:44:12.041432 run osmo-hlr_10.42.42.2(pid=31387): Launched 21:44:12.169182 run osmo-stp_10.42.42.5: Starting osmo-stp 21:44:12.739619 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31389): Launched 21:44:13.068220 run osmo-stp_10.42.42.5(pid=31390): Launched 21:44:13.193890 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:44:13.761953 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31392): Launched 21:44:13.888205 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:44:14.167402 run patchelf(pid=31393): Launched 21:44:14.350965 run osmo-stp_10.42.42.5(pid=31390): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31390)] 21:44:14.490260 run osmo-stp_10.42.42.5(pid=31390): stdout: | (launched: 2022-12-12_21:44:13.008056) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:44:14.631671 run osmo-stp_10.42.42.5(pid=31390): stderr: | 20221212214413204 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214413204 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214413204 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214413204 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214413205 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214413205 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214413205 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:44:14.772330 run osmo-stp_10.42.42.5(pid=31390): stdout: | (launched: 2022-12-12_21:44:13.008056) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:44:14.907888 run osmo-stp_10.42.42.5(pid=31390): stderr: | 20221212214413204 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214413204 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214413204 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214413204 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214413205 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214413205 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214413205 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:44:15.068318 run patchelf(pid=31393): Terminating (SIGINT) 21:44:15.253645 run patchelf(pid=31393): Terminated: ok {rc=0} 21:44:15.387502 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31390): Process ended prematurely: osmo-stp_10.42.42.5(pid=31390) [trial-2382↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31390)] [trial-2382↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 21:44:15.397836 tst iperf3m4.py:8: Test FAILED (10.8 sec) 21:44:15.427618 run osmo-hlr_10.42.42.2(pid=31387): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31387)] 21:44:15.478637 run osmo-hlr_10.42.42.2(pid=31387): stdout: | (launched: 2022-12-12_21:44:11.981395) 21:44:15.531260 run osmo-hlr_10.42.42.2(pid=31387): stderr: | 20221212214412180 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212214412180 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212214412180 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212214412180 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212214412180 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212214412180 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212214412192 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212214412200 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212214412200 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212214412201 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:44:15.584314 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31376): Terminating (SIGTERM) 21:44:15.627229 run iperf3-srv_10.42.42.10(pid=31377): Terminating (SIGTERM) 21:44:15.670245 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31378): Terminating (SIGTERM) 21:44:15.713213 run iperf3-srv_10.42.42.10(pid=31379): Terminating (SIGTERM) 21:44:15.755871 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31380): Terminating (SIGTERM) 21:44:15.798567 run iperf3-srv_10.42.42.10(pid=31381): Terminating (SIGTERM) 21:44:15.842940 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31382): Terminating (SIGTERM) 21:44:15.889387 run iperf3-srv_10.42.42.10(pid=31383): Terminating (SIGTERM) 21:44:15.942846 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31386): Terminating (SIGTERM) 21:44:15.986568 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31389): Terminating (SIGTERM) 21:44:16.029732 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31392): Terminating (SIGTERM) 21:44:16.073645 --- ParallelTerminationStrategy: PID 31376 died... 21:44:16.094198 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31376): Terminated: ok {rc=0} 21:44:16.142731 --- ParallelTerminationStrategy: PID 31377 died... 21:44:16.163126 run iperf3-srv_10.42.42.10(pid=31377): Terminated {rc=256} 21:44:16.211297 --- ParallelTerminationStrategy: PID 31378 died... 21:44:16.231997 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31378): Terminated: ok {rc=0} 21:44:16.280617 --- ParallelTerminationStrategy: PID 31379 died... 21:44:16.301199 run iperf3-srv_10.42.42.10(pid=31379): Terminated {rc=256} 21:44:16.349594 --- ParallelTerminationStrategy: PID 31380 died... 21:44:16.370159 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31380): Terminated: ok {rc=0} 21:44:16.423606 --- ParallelTerminationStrategy: PID 31381 died... 21:44:16.448338 run iperf3-srv_10.42.42.10(pid=31381): Terminated {rc=256} 21:44:16.507080 --- ParallelTerminationStrategy: PID 31382 died... 21:44:16.532318 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31382): Terminated: ok {rc=0} 21:44:16.584041 --- ParallelTerminationStrategy: PID 31383 died... 21:44:16.603893 run iperf3-srv_10.42.42.10(pid=31383): Terminated {rc=256} 21:44:16.652865 --- ParallelTerminationStrategy: PID 31386 died... 21:44:16.673642 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31386): Terminated: ok {rc=0} 21:44:16.721733 --- ParallelTerminationStrategy: PID 31389 died... 21:44:16.741988 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31389): Terminated: ok {rc=0} 21:44:16.790524 --- ParallelTerminationStrategy: PID 31392 died... 21:44:16.810965 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31392): Terminated: ok {rc=0} 21:44:16.902272 bus /gobi_4: Setting Powered False 21:44:18.003739 bus /gobi_4: Setting Powered False 21:44:19.122641 bus /gobi_1: Setting Powered False 21:44:20.223464 bus /gobi_1: Setting Powered False 21:44:21.342371 bus /gobi_0: Setting Powered False 21:44:22.444054 bus /gobi_0: Setting Powered False 21:44:23.563850 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 21:44:24.668910 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:44:24.681321 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 21:44:24.743794 tst ping.py: using LAC 31698 21:44:24.871942 tst ping.py: using RAC 78 21:44:24.998495 tst ping.py: using CellId 31698 21:44:25.125629 tst ping.py: using BVCI 31699 21:44:25.237238 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:44:25.248263 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:44:25.259188 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:44:25.270049 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:44:25.280895 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:44:25.291784 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:44:25.302777 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:44:25.313693 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:44:25.431334 tst ping.py:19: start network... 21:44:25.632747 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:44:26.101630 run create_hlr_db(pid=31395): Launched 21:44:26.224677 bus /gobi_6: Setting Powered False 21:44:27.286034 run create_hlr_db(pid=31395): Terminated: ok {rc=0} 21:44:27.730651 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31397): Launched 21:44:28.056362 run osmo-hlr_10.42.42.2(pid=31398): Launched 21:44:28.181162 run osmo-stp_10.42.42.5: Starting osmo-stp 21:44:28.752458 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31400): Launched 21:44:29.076151 run osmo-stp_10.42.42.5(pid=31401): Launched 21:44:29.200206 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:44:29.761157 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31403): Launched 21:44:29.884432 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:44:30.157509 run patchelf(pid=31404): Launched 21:44:30.338379 run osmo-stp_10.42.42.5(pid=31401): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31401)] 21:44:30.475666 run osmo-stp_10.42.42.5(pid=31401): stdout: | (launched: 2022-12-12_21:44:29.017309) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:44:30.615172 run osmo-stp_10.42.42.5(pid=31401): stderr: | 20221212214429211 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214429211 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214429211 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214429212 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214429212 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214429212 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214429212 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:44:30.755291 run osmo-stp_10.42.42.5(pid=31401): stdout: | (launched: 2022-12-12_21:44:29.017309) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:44:30.912435 run osmo-stp_10.42.42.5(pid=31401): stderr: | 20221212214429211 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214429211 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214429211 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214429212 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214429212 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214429212 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214429212 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:44:31.075304 run patchelf(pid=31404): Terminating (SIGINT) 21:44:31.255223 run patchelf(pid=31404): Terminated: ok {rc=0} 21:44:31.390389 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=31401): Process ended prematurely: osmo-stp_10.42.42.5(pid=31401) [trial-2382↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31401)] [trial-2382↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22] 21:44:31.399979 tst ping.py:22: Test FAILED (6.7 sec) 21:44:31.429327 run osmo-hlr_10.42.42.2(pid=31398): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31398)] 21:44:31.479544 run osmo-hlr_10.42.42.2(pid=31398): stdout: | (launched: 2022-12-12_21:44:27.997445) 21:44:31.532693 run osmo-hlr_10.42.42.2(pid=31398): stderr: | 20221212214428199 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212214428199 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212214428199 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212214428199 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212214428199 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212214428199 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212214428210 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212214428218 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212214428219 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212214428219 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:44:31.584591 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31397): Terminating (SIGTERM) 21:44:31.626969 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31400): Terminating (SIGTERM) 21:44:31.671158 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31403): Terminating (SIGTERM) 21:44:31.719066 --- ParallelTerminationStrategy: PID 31397 died... 21:44:31.739985 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31397): Terminated: ok {rc=0} 21:44:31.789991 --- ParallelTerminationStrategy: PID 31400 died... 21:44:31.810915 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31400): Terminated: ok {rc=0} 21:44:31.860425 --- ParallelTerminationStrategy: PID 31403 died... 21:44:31.881138 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31403): Terminated: ok {rc=0} 21:44:31.986890 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 21:44:33.081431 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:44:33.093765 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 21:44:33.156838 tst ping_idle_ping.py: using LAC 31699 21:44:33.284207 tst ping_idle_ping.py: using RAC 79 21:44:33.412609 tst ping_idle_ping.py: using CellId 31699 21:44:33.540064 tst ping_idle_ping.py: using BVCI 31700 21:44:33.658602 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:44:33.670156 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:44:33.681480 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:44:33.693298 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:44:33.704712 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:44:33.716258 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:44:33.727979 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:44:33.739663 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:44:33.859363 tst ping_idle_ping.py:24: start network... 21:44:34.077464 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:44:34.578629 run create_hlr_db(pid=31406): Launched 21:44:34.702084 bus /gobi_6: Setting Powered False 21:44:35.762702 run create_hlr_db(pid=31406): Terminated: ok {rc=0} 21:44:36.185457 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31408): Launched 21:44:36.490115 run osmo-hlr_10.42.42.2(pid=31409): Launched 21:44:36.605237 run osmo-stp_10.42.42.5: Starting osmo-stp 21:44:37.146214 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31411): Launched 21:44:37.447498 run osmo-stp_10.42.42.5(pid=31412): Launched 21:44:37.564099 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:44:38.084659 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31414): Launched 21:44:38.199993 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:44:38.455024 run patchelf(pid=31415): Launched 21:44:38.622547 run osmo-stp_10.42.42.5(pid=31412): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31412)] 21:44:38.750126 run osmo-stp_10.42.42.5(pid=31412): stdout: | (launched: 2022-12-12_21:44:37.392223) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:44:38.879163 run osmo-stp_10.42.42.5(pid=31412): stderr: | 20221212214437565 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214437565 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214437565 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214437566 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214437566 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214437566 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214437566 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:44:39.008237 run osmo-stp_10.42.42.5(pid=31412): stdout: | (launched: 2022-12-12_21:44:37.392223) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:44:39.131779 run osmo-stp_10.42.42.5(pid=31412): stderr: | 20221212214437565 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214437565 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214437565 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214437566 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214437566 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214437566 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214437566 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:44:39.278247 run patchelf(pid=31415): Terminating (SIGINT) 21:44:39.447745 run patchelf(pid=31415): Terminated: ok {rc=0} 21:44:39.570958 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=31412): Process ended prematurely: osmo-stp_10.42.42.5(pid=31412) [trial-2382↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31412)] [trial-2382↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 21:44:39.579655 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 21:44:39.606800 run osmo-hlr_10.42.42.2(pid=31409): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31409)] 21:44:39.655067 run osmo-hlr_10.42.42.2(pid=31409): stdout: | (launched: 2022-12-12_21:44:36.434485) 21:44:39.705066 run osmo-hlr_10.42.42.2(pid=31409): stderr: | 20221212214436613 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212214436613 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212214436613 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212214436613 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212214436613 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212214436613 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212214436626 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212214436635 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212214436635 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212214436635 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:44:39.755304 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31408): Terminating (SIGTERM) 21:44:39.795776 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31411): Terminating (SIGTERM) 21:44:39.836127 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31414): Terminating (SIGTERM) 21:44:39.876638 --- ParallelTerminationStrategy: PID 31408 died... 21:44:39.896180 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31408): Terminated: ok {rc=0} 21:44:39.940935 --- ParallelTerminationStrategy: PID 31411 died... 21:44:39.959874 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31411): Terminated: ok {rc=0} 21:44:40.004474 --- ParallelTerminationStrategy: PID 31414 died... 21:44:40.023399 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31414): Terminated: ok {rc=0} 21:44:40.107761 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2382 gprs:nanobts+band-1900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 21:44:41.406382 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:44:41.415162 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 21:44:41.440699 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 21:44:41.477317 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 21:44:41.531830 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 21:44:41.556117 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 21:44:41.592396 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 21:44:42.150976 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2382 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 21:44:42.156070 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:44:42.167656 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 21:44:42.228664 tst switch_tch_pdch.py: using LAC 31700 21:44:42.354755 tst switch_tch_pdch.py: using RAC 80 21:44:42.474586 tst switch_tch_pdch.py: using CellId 31700 21:44:42.593667 tst switch_tch_pdch.py: using BVCI 31701 21:44:42.703329 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:44:42.714844 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:44:42.726278 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:44:42.737611 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:44:42.748844 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:44:42.760101 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:44:42.771584 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:44:42.782916 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:44:42.898887 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:44:43.019948 tst switch_tch_pdch.py:51: start network... 21:44:43.231282 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:44:43.699335 run create_hlr_db(pid=31419): Launched 21:44:43.822418 bus /gobi_6: Setting Powered False 21:44:44.882854 run create_hlr_db(pid=31419): Terminated: ok {rc=0} 21:44:45.305062 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31421): Launched 21:44:45.608308 run osmo-hlr_10.42.42.2(pid=31422): Launched 21:44:45.725926 run osmo-stp_10.42.42.5: Starting osmo-stp 21:44:46.318975 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31424): Launched 21:44:46.665721 run osmo-stp_10.42.42.5(pid=31425): Launched 21:44:46.923525 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:44:47.533821 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31427): Launched 21:44:47.658644 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:44:47.933317 run patchelf(pid=31428): Launched 21:44:48.113535 run osmo-stp_10.42.42.5(pid=31425): ERR: Terminated: ERROR {rc=1} [trial-2382↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31425)] 21:44:48.251001 run osmo-stp_10.42.42.5(pid=31425): stdout: | (launched: 2022-12-12_21:44:46.601953) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:44:48.390185 run osmo-stp_10.42.42.5(pid=31425): stderr: | 20221212214446891 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214446891 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214446891 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214446892 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214446892 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214446892 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214446892 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:44:48.529141 run osmo-stp_10.42.42.5(pid=31425): stdout: | (launched: 2022-12-12_21:44:46.601953) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:44:48.662711 run osmo-stp_10.42.42.5(pid=31425): stderr: | 20221212214446891 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214446891 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214446891 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214446892 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214446892 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214446892 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214446892 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:44:48.820775 run patchelf(pid=31428): Terminating (SIGINT) 21:44:49.003051 run patchelf(pid=31428): Terminated: ok {rc=0} 21:44:49.134189 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=31425): Process ended prematurely: osmo-stp_10.42.42.5(pid=31425) [trial-2382↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31425)] [trial-2382↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 21:44:49.143809 tst switch_tch_pdch.py:54: Test FAILED (7.0 sec) 21:44:49.172931 run osmo-hlr_10.42.42.2(pid=31422): ERR: Terminated: ERROR {rc=237} [trial-2382↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31422)] 21:44:49.224343 run osmo-hlr_10.42.42.2(pid=31422): stdout: | (launched: 2022-12-12_21:44:45.552825) 21:44:49.276919 run osmo-hlr_10.42.42.2(pid=31422): stderr: | 20221212214445733 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212214445733 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212214445733 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212214445733 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212214445733 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212214445733 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212214445745 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212214445754 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212214445754 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212214445755 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:44:49.330267 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31421): Terminating (SIGTERM) 21:44:49.373005 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31424): Terminating (SIGTERM) 21:44:49.415523 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31427): Terminating (SIGTERM) 21:44:49.458302 --- ParallelTerminationStrategy: PID 31421 died... 21:44:49.478597 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31421): Terminated: ok {rc=0} 21:44:49.525690 --- ParallelTerminationStrategy: PID 31424 died... 21:44:49.545384 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31424): Terminated: ok {rc=0} 21:44:49.592754 --- ParallelTerminationStrategy: PID 31427 died... 21:44:49.612569 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31427): Terminated: ok {rc=0} 21:44:49.701947 bus /gobi_0: Setting Powered False 21:44:50.801832 bus /gobi_0: Setting Powered False 21:44:51.917421 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2382 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 sms:nanobts+band-900 --------------------------------------------------------------------- 21:44:53.164310 tst sms:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:44:53.169012 tst sms:nanobts+band-900: Verifying 1 x bts (candidates: 11) 21:44:53.200800 tst sms:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 21:44:53.227187 tst sms:nanobts+band-900: Verifying 2 x modem (candidates: 12) 21:44:53.279147 tst sms:nanobts+band-900: Reserving 1 x bts (candidates: 11) 21:44:53.311551 tst sms:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 21:44:53.338011 tst sms:nanobts+band-900: Reserving 2 x modem (candidates: 12) 21:44:53.882642 tst sms:nanobts+band-900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 sms:nanobts+band-900 mo_mt_sms.py ---------------------------------------------- 21:44:53.887516 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 21:44:53.898435 tst sms:nanobts+band-900: Using 1 x bts (candidates: 1) 21:44:53.943842 tst mo_mt_sms.py: using LAC 31701 21:44:54.063051 tst mo_mt_sms.py: using RAC 81 21:44:54.182767 tst mo_mt_sms.py: using CellId 31701 21:44:54.306521 tst mo_mt_sms.py: using BVCI 31702 21:44:54.418328 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 21:44:54.428923 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 21:44:54.439450 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 21:44:54.449951 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 21:44:54.460368 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 21:44:54.470851 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 21:44:54.585800 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 21:44:54.706634 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:44:55.209128 run create_hlr_db(pid=31433): Launched 21:44:55.332899 bus /gobi_6: Setting Powered False 21:44:56.396810 run create_hlr_db(pid=31433): Terminated: ok {rc=0} 21:44:56.848114 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31435): Launched 21:44:57.171379 run osmo-hlr_10.42.42.2(pid=31436): Launched 21:44:57.295160 run osmo-stp_10.42.42.5: Starting osmo-stp 21:44:57.855506 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31438): Launched 21:44:58.178774 run osmo-stp_10.42.42.5(pid=31439): Launched 21:44:58.302494 run osmo-msc_10.42.42.6: Starting osmo-msc 21:44:58.888520 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31441): Launched 21:44:59.212663 run osmo-msc_10.42.42.6(pid=31442): Launched 21:44:59.395294 run osmo-stp_10.42.42.5(pid=31439): ERR: Terminated: ERROR {rc=1} [trial-2382↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31439)] 21:44:59.533916 run osmo-stp_10.42.42.5(pid=31439): stdout: | (launched: 2022-12-12_21:44:58.119925) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:44:59.672931 run osmo-stp_10.42.42.5(pid=31439): stderr: | 20221212214458311 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214458311 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214458312 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214458312 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214458312 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214458313 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214458313 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:44:59.810866 run osmo-stp_10.42.42.5(pid=31439): stdout: | (launched: 2022-12-12_21:44:58.119925) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:44:59.940341 run osmo-stp_10.42.42.5(pid=31439): stderr: | 20221212214458311 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214458311 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214458312 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214458312 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214458312 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214458313 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214458313 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:45:00.095675 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=31439): Process ended prematurely: osmo-stp_10.42.42.5(pid=31439) [trial-2382↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31439)] [trial-2382↪sms:nanobts+band-900↪mo_mt_sms.py:16] 21:45:00.104612 tst mo_mt_sms.py:16: Test FAILED (6.2 sec) 21:45:00.133071 run osmo-hlr_10.42.42.2(pid=31436): ERR: Terminated: ERROR {rc=237} [trial-2382↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31436)] 21:45:00.183963 run osmo-hlr_10.42.42.2(pid=31436): stdout: | (launched: 2022-12-12_21:44:57.112517) 21:45:00.236692 run osmo-hlr_10.42.42.2(pid=31436): stderr: | 20221212214457310 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212214457310 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212214457310 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212214457310 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212214457310 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212214457310 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212214457323 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/sms:nanobts+band-900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212214457331 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212214457331 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212214457332 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:45:00.310049 run osmo-msc_10.42.42.6(pid=31442): ERR: Terminated: ERROR {rc=2} [trial-2382↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31442)] 21:45:00.361300 run osmo-msc_10.42.42.6(pid=31442): stdout: | (launched: 2022-12-12_21:44:59.153949) 21:45:00.414038 run osmo-msc_10.42.42.6(pid=31442): stderr: | 20221212214459478 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212214459478 DLGLOBAL DEBUG validating counter group 0x7fe04a1f6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212214459479 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212214459479 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212214459479 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212214459479 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212214459481 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212214459481 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212214459481 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212214459481 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:45:00.467287 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31435): Terminating (SIGTERM) 21:45:00.509803 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31438): Terminating (SIGTERM) 21:45:00.552274 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31441): Terminating (SIGTERM) 21:45:00.595356 --- ParallelTerminationStrategy: PID 31435 died... 21:45:00.615645 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31435): Terminated: ok {rc=0} 21:45:00.663362 --- ParallelTerminationStrategy: PID 31438 died... 21:45:00.683233 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31438): Terminated: ok {rc=0} 21:45:00.730502 --- ParallelTerminationStrategy: PID 31441 died... 21:45:00.750411 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31441): Terminated: ok {rc=0} 21:45:00.854800 bus /sierra_3: Setting Powered False 21:45:01.978919 bus /sierra_3: Setting Powered False 21:45:03.100472 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 sms:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 nitb_ussd:nanobts+band-900 --------------------------------------------------------------------- 21:45:04.343459 tst nitb_ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:45:04.349874 tst nitb_ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 21:45:04.384481 tst nitb_ussd:nanobts+band-900: Verifying 1 x ip_address (candidates: 9) 21:45:04.391472 tst nitb_ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 21:45:04.425371 tst nitb_ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 21:45:04.458611 tst nitb_ussd:nanobts+band-900: Reserving 1 x ip_address (candidates: 9) 21:45:04.465648 tst nitb_ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 21:45:04.987067 tst nitb_ussd:nanobts+band-900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2382 nitb_ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 21:45:04.992236 tst nitb_ussd:nanobts+band-900: Using 1 x ip_address (candidates: 1) 21:45:05.003509 tst nitb_ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 21:45:05.050652 tst assert_extension.py: using LAC 31702 21:45:05.181068 tst assert_extension.py: using RAC 82 21:45:05.307874 tst assert_extension.py: using CellId 31702 21:45:05.427644 tst assert_extension.py: using BVCI 31703 21:45:05.538626 tst nitb_ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 21:45:05.655583 tst assert_extension.py:10: start nitb and bts... 21:45:05.874388 run osmo-nitb_10.42.42.2: Starting osmo-nitb 21:45:06.532265 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=31450): Launched 21:45:06.856031 run osmo-nitb_10.42.42.2(pid=31451): Launched 21:45:07.035195 run osmo-nitb_10.42.42.2(pid=31451): ERR: Terminated: ERROR {rc=2} [trial-2382↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31451)] 21:45:07.180498 run osmo-nitb_10.42.42.2(pid=31451): stdout: | (launched: 2022-12-12_21:45:06.797526) 21:45:07.327239 run osmo-nitb_10.42.42.2(pid=31451): stderr: | (launched: 2022-12-12_21:45:06.845724) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 21:45:07.473892 run osmo-nitb_10.42.42.2(pid=31451): stdout: | (launched: 2022-12-12_21:45:06.797526) 21:45:07.614915 run osmo-nitb_10.42.42.2(pid=31451): stderr: | (launched: 2022-12-12_21:45:06.845724) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7ff6b86c2268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=31451): Process ended prematurely: osmo-nitb_10.42.42.2(pid=31451) [trial-2382↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31451)] 21:45:07.977790 tst osmo-nitb_10.42.42.2(pid=31451): stdout: | (launched: 2022-12-12_21:45:06.797526) 21:45:08.108799 tst osmo-nitb_10.42.42.2(pid=31451): stderr: | (launched: 2022-12-12_21:45:06.845724) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 21:45:08.263857 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=31451): Process ended prematurely: osmo-nitb_10.42.42.2(pid=31451) [trial-2382↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31451)] [trial-2382↪nitb_ussd:nanobts+band-900↪assert_extension.py:12] 21:45:08.272914 tst assert_extension.py:12: Test FAILED (3.3 sec) 21:45:08.279932 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=31450): Terminating (SIGTERM) 21:45:08.492007 --- ParallelTerminationStrategy: PID 31450 died... 21:45:08.513772 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=31450): Terminated: ok {rc=0} 21:45:08.602823 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 nitb_ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 ussd:nanobts+band-900 --------------------------------------------------------------------- 21:45:09.777554 tst ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:45:09.782418 tst ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 21:45:09.814485 tst ussd:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 21:45:09.840876 tst ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 21:45:09.876664 tst ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 21:45:09.910536 tst ussd:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 21:45:09.937788 tst ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 21:45:10.465267 tst ussd:nanobts+band-900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2382 ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 21:45:10.470342 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 21:45:10.481236 tst ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 21:45:10.527541 tst assert_extension.py: using LAC 31703 21:45:10.649110 tst assert_extension.py: using RAC 83 21:45:10.767787 tst assert_extension.py: using CellId 31703 21:45:10.886069 tst assert_extension.py: using BVCI 31704 21:45:11.005386 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 21:45:11.016505 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 21:45:11.027552 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 21:45:11.038820 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 21:45:11.050264 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 21:45:11.061573 tst ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 21:45:11.180144 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:45:11.682233 run create_hlr_db(pid=31455): Launched 21:45:11.805763 bus /sierra_2: Setting Powered False 21:45:12.869888 run create_hlr_db(pid=31455): Terminated: ok {rc=0} 21:45:13.301062 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31457): Launched 21:45:13.603935 run osmo-hlr_10.42.42.2(pid=31458): Launched 21:45:13.719426 run osmo-stp_10.42.42.5: Starting osmo-stp 21:45:14.242702 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31460): Launched 21:45:14.544679 run osmo-stp_10.42.42.5(pid=31461): Launched 21:45:14.660096 run osmo-msc_10.42.42.6: Starting osmo-msc 21:45:15.204583 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31463): Launched 21:45:15.506527 run osmo-msc_10.42.42.6(pid=31464): Launched 21:45:15.675400 run osmo-stp_10.42.42.5(pid=31461): ERR: Terminated: ERROR {rc=1} [trial-2382↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31461)] 21:45:15.803816 run osmo-stp_10.42.42.5(pid=31461): stdout: | (launched: 2022-12-12_21:45:14.489085) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:45:15.976073 run osmo-stp_10.42.42.5(pid=31461): stderr: | 20221212214514661 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214514661 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214514661 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214514662 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214514662 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214514663 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214514663 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:45:16.105142 run osmo-stp_10.42.42.5(pid=31461): stdout: | (launched: 2022-12-12_21:45:14.489085) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:45:16.226600 run osmo-stp_10.42.42.5(pid=31461): stderr: | 20221212214514661 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214514661 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214514661 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214514662 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214514662 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214514663 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214514663 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:45:16.375358 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=31461): Process ended prematurely: osmo-stp_10.42.42.5(pid=31461) [trial-2382↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31461)] [trial-2382↪ussd:nanobts+band-900↪assert_extension.py:17] 21:45:16.384280 tst assert_extension.py:17: Test FAILED (5.9 sec) 21:45:16.411654 run osmo-hlr_10.42.42.2(pid=31458): ERR: Terminated: ERROR {rc=237} [trial-2382↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31458)] 21:45:16.461366 run osmo-hlr_10.42.42.2(pid=31458): stdout: | (launched: 2022-12-12_21:45:13.548337) 21:45:16.512421 run osmo-hlr_10.42.42.2(pid=31458): stderr: | 20221212214513727 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212214513727 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212214513727 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212214513727 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212214513727 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212214513727 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212214513739 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/ussd:nanobts+band-900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212214513748 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212214513748 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212214513748 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:45:16.583907 run osmo-msc_10.42.42.6(pid=31464): ERR: Terminated: ERROR {rc=2} [trial-2382↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31464)] 21:45:16.633677 run osmo-msc_10.42.42.6(pid=31464): stdout: | (launched: 2022-12-12_21:45:15.451176) 21:45:16.684472 run osmo-msc_10.42.42.6(pid=31464): stderr: | 20221212214515726 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212214515726 DLGLOBAL DEBUG validating counter group 0x7f8c0eeb5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212214515727 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212214515727 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212214515727 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212214515727 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212214515730 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212214515730 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212214515730 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212214515730 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:45:16.735672 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31457): Terminating (SIGTERM) 21:45:16.777123 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31460): Terminating (SIGTERM) 21:45:16.818255 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31463): Terminating (SIGTERM) 21:45:16.859636 --- ParallelTerminationStrategy: PID 31457 died... 21:45:16.879444 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31457): Terminated: ok {rc=0} 21:45:16.925262 --- ParallelTerminationStrategy: PID 31460 died... 21:45:16.944763 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31460): Terminated: ok {rc=0} 21:45:16.990466 --- ParallelTerminationStrategy: PID 31463 died... 21:45:17.009941 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31463): Terminated: ok {rc=0} 21:45:17.095819 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 21:45:18.302325 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:45:18.309685 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 21:45:18.341758 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 21:45:18.368266 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 21:45:18.419815 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 21:45:18.451822 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 21:45:18.478235 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 21:45:19.029209 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 21:45:19.079162 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:45:19.090583 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 21:45:19.157111 tst mo_mt_call.py: using LAC 31704 21:45:19.278671 tst mo_mt_call.py: using RAC 84 21:45:19.401803 tst mo_mt_call.py: using CellId 31704 21:45:19.522815 tst mo_mt_call.py: using BVCI 31705 21:45:19.636771 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:45:19.648002 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:45:19.659000 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:45:19.670127 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:45:19.681477 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:45:19.692337 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 21:45:19.813756 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 21:45:19.933279 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:45:20.409586 run create_hlr_db(pid=31469): Launched 21:45:20.536552 bus /sierra_2: Setting Powered False 21:45:21.598901 run create_hlr_db(pid=31469): Terminated: ok {rc=0} 21:45:22.049137 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31471): Launched 21:45:22.378856 run osmo-hlr_10.42.42.2(pid=31472): Launched 21:45:22.504582 run osmo-stp_10.42.42.5: Starting osmo-stp 21:45:23.074017 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31474): Launched 21:45:23.403197 run osmo-stp_10.42.42.5(pid=31475): Launched 21:45:23.528749 run osmo-msc_10.42.42.6: Starting osmo-msc 21:45:24.125497 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31477): Launched 21:45:24.456272 run osmo-msc_10.42.42.6(pid=31478): Launched 21:45:24.641276 run osmo-stp_10.42.42.5(pid=31475): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31475)] 21:45:24.781911 run osmo-stp_10.42.42.5(pid=31475): stdout: | (launched: 2022-12-12_21:45:23.343469) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:45:24.922297 run osmo-stp_10.42.42.5(pid=31475): stderr: | 20221212214523537 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214523537 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214523537 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214523538 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214523540 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214523540 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214523540 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:45:25.060115 run osmo-stp_10.42.42.5(pid=31475): stdout: | (launched: 2022-12-12_21:45:23.343469) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:45:25.191837 run osmo-stp_10.42.42.5(pid=31475): stderr: | 20221212214523537 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214523537 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214523537 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214523538 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214523540 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214523540 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214523540 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:45:25.349412 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31475): Process ended prematurely: osmo-stp_10.42.42.5(pid=31475) [trial-2382↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31475)] [trial-2382↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 21:45:25.359004 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 21:45:25.387750 run osmo-hlr_10.42.42.2(pid=31472): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31472)] 21:45:25.438942 run osmo-hlr_10.42.42.2(pid=31472): stdout: | (launched: 2022-12-12_21:45:22.319305) 21:45:25.491741 run osmo-hlr_10.42.42.2(pid=31472): stderr: | 20221212214522518 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212214522518 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212214522518 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212214522519 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212214522519 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212214522519 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212214522531 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212214522540 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212214522540 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212214522540 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:45:25.565699 run osmo-msc_10.42.42.6(pid=31478): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31478)] 21:45:25.616880 run osmo-msc_10.42.42.6(pid=31478): stdout: | (launched: 2022-12-12_21:45:24.396209) 21:45:25.669848 run osmo-msc_10.42.42.6(pid=31478): stderr: | 20221212214524720 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212214524720 DLGLOBAL DEBUG validating counter group 0x7f2d4d9a9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212214524720 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212214524720 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212214524720 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212214524721 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212214524722 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212214524723 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212214524723 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212214524723 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:45:25.723107 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31471): Terminating (SIGTERM) 21:45:25.765577 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31474): Terminating (SIGTERM) 21:45:25.807663 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31477): Terminating (SIGTERM) 21:45:25.851236 --- ParallelTerminationStrategy: PID 31471 died... 21:45:25.871590 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31471): Terminated: ok {rc=0} 21:45:25.919035 --- ParallelTerminationStrategy: PID 31474 died... 21:45:25.938871 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31474): Terminated: ok {rc=0} 21:45:25.985917 --- ParallelTerminationStrategy: PID 31477 died... 21:45:26.005673 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31477): Terminated: ok {rc=0} 21:45:26.095518 bus /sierra_3: Setting Powered False 21:45:27.195198 bus /sierra_3: Setting Powered False 21:45:28.312689 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2382 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 21:45:29.462843 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:45:29.475131 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 21:45:29.543369 tst mo_mt_call_osmux.py: using LAC 31705 21:45:29.673169 tst mo_mt_call_osmux.py: using RAC 85 21:45:29.797553 tst mo_mt_call_osmux.py: using CellId 31705 21:45:29.920901 tst mo_mt_call_osmux.py: using BVCI 31706 21:45:30.034932 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:45:30.046187 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:45:30.057219 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:45:30.068216 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:45:30.079233 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:45:30.090265 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 21:45:30.210405 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 21:45:30.328285 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:45:30.855558 run create_hlr_db(pid=31480): Launched 21:45:31.019217 bus /sierra_2: Setting Powered False 21:45:32.100059 run create_hlr_db(pid=31480): Terminated: ok {rc=0} 21:45:32.573443 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31482): Launched 21:45:32.905015 run osmo-hlr_10.42.42.2(pid=31483): Launched 21:45:33.031041 run osmo-stp_10.42.42.5: Starting osmo-stp 21:45:33.603348 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31485): Launched 21:45:33.934492 run osmo-stp_10.42.42.5(pid=31486): Launched 21:45:34.060616 run osmo-msc_10.42.42.6: Starting osmo-msc 21:45:34.656438 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31488): Launched 21:45:34.986272 run osmo-msc_10.42.42.6(pid=31489): Launched 21:45:35.170095 run osmo-stp_10.42.42.5(pid=31486): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31486)] 21:45:35.309584 run osmo-stp_10.42.42.5(pid=31486): stdout: | (launched: 2022-12-12_21:45:33.874470) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:45:35.449820 run osmo-stp_10.42.42.5(pid=31486): stderr: | 20221212214534066 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214534066 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214534067 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214534067 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214534067 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214534068 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214534068 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:45:35.588479 run osmo-stp_10.42.42.5(pid=31486): stdout: | (launched: 2022-12-12_21:45:33.874470) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:45:35.721168 run osmo-stp_10.42.42.5(pid=31486): stderr: | 20221212214534066 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214534066 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214534067 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214534067 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214534067 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214534068 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214534068 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:45:35.879178 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31486): Process ended prematurely: osmo-stp_10.42.42.5(pid=31486) [trial-2382↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31486)] [trial-2382↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 21:45:35.888867 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 21:45:35.917982 run osmo-hlr_10.42.42.2(pid=31483): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31483)] 21:45:35.969288 run osmo-hlr_10.42.42.2(pid=31483): stdout: | (launched: 2022-12-12_21:45:32.845056) 21:45:36.021982 run osmo-hlr_10.42.42.2(pid=31483): stderr: | 20221212214533046 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212214533046 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212214533046 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212214533047 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212214533047 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212214533047 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212214533059 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212214533068 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212214533069 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212214533069 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:45:36.095534 run osmo-msc_10.42.42.6(pid=31489): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31489)] 21:45:36.146326 run osmo-msc_10.42.42.6(pid=31489): stdout: | (launched: 2022-12-12_21:45:34.926535) 21:45:36.198744 run osmo-msc_10.42.42.6(pid=31489): stderr: | 20221212214535250 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212214535250 DLGLOBAL DEBUG validating counter group 0x7fed3c3d3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212214535250 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212214535250 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212214535251 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212214535251 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212214535252 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212214535253 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212214535253 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212214535253 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:45:36.252203 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31482): Terminating (SIGTERM) 21:45:36.294644 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31485): Terminating (SIGTERM) 21:45:36.336835 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31488): Terminating (SIGTERM) 21:45:36.379880 --- ParallelTerminationStrategy: PID 31482 died... 21:45:36.400316 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31482): Terminated: ok {rc=0} 21:45:36.447978 --- ParallelTerminationStrategy: PID 31485 died... 21:45:36.468073 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31485): Terminated: ok {rc=0} 21:45:36.515601 --- ParallelTerminationStrategy: PID 31488 died... 21:45:36.535662 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31488): Terminated: ok {rc=0} 21:45:36.624633 bus /sierra_3: Setting Powered False 21:45:37.724919 bus /sierra_3: Setting Powered False 21:45:38.841418 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 21:45:40.102220 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:45:40.110676 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 21:45:40.144713 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 21:45:40.172137 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 21:45:40.226558 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 21:45:40.260074 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 21:45:40.287203 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 21:45:40.838828 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 21:45:40.892049 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:45:40.903688 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 21:45:40.971482 tst mo_mt_call.py: using LAC 31706 21:45:41.100501 tst mo_mt_call.py: using RAC 86 21:45:41.229247 tst mo_mt_call.py: using CellId 31706 21:45:41.359403 tst mo_mt_call.py: using BVCI 31707 21:45:41.479232 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:45:41.490904 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:45:41.502353 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:45:41.514323 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:45:41.526179 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:45:41.537971 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 21:45:41.655501 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 21:45:41.771931 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:45:42.248636 run create_hlr_db(pid=31494): Launched 21:45:42.375112 bus /sierra_2: Setting Powered False 21:45:43.438364 run create_hlr_db(pid=31494): Terminated: ok {rc=0} 21:45:43.886705 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31496): Launched 21:45:44.217202 run osmo-hlr_10.42.42.2(pid=31497): Launched 21:45:44.343790 run osmo-stp_10.42.42.5: Starting osmo-stp 21:45:44.916802 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31499): Launched 21:45:45.226669 run osmo-stp_10.42.42.5(pid=31500): Launched 21:45:45.343459 run osmo-msc_10.42.42.6: Starting osmo-msc 21:45:45.934726 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31502): Launched 21:45:46.263429 run osmo-msc_10.42.42.6(pid=31503): Launched 21:45:46.472509 run osmo-stp_10.42.42.5(pid=31500): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31500)] 21:45:46.657237 run osmo-stp_10.42.42.5(pid=31500): stdout: | (launched: 2022-12-12_21:45:45.170507) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:45:46.904818 run osmo-stp_10.42.42.5(pid=31500): stderr: | 20221212214545341 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214545341 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214545342 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214545342 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214545343 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214545343 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214545343 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:45:47.050168 run osmo-stp_10.42.42.5(pid=31500): stdout: | (launched: 2022-12-12_21:45:45.170507) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:45:47.255053 run osmo-stp_10.42.42.5(pid=31500): stderr: | 20221212214545341 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214545341 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214545342 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214545342 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214545343 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214545343 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214545343 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:45:47.418438 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31500): Process ended prematurely: osmo-stp_10.42.42.5(pid=31500) [trial-2382↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31500)] [trial-2382↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 21:45:47.428102 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 21:45:47.457095 run osmo-hlr_10.42.42.2(pid=31497): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31497)] 21:45:47.509286 run osmo-hlr_10.42.42.2(pid=31497): stdout: | (launched: 2022-12-12_21:45:44.157787) 21:45:47.563253 run osmo-hlr_10.42.42.2(pid=31497): stderr: | 20221212214544357 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212214544357 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212214544357 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212214544357 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212214544357 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212214544358 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212214544370 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212214544378 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212214544378 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212214544378 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:45:47.637806 run osmo-msc_10.42.42.6(pid=31503): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31503)] 21:45:47.689808 run osmo-msc_10.42.42.6(pid=31503): stdout: | (launched: 2022-12-12_21:45:46.200342) 21:45:47.743228 run osmo-msc_10.42.42.6(pid=31503): stderr: | 20221212214546823 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212214546823 DLGLOBAL DEBUG validating counter group 0x7fab016ecc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212214546823 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212214546824 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212214546824 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212214546824 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212214546826 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212214546826 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212214546826 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212214546826 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:45:47.796887 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31496): Terminating (SIGTERM) 21:45:47.840325 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31499): Terminating (SIGTERM) 21:45:47.883763 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31502): Terminating (SIGTERM) 21:45:47.927373 --- ParallelTerminationStrategy: PID 31496 died... 21:45:47.947762 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31496): Terminated: ok {rc=0} 21:45:47.996092 --- ParallelTerminationStrategy: PID 31499 died... 21:45:48.016355 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31499): Terminated: ok {rc=0} 21:45:48.065254 --- ParallelTerminationStrategy: PID 31502 died... 21:45:48.085519 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31502): Terminated: ok {rc=0} 21:45:48.175240 bus /sierra_3: Setting Powered False 21:45:49.277183 bus /sierra_3: Setting Powered False 21:45:50.394887 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2382 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 21:45:51.546500 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:45:51.558750 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 21:45:51.626766 tst mo_mt_call_osmux.py: using LAC 31707 21:45:51.756146 tst mo_mt_call_osmux.py: using RAC 87 21:45:51.885176 tst mo_mt_call_osmux.py: using CellId 31707 21:45:52.014266 tst mo_mt_call_osmux.py: using BVCI 31708 21:45:52.134614 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:45:52.146350 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:45:52.157877 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:45:52.169673 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:45:52.181897 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:45:52.193599 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 21:45:52.313500 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 21:45:52.430631 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:45:52.909395 run create_hlr_db(pid=31505): Launched 21:45:53.037109 bus /sierra_2: Setting Powered False 21:45:54.099974 run create_hlr_db(pid=31505): Terminated: ok {rc=0} 21:45:54.529232 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31507): Launched 21:45:54.838243 run osmo-hlr_10.42.42.2(pid=31508): Launched 21:45:54.955173 run osmo-stp_10.42.42.5: Starting osmo-stp 21:45:55.483182 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31510): Launched 21:45:55.790684 run osmo-stp_10.42.42.5(pid=31511): Launched 21:45:55.907732 run osmo-msc_10.42.42.6: Starting osmo-msc 21:45:56.464623 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31513): Launched 21:45:56.773628 run osmo-msc_10.42.42.6(pid=31514): Launched 21:45:56.946618 run osmo-stp_10.42.42.5(pid=31511): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31511)] 21:45:57.077180 run osmo-stp_10.42.42.5(pid=31511): stdout: | (launched: 2022-12-12_21:45:55.734410) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:45:57.207669 run osmo-stp_10.42.42.5(pid=31511): stderr: | 20221212214555904 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214555904 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214555905 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214555905 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214555905 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214555906 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214555906 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:45:57.336616 run osmo-stp_10.42.42.5(pid=31511): stdout: | (launched: 2022-12-12_21:45:55.734410) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:45:57.459903 run osmo-stp_10.42.42.5(pid=31511): stderr: | 20221212214555904 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214555904 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214555905 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214555905 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214555905 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214555906 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214555906 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:45:57.607679 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31511): Process ended prematurely: osmo-stp_10.42.42.5(pid=31511) [trial-2382↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31511)] [trial-2382↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 21:45:57.616695 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 21:45:57.643607 run osmo-hlr_10.42.42.2(pid=31508): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31508)] 21:45:57.691675 run osmo-hlr_10.42.42.2(pid=31508): stdout: | (launched: 2022-12-12_21:45:54.781587) 21:45:57.741566 run osmo-hlr_10.42.42.2(pid=31508): stderr: | 20221212214554963 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212214554963 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212214554963 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212214554963 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212214554963 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212214554963 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212214554977 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212214554988 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212214554988 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212214554988 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:45:57.811468 run osmo-msc_10.42.42.6(pid=31514): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31514)] 21:45:57.859595 run osmo-msc_10.42.42.6(pid=31514): stdout: | (launched: 2022-12-12_21:45:56.716927) 21:45:57.909536 run osmo-msc_10.42.42.6(pid=31514): stderr: | 20221212214556989 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212214556989 DLGLOBAL DEBUG validating counter group 0x7fe9e3159c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212214556989 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212214556989 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212214556990 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212214556990 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212214556991 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212214556992 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212214556992 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212214556992 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:45:57.960164 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31507): Terminating (SIGTERM) 21:45:58.000430 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31510): Terminating (SIGTERM) 21:45:58.040850 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31513): Terminating (SIGTERM) 21:45:58.081559 --- ParallelTerminationStrategy: PID 31507 died... 21:45:58.101399 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31507): Terminated: ok {rc=0} 21:45:58.146617 --- ParallelTerminationStrategy: PID 31510 died... 21:45:58.165774 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31510): Terminated: ok {rc=0} 21:45:58.210328 --- ParallelTerminationStrategy: PID 31513 died... 21:45:58.229393 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31513): Terminated: ok {rc=0} 21:45:58.313551 bus /sierra_3: Setting Powered False 21:45:59.411543 bus /sierra_3: Setting Powered False 21:46:00.529614 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 21:46:01.785420 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:46:01.798784 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 21:46:01.847601 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 21:46:01.883967 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 21:46:01.953210 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 21:46:01.995804 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 21:46:02.031819 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 21:46:02.564764 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 21:46:02.619080 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:46:02.631002 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 21:46:02.698771 tst mo_mt_call.py: using LAC 31708 21:46:02.828310 tst mo_mt_call.py: using RAC 88 21:46:02.957199 tst mo_mt_call.py: using CellId 31708 21:46:03.086333 tst mo_mt_call.py: using BVCI 31709 21:46:03.208170 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:46:03.219902 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:46:03.231462 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:46:03.243315 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:46:03.255271 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:46:03.266969 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 21:46:03.384667 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 21:46:03.504766 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:46:04.017078 run create_hlr_db(pid=31519): Launched 21:46:04.142882 bus /sierra_2: Setting Powered False 21:46:05.208707 run create_hlr_db(pid=31519): Terminated: ok {rc=0} 21:46:05.648324 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31521): Launched 21:46:05.956613 run osmo-hlr_10.42.42.2(pid=31522): Launched 21:46:06.074282 run osmo-stp_10.42.42.5: Starting osmo-stp 21:46:06.619935 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31524): Launched 21:46:06.928609 run osmo-stp_10.42.42.5(pid=31525): Launched 21:46:07.045893 run osmo-msc_10.42.42.6: Starting osmo-msc 21:46:07.601524 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31527): Launched 21:46:07.911109 run osmo-msc_10.42.42.6(pid=31528): Launched 21:46:08.082591 run osmo-stp_10.42.42.5(pid=31525): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31525)] 21:46:08.222691 run osmo-stp_10.42.42.5(pid=31525): stdout: | (launched: 2022-12-12_21:46:06.871941) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:46:08.364512 run osmo-stp_10.42.42.5(pid=31525): stderr: | 20221212214607045 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214607045 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214607045 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214607046 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214607046 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214607046 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214607046 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:46:08.502260 run osmo-stp_10.42.42.5(pid=31525): stdout: | (launched: 2022-12-12_21:46:06.871941) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:46:08.633860 run osmo-stp_10.42.42.5(pid=31525): stderr: | 20221212214607045 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214607045 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214607045 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214607046 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214607046 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214607046 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214607046 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:46:08.792661 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31525): Process ended prematurely: osmo-stp_10.42.42.5(pid=31525) [trial-2382↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31525)] [trial-2382↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 21:46:08.802416 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 21:46:08.831201 run osmo-hlr_10.42.42.2(pid=31522): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31522)] 21:46:08.882861 run osmo-hlr_10.42.42.2(pid=31522): stdout: | (launched: 2022-12-12_21:46:05.900302) 21:46:08.935681 run osmo-hlr_10.42.42.2(pid=31522): stderr: | 20221212214606076 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212214606076 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212214606076 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212214606076 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212214606076 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212214606076 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212214606088 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212214606096 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212214606096 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212214606096 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:46:09.009578 run osmo-msc_10.42.42.6(pid=31528): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31528)] 21:46:09.060452 run osmo-msc_10.42.42.6(pid=31528): stdout: | (launched: 2022-12-12_21:46:07.854657) 21:46:09.113302 run osmo-msc_10.42.42.6(pid=31528): stderr: | 20221212214608129 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212214608130 DLGLOBAL DEBUG validating counter group 0x7f24d3317c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212214608130 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212214608130 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212214608130 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212214608130 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212214608132 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212214608132 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212214608132 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212214608132 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:46:09.166585 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31521): Terminating (SIGTERM) 21:46:09.209207 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31524): Terminating (SIGTERM) 21:46:09.252276 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31527): Terminating (SIGTERM) 21:46:09.295116 --- ParallelTerminationStrategy: PID 31521 died... 21:46:09.315522 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31521): Terminated: ok {rc=0} 21:46:09.363342 --- ParallelTerminationStrategy: PID 31524 died... 21:46:09.383252 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31524): Terminated: ok {rc=0} 21:46:09.430575 --- ParallelTerminationStrategy: PID 31527 died... 21:46:09.450668 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31527): Terminated: ok {rc=0} 21:46:09.541370 bus /sierra_3: Setting Powered False 21:46:10.641541 bus /sierra_3: Setting Powered False 21:46:11.760600 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2382 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 21:46:12.908488 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:46:12.920373 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 21:46:12.987944 tst mo_mt_call_osmux.py: using LAC 31709 21:46:13.111544 tst mo_mt_call_osmux.py: using RAC 89 21:46:13.234658 tst mo_mt_call_osmux.py: using CellId 31709 21:46:13.357677 tst mo_mt_call_osmux.py: using BVCI 31710 21:46:13.469428 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:46:13.480625 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:46:13.491817 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:46:13.502877 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:46:13.514065 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:46:13.525222 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 21:46:13.645452 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 21:46:13.765931 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:46:14.245944 run create_hlr_db(pid=31530): Launched 21:46:14.372319 bus /sierra_2: Setting Powered False 21:46:15.435163 run create_hlr_db(pid=31530): Terminated: ok {rc=0} 21:46:15.888935 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31532): Launched 21:46:16.285703 run osmo-hlr_10.42.42.2(pid=31533): Launched 21:46:16.553381 run osmo-stp_10.42.42.5: Starting osmo-stp 21:46:17.289089 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31535): Launched 21:46:17.622013 run osmo-stp_10.42.42.5(pid=31536): Launched 21:46:17.749454 run osmo-msc_10.42.42.6: Starting osmo-msc 21:46:18.348473 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31538): Launched 21:46:18.678340 run osmo-msc_10.42.42.6(pid=31539): Launched 21:46:18.863990 run osmo-stp_10.42.42.5(pid=31536): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31536)] 21:46:19.003610 run osmo-stp_10.42.42.5(pid=31536): stdout: | (launched: 2022-12-12_21:46:17.562295) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:46:19.143857 run osmo-stp_10.42.42.5(pid=31536): stderr: | 20221212214617755 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214617755 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214617756 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214617756 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214617757 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214617757 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214617757 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:46:19.281906 run osmo-stp_10.42.42.5(pid=31536): stdout: | (launched: 2022-12-12_21:46:17.562295) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:46:19.413554 run osmo-stp_10.42.42.5(pid=31536): stderr: | 20221212214617755 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214617755 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214617756 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214617756 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214617757 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214617757 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214617757 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:46:19.571181 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31536): Process ended prematurely: osmo-stp_10.42.42.5(pid=31536) [trial-2382↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31536)] [trial-2382↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 21:46:19.581061 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 21:46:19.609728 run osmo-hlr_10.42.42.2(pid=31533): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31533)] 21:46:19.660435 run osmo-hlr_10.42.42.2(pid=31533): stdout: | (launched: 2022-12-12_21:46:16.221592) 21:46:19.713478 run osmo-hlr_10.42.42.2(pid=31533): stderr: | 20221212214616449 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212214616449 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212214616449 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212214616450 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212214616450 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212214616450 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212214616462 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212214616483 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212214616483 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212214616483 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:46:19.787002 run osmo-msc_10.42.42.6(pid=31539): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31539)] 21:46:19.837884 run osmo-msc_10.42.42.6(pid=31539): stdout: | (launched: 2022-12-12_21:46:18.618520) 21:46:19.890361 run osmo-msc_10.42.42.6(pid=31539): stderr: | 20221212214618940 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212214618940 DLGLOBAL DEBUG validating counter group 0x7fb690a4bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212214618941 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212214618941 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212214618941 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212214618941 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212214618943 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212214618943 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212214618943 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212214618943 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:46:19.943359 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31532): Terminating (SIGTERM) 21:46:19.985780 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31535): Terminating (SIGTERM) 21:46:20.028305 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31538): Terminating (SIGTERM) 21:46:20.071386 --- ParallelTerminationStrategy: PID 31532 died... 21:46:20.091735 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31532): Terminated: ok {rc=0} 21:46:20.139199 --- ParallelTerminationStrategy: PID 31535 died... 21:46:20.158959 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31535): Terminated: ok {rc=0} 21:46:20.206256 --- ParallelTerminationStrategy: PID 31538 died... 21:46:20.226242 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31538): Terminated: ok {rc=0} 21:46:20.315504 bus /sierra_3: Setting Powered False 21:46:21.415874 bus /sierra_3: Setting Powered False 21:46:22.534448 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 21:46:23.790327 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:46:23.798886 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 21:46:23.830703 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 21:46:23.857001 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 21:46:23.906879 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 21:46:23.938694 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 21:46:23.964823 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 21:46:24.517484 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 21:46:24.566602 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:46:24.577865 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 21:46:24.642289 tst mo_mt_call.py: using LAC 31710 21:46:24.761593 tst mo_mt_call.py: using RAC 90 21:46:24.890883 tst mo_mt_call.py: using CellId 31710 21:46:25.019635 tst mo_mt_call.py: using BVCI 31711 21:46:25.141427 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:46:25.153479 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:46:25.165091 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:46:25.177063 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:46:25.189056 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:46:25.201061 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 21:46:25.317874 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 21:46:25.439772 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:46:25.950893 run create_hlr_db(pid=31544): Launched 21:46:26.076116 bus /sierra_2: Setting Powered False 21:46:27.138842 run create_hlr_db(pid=31544): Terminated: ok {rc=0} 21:46:27.597736 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31546): Launched 21:46:27.905709 run osmo-hlr_10.42.42.2(pid=31547): Launched 21:46:28.022732 run osmo-stp_10.42.42.5: Starting osmo-stp 21:46:28.569142 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31549): Launched 21:46:28.876727 run osmo-stp_10.42.42.5(pid=31550): Launched 21:46:28.993287 run osmo-msc_10.42.42.6: Starting osmo-msc 21:46:29.547799 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31552): Launched 21:46:29.855176 run osmo-msc_10.42.42.6(pid=31553): Launched 21:46:30.026731 run osmo-stp_10.42.42.5(pid=31550): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31550)] 21:46:30.156039 run osmo-stp_10.42.42.5(pid=31550): stdout: | (launched: 2022-12-12_21:46:28.820564) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:46:30.285569 run osmo-stp_10.42.42.5(pid=31550): stderr: | 20221212214628992 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214628992 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214628992 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214628993 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214628995 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214628995 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214628995 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:46:30.413643 run osmo-stp_10.42.42.5(pid=31550): stdout: | (launched: 2022-12-12_21:46:28.820564) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:46:30.535420 run osmo-stp_10.42.42.5(pid=31550): stderr: | 20221212214628992 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214628992 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214628992 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214628993 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214628995 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214628995 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214628995 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:46:30.681356 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31550): Process ended prematurely: osmo-stp_10.42.42.5(pid=31550) [trial-2382↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31550)] [trial-2382↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 21:46:30.690072 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 21:46:30.716565 run osmo-hlr_10.42.42.2(pid=31547): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31547)] 21:46:30.764543 run osmo-hlr_10.42.42.2(pid=31547): stdout: | (launched: 2022-12-12_21:46:27.849328) 21:46:30.814434 run osmo-hlr_10.42.42.2(pid=31547): stderr: | 20221212214628029 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212214628029 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212214628029 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212214628029 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212214628029 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212214628029 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212214628040 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212214628048 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212214628049 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212214628049 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:46:30.908228 run osmo-msc_10.42.42.6(pid=31553): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31553)] 21:46:30.957826 run osmo-msc_10.42.42.6(pid=31553): stdout: | (launched: 2022-12-12_21:46:29.798724) 21:46:31.009108 run osmo-msc_10.42.42.6(pid=31553): stderr: | 20221212214630072 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212214630072 DLGLOBAL DEBUG validating counter group 0x7f884ee34c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212214630072 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212214630072 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212214630073 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212214630073 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212214630075 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212214630075 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212214630075 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212214630075 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:46:31.061806 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31546): Terminating (SIGTERM) 21:46:31.103383 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31549): Terminating (SIGTERM) 21:46:31.146278 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31552): Terminating (SIGTERM) 21:46:31.188466 --- ParallelTerminationStrategy: PID 31546 died... 21:46:31.209239 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31546): Terminated: ok {rc=0} 21:46:31.254847 --- ParallelTerminationStrategy: PID 31549 died... 21:46:31.274697 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31549): Terminated: ok {rc=0} 21:46:31.320300 --- ParallelTerminationStrategy: PID 31552 died... 21:46:31.339928 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31552): Terminated: ok {rc=0} 21:46:31.426549 bus /sierra_3: Setting Powered False 21:46:32.525075 bus /sierra_3: Setting Powered False 21:46:33.640563 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2382 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 21:46:34.788357 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:46:34.800191 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 21:46:34.866939 tst mo_mt_call_osmux.py: using LAC 31711 21:46:34.988217 tst mo_mt_call_osmux.py: using RAC 91 21:46:35.114278 tst mo_mt_call_osmux.py: using CellId 31711 21:46:35.238853 tst mo_mt_call_osmux.py: using BVCI 31712 21:46:35.352293 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:46:35.363509 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:46:35.374581 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:46:35.385529 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:46:35.396557 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:46:35.407627 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 21:46:35.527926 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 21:46:35.647127 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:46:36.126777 run create_hlr_db(pid=31555): Launched 21:46:36.252556 bus /sierra_2: Setting Powered False 21:46:37.314766 run create_hlr_db(pid=31555): Terminated: ok {rc=0} 21:46:37.764738 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31557): Launched 21:46:38.094294 run osmo-hlr_10.42.42.2(pid=31558): Launched 21:46:38.220189 run osmo-stp_10.42.42.5: Starting osmo-stp 21:46:38.789782 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31560): Launched 21:46:39.119455 run osmo-stp_10.42.42.5(pid=31561): Launched 21:46:39.246151 run osmo-msc_10.42.42.6: Starting osmo-msc 21:46:39.843944 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31563): Launched 21:46:40.175148 run osmo-msc_10.42.42.6(pid=31564): Launched 21:46:40.359200 run osmo-stp_10.42.42.5(pid=31561): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31561)] 21:46:40.498325 run osmo-stp_10.42.42.5(pid=31561): stdout: | (launched: 2022-12-12_21:46:39.059599) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:46:40.637642 run osmo-stp_10.42.42.5(pid=31561): stderr: | 20221212214639254 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214639254 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214639254 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214639255 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214639255 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214639255 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214639255 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:46:40.776368 run osmo-stp_10.42.42.5(pid=31561): stdout: | (launched: 2022-12-12_21:46:39.059599) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:46:40.908201 run osmo-stp_10.42.42.5(pid=31561): stderr: | 20221212214639254 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214639254 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214639254 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214639255 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214639255 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214639255 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214639255 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:46:41.065924 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31561): Process ended prematurely: osmo-stp_10.42.42.5(pid=31561) [trial-2382↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31561)] [trial-2382↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 21:46:41.075667 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 21:46:41.104132 run osmo-hlr_10.42.42.2(pid=31558): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31558)] 21:46:41.155272 run osmo-hlr_10.42.42.2(pid=31558): stdout: | (launched: 2022-12-12_21:46:38.034527) 21:46:41.207965 run osmo-hlr_10.42.42.2(pid=31558): stderr: | 20221212214638235 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212214638235 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212214638235 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212214638235 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212214638235 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212214638235 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212214638248 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212214638257 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212214638257 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212214638257 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:46:41.281515 run osmo-msc_10.42.42.6(pid=31564): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31564)] 21:46:41.332253 run osmo-msc_10.42.42.6(pid=31564): stdout: | (launched: 2022-12-12_21:46:40.115193) 21:46:41.384771 run osmo-msc_10.42.42.6(pid=31564): stderr: | 20221212214640440 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212214640440 DLGLOBAL DEBUG validating counter group 0x7f77edb16c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212214640440 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212214640440 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212214640440 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212214640441 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212214640442 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212214640443 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212214640443 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212214640443 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:46:41.437553 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31557): Terminating (SIGTERM) 21:46:41.480135 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31560): Terminating (SIGTERM) 21:46:41.522818 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31563): Terminating (SIGTERM) 21:46:41.565826 --- ParallelTerminationStrategy: PID 31557 died... 21:46:41.586331 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31557): Terminated: ok {rc=0} 21:46:41.633931 --- ParallelTerminationStrategy: PID 31560 died... 21:46:41.653867 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31560): Terminated: ok {rc=0} 21:46:41.701392 --- ParallelTerminationStrategy: PID 31563 died... 21:46:41.721788 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31563): Terminated: ok {rc=0} 21:46:41.811601 bus /sierra_3: Setting Powered False 21:46:42.911653 bus /sierra_3: Setting Powered False 21:46:44.029214 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 21:46:45.281624 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:46:45.289689 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 21:46:45.325365 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 21:46:45.352630 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 21:46:45.407939 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 21:46:45.441840 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 21:46:45.469911 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 21:46:46.023284 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 21:46:46.097427 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:46:46.113844 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 21:46:46.201317 tst mo_mt_call.py: using LAC 31712 21:46:46.361658 tst mo_mt_call.py: using RAC 92 21:46:46.528416 tst mo_mt_call.py: using CellId 31712 21:46:46.661986 tst mo_mt_call.py: using BVCI 31713 21:46:46.784501 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:46:46.797126 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:46:46.809493 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:46:46.823678 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:46:46.837067 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:46:46.849454 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:46:46.990407 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:46:47.119256 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:46:47.604148 run create_hlr_db(pid=31569): Launched 21:46:47.729273 bus /sierra_2: Setting Powered False 21:46:48.792045 run create_hlr_db(pid=31569): Terminated: ok {rc=0} 21:46:49.219901 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31571): Launched 21:46:49.528458 run osmo-hlr_10.42.42.2(pid=31572): Launched 21:46:49.644664 run osmo-stp_10.42.42.5: Starting osmo-stp 21:46:50.187701 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31574): Launched 21:46:50.494941 run osmo-stp_10.42.42.5(pid=31575): Launched 21:46:50.612797 run osmo-msc_10.42.42.6: Starting osmo-msc 21:46:51.168349 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31577): Launched 21:46:51.475236 run osmo-msc_10.42.42.6(pid=31578): Launched 21:46:51.647057 run osmo-stp_10.42.42.5(pid=31575): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31575)] 21:46:51.776511 run osmo-stp_10.42.42.5(pid=31575): stdout: | (launched: 2022-12-12_21:46:50.438701) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:46:51.906318 run osmo-stp_10.42.42.5(pid=31575): stderr: | 20221212214650611 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214650612 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214650612 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214650612 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214650613 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214650613 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214650613 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:46:52.033553 run osmo-stp_10.42.42.5(pid=31575): stdout: | (launched: 2022-12-12_21:46:50.438701) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:46:52.155863 run osmo-stp_10.42.42.5(pid=31575): stderr: | 20221212214650611 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214650612 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214650612 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214650612 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214650613 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214650613 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214650613 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:46:52.301872 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31575): Process ended prematurely: osmo-stp_10.42.42.5(pid=31575) [trial-2382↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31575)] [trial-2382↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 21:46:52.310505 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 21:46:52.337106 run osmo-hlr_10.42.42.2(pid=31572): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31572)] 21:46:52.385072 run osmo-hlr_10.42.42.2(pid=31572): stdout: | (launched: 2022-12-12_21:46:49.471310) 21:46:52.434760 run osmo-hlr_10.42.42.2(pid=31572): stderr: | 20221212214649650 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212214649650 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212214649651 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212214649651 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212214649651 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212214649651 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212214649664 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212214649673 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212214649673 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212214649673 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:46:52.504573 run osmo-msc_10.42.42.6(pid=31578): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31578)] 21:46:52.553385 run osmo-msc_10.42.42.6(pid=31578): stdout: | (launched: 2022-12-12_21:46:51.419283) 21:46:52.602933 run osmo-msc_10.42.42.6(pid=31578): stderr: | 20221212214651692 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212214651692 DLGLOBAL DEBUG validating counter group 0x7f61a70e2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212214651692 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212214651692 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212214651692 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212214651693 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212214651694 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212214651695 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212214651695 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212214651695 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:46:52.652845 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31571): Terminating (SIGTERM) 21:46:52.692937 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31574): Terminating (SIGTERM) 21:46:52.732726 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31577): Terminating (SIGTERM) 21:46:52.772828 --- ParallelTerminationStrategy: PID 31571 died... 21:46:52.792133 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31571): Terminated: ok {rc=0} 21:46:52.836296 --- ParallelTerminationStrategy: PID 31574 died... 21:46:52.854890 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31574): Terminated: ok {rc=0} 21:46:52.899315 --- ParallelTerminationStrategy: PID 31577 died... 21:46:52.918082 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31577): Terminated: ok {rc=0} 21:46:53.002289 bus /sierra_3: Setting Powered False 21:46:54.101218 bus /sierra_3: Setting Powered False 21:46:55.218343 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2382 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 21:46:56.368415 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:46:56.380896 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 21:46:56.450919 tst mo_mt_call_osmux.py: using LAC 31713 21:46:56.579808 tst mo_mt_call_osmux.py: using RAC 93 21:46:56.708674 tst mo_mt_call_osmux.py: using CellId 31713 21:46:56.831218 tst mo_mt_call_osmux.py: using BVCI 31714 21:46:56.945222 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:46:56.956439 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:46:56.967628 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:46:56.978729 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:46:56.989858 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:46:57.000802 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:46:57.120053 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:46:57.242868 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:46:57.754224 run create_hlr_db(pid=31580): Launched 21:46:57.881175 bus /sierra_2: Setting Powered False 21:46:58.947238 run create_hlr_db(pid=31580): Terminated: ok {rc=0} 21:46:59.386953 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31582): Launched 21:46:59.694828 run osmo-hlr_10.42.42.2(pid=31583): Launched 21:46:59.811520 run osmo-stp_10.42.42.5: Starting osmo-stp 21:47:00.358860 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31585): Launched 21:47:00.666961 run osmo-stp_10.42.42.5(pid=31586): Launched 21:47:00.783972 run osmo-msc_10.42.42.6: Starting osmo-msc 21:47:01.373670 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31588): Launched 21:47:01.731609 run osmo-msc_10.42.42.6(pid=31589): Launched 21:47:02.009341 run osmo-stp_10.42.42.5(pid=31586): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31586)] 21:47:02.286603 run osmo-stp_10.42.42.5(pid=31586): stdout: | (launched: 2022-12-12_21:47:00.610355) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:47:02.478928 run osmo-stp_10.42.42.5(pid=31586): stderr: | 20221212214700782 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214700782 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214700782 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214700783 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214700783 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214700783 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214700783 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:47:02.607646 run osmo-stp_10.42.42.5(pid=31586): stdout: | (launched: 2022-12-12_21:47:00.610355) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:47:02.730891 run osmo-stp_10.42.42.5(pid=31586): stderr: | 20221212214700782 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214700782 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214700782 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214700783 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214700783 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214700783 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214700783 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:47:02.878044 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31586): Process ended prematurely: osmo-stp_10.42.42.5(pid=31586) [trial-2382↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31586)] [trial-2382↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 21:47:02.886866 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 21:47:02.913561 run osmo-hlr_10.42.42.2(pid=31583): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31583)] 21:47:02.961496 run osmo-hlr_10.42.42.2(pid=31583): stdout: | (launched: 2022-12-12_21:46:59.638378) 21:47:03.011326 run osmo-hlr_10.42.42.2(pid=31583): stderr: | 20221212214659817 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212214659817 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212214659817 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212214659818 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212214659818 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212214659818 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212214659830 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212214659840 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212214659841 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212214659841 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:47:03.081038 run osmo-msc_10.42.42.6(pid=31589): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31589)] 21:47:03.129867 run osmo-msc_10.42.42.6(pid=31589): stdout: | (launched: 2022-12-12_21:47:01.657660) 21:47:03.179430 run osmo-msc_10.42.42.6(pid=31589): stderr: | 20221212214702311 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212214702312 DLGLOBAL DEBUG validating counter group 0x7f7deb92fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212214702312 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212214702312 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212214702312 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212214702312 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212214702314 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212214702314 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212214702314 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212214702315 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:47:03.229280 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31582): Terminating (SIGTERM) 21:47:03.269289 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31585): Terminating (SIGTERM) 21:47:03.309459 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31588): Terminating (SIGTERM) 21:47:03.350035 --- ParallelTerminationStrategy: PID 31582 died... 21:47:03.369472 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31582): Terminated: ok {rc=0} 21:47:03.413912 --- ParallelTerminationStrategy: PID 31585 died... 21:47:03.432576 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31585): Terminated: ok {rc=0} 21:47:03.476884 --- ParallelTerminationStrategy: PID 31588 died... 21:47:03.496214 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31588): Terminated: ok {rc=0} 21:47:03.581489 bus /sierra_3: Setting Powered False 21:47:04.681507 bus /sierra_3: Setting Powered False 21:47:05.798450 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 21:47:07.044402 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:47:07.051497 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 21:47:07.083519 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 21:47:07.109865 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 21:47:07.162694 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 21:47:07.194949 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 21:47:07.221247 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 21:47:07.773992 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 21:47:07.823045 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 21:47:07.834564 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 21:47:07.883951 tst mo_mt_call.py: using LAC 31714 21:47:08.006643 tst mo_mt_call.py: using RAC 94 21:47:08.129646 tst mo_mt_call.py: using CellId 31714 21:47:08.255204 tst mo_mt_call.py: using BVCI 31715 21:47:08.367848 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 21:47:08.379433 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 21:47:08.390702 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 21:47:08.401976 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 21:47:08.413354 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 21:47:08.424530 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 21:47:08.540482 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 21:47:08.658612 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:47:09.136501 run create_hlr_db(pid=31595): Launched 21:47:09.261097 bus /sierra_2: Setting Powered False 21:47:10.323400 run create_hlr_db(pid=31595): Terminated: ok {rc=0} 21:47:10.773265 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31597): Launched 21:47:11.102313 run osmo-hlr_10.42.42.2(pid=31598): Launched 21:47:11.228822 run osmo-stp_10.42.42.5: Starting osmo-stp 21:47:11.801667 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31600): Launched 21:47:12.131523 run osmo-stp_10.42.42.5(pid=31601): Launched 21:47:12.256398 run osmo-msc_10.42.42.6: Starting osmo-msc 21:47:12.853208 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31603): Launched 21:47:13.182099 run osmo-msc_10.42.42.6(pid=31604): Launched 21:47:13.366031 run osmo-stp_10.42.42.5(pid=31601): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31601)] 21:47:13.504750 run osmo-stp_10.42.42.5(pid=31601): stdout: | (launched: 2022-12-12_21:47:12.071320) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:47:13.644462 run osmo-stp_10.42.42.5(pid=31601): stderr: | 20221212214712265 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214712265 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214712265 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214712265 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214712266 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214712266 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214712266 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:47:13.783480 run osmo-stp_10.42.42.5(pid=31601): stdout: | (launched: 2022-12-12_21:47:12.071320) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:47:13.915105 run osmo-stp_10.42.42.5(pid=31601): stderr: | 20221212214712265 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214712265 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214712265 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214712265 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214712266 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214712266 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214712266 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:47:14.073198 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31601): Process ended prematurely: osmo-stp_10.42.42.5(pid=31601) [trial-2382↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31601)] [trial-2382↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 21:47:14.082722 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 21:47:14.111369 run osmo-hlr_10.42.42.2(pid=31598): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31598)] 21:47:14.162370 run osmo-hlr_10.42.42.2(pid=31598): stdout: | (launched: 2022-12-12_21:47:11.042910) 21:47:14.215044 run osmo-hlr_10.42.42.2(pid=31598): stderr: | 20221212214711240 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212214711240 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212214711240 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212214711241 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212214711241 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212214711241 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212214711252 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212214711261 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212214711261 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212214711261 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:47:14.288270 run osmo-msc_10.42.42.6(pid=31604): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31604)] 21:47:14.339141 run osmo-msc_10.42.42.6(pid=31604): stdout: | (launched: 2022-12-12_21:47:13.122342) 21:47:14.391446 run osmo-msc_10.42.42.6(pid=31604): stderr: | 20221212214713444 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212214713444 DLGLOBAL DEBUG validating counter group 0x7f54eed26c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212214713444 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212214713444 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212214713444 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212214713445 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212214713446 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212214713447 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212214713447 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212214713447 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:47:14.444213 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31597): Terminating (SIGTERM) 21:47:14.486784 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31600): Terminating (SIGTERM) 21:47:14.529091 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31603): Terminating (SIGTERM) 21:47:14.572170 --- ParallelTerminationStrategy: PID 31597 died... 21:47:14.593071 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31597): Terminated: ok {rc=0} 21:47:14.640240 --- ParallelTerminationStrategy: PID 31600 died... 21:47:14.660027 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31600): Terminated: ok {rc=0} 21:47:14.707555 --- ParallelTerminationStrategy: PID 31603 died... 21:47:14.727722 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31603): Terminated: ok {rc=0} 21:47:14.816075 bus /sierra_3: Setting Powered False 21:47:15.932751 bus /sierra_3: Setting Powered False 21:47:17.063109 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2382 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 21:47:18.232115 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 21:47:18.244619 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 21:47:18.296570 tst mo_mt_call_osmux.py: using LAC 31715 21:47:18.428154 tst mo_mt_call_osmux.py: using RAC 95 21:47:18.557912 tst mo_mt_call_osmux.py: using CellId 31715 21:47:18.688867 tst mo_mt_call_osmux.py: using BVCI 31716 21:47:18.811901 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 21:47:18.823772 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 21:47:18.835543 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 21:47:18.847484 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 21:47:18.859559 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 21:47:18.871502 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 21:47:18.993663 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 21:47:19.114174 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:47:19.627576 run create_hlr_db(pid=31606): Launched 21:47:19.754823 bus /sierra_2: Setting Powered False 21:47:20.821111 run create_hlr_db(pid=31606): Terminated: ok {rc=0} 21:47:21.261238 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31608): Launched 21:47:21.570007 run osmo-hlr_10.42.42.2(pid=31609): Launched 21:47:21.687265 run osmo-stp_10.42.42.5: Starting osmo-stp 21:47:22.217444 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31611): Launched 21:47:22.528793 run osmo-stp_10.42.42.5(pid=31612): Launched 21:47:22.645904 run osmo-msc_10.42.42.6: Starting osmo-msc 21:47:23.203520 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31614): Launched 21:47:23.511392 run osmo-msc_10.42.42.6(pid=31615): Launched 21:47:23.684375 run osmo-stp_10.42.42.5(pid=31612): ERR: Terminated: ERROR {rc=1} [trial-2382↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31612)] 21:47:23.814791 run osmo-stp_10.42.42.5(pid=31612): stdout: | (launched: 2022-12-12_21:47:22.471025) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:47:23.944580 run osmo-stp_10.42.42.5(pid=31612): stderr: | 20221212214722644 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214722644 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214722645 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214722645 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214722646 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214722646 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214722646 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:47:24.073132 run osmo-stp_10.42.42.5(pid=31612): stdout: | (launched: 2022-12-12_21:47:22.471025) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:47:24.195965 run osmo-stp_10.42.42.5(pid=31612): stderr: | 20221212214722644 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214722644 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214722645 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214722645 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214722646 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214722646 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214722646 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:47:24.343630 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31612): Process ended prematurely: osmo-stp_10.42.42.5(pid=31612) [trial-2382↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31612)] [trial-2382↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 21:47:24.352666 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 21:47:24.379575 run osmo-hlr_10.42.42.2(pid=31609): ERR: Terminated: ERROR {rc=237} [trial-2382↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31609)] 21:47:24.427835 run osmo-hlr_10.42.42.2(pid=31609): stdout: | (launched: 2022-12-12_21:47:21.513070) 21:47:24.478059 run osmo-hlr_10.42.42.2(pid=31609): stderr: | 20221212214721690 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212214721691 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212214721691 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212214721691 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212214721691 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212214721691 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212214721706 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212214721717 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212214721717 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212214721718 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:47:24.547930 run osmo-msc_10.42.42.6(pid=31615): ERR: Terminated: ERROR {rc=2} [trial-2382↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31615)] 21:47:24.595906 run osmo-msc_10.42.42.6(pid=31615): stdout: | (launched: 2022-12-12_21:47:23.455280) 21:47:24.645452 run osmo-msc_10.42.42.6(pid=31615): stderr: | 20221212214723729 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212214723729 DLGLOBAL DEBUG validating counter group 0x7fe79656bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212214723730 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212214723731 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212214723731 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212214723731 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212214723733 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212214723733 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212214723733 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212214723733 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:47:24.695631 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31608): Terminating (SIGTERM) 21:47:24.735966 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31611): Terminating (SIGTERM) 21:47:24.776357 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31614): Terminating (SIGTERM) 21:47:24.817757 --- ParallelTerminationStrategy: PID 31608 died... 21:47:24.837337 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31608): Terminated: ok {rc=0} 21:47:24.882225 --- ParallelTerminationStrategy: PID 31611 died... 21:47:24.901285 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31611): Terminated: ok {rc=0} 21:47:24.946062 --- ParallelTerminationStrategy: PID 31614 died... 21:47:24.965122 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31614): Terminated: ok {rc=0} 21:47:25.052523 bus /sierra_3: Setting Powered False 21:47:26.152711 bus /sierra_3: Setting Powered False 21:47:27.269790 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 emergency:nanobts+band-900 --------------------------------------------------------------------- 21:47:28.530112 tst emergency:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:47:28.536310 tst emergency:nanobts+band-900: Verifying 1 x bts (candidates: 11) 21:47:28.570360 tst emergency:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 21:47:28.597770 tst emergency:nanobts+band-900: Verifying 4 x modem (candidates: 12) 21:47:28.685480 tst emergency:nanobts+band-900: Reserving 1 x bts (candidates: 11) 21:47:28.719084 tst emergency:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 21:47:28.746448 tst emergency:nanobts+band-900: Reserving 4 x modem (candidates: 12) 21:47:29.329904 tst emergency:nanobts+band-900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2382 emergency:nanobts+band-900 emergency_mo_mt_call.py ---------------------------------------------- 21:47:29.335706 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 21:47:29.346978 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 21:47:29.395801 tst emergency_mo_mt_call.py: using LAC 31716 21:47:29.522068 tst emergency_mo_mt_call.py: using RAC 96 21:47:29.650178 tst emergency_mo_mt_call.py: using CellId 31716 21:47:29.780390 tst emergency_mo_mt_call.py: using BVCI 31717 21:47:29.899942 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 21:47:29.911203 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 21:47:29.922245 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 21:47:29.933630 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 21:47:29.944874 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 21:47:29.956208 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 21:47:30.076200 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 21:47:30.196004 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:47:30.697936 run create_hlr_db(pid=31620): Launched 21:47:30.821032 bus /sierra_2: Setting Powered False 21:47:31.903462 run create_hlr_db(pid=31620): Terminated: ok {rc=0} 21:47:32.360227 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31622): Launched 21:47:32.663610 run osmo-hlr_10.42.42.2(pid=31623): Launched 21:47:32.780053 run osmo-stp_10.42.42.5: Starting osmo-stp 21:47:33.318323 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31625): Launched 21:47:33.620806 run osmo-stp_10.42.42.5(pid=31626): Launched 21:47:33.746430 tst emergency_mo_mt_call.py: using MSISDN 7981 21:47:33.907455 run osmo-msc_10.42.42.6: Starting osmo-msc 21:47:34.451838 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31628): Launched 21:47:34.754878 run osmo-msc_10.42.42.6(pid=31629): Launched 21:47:34.925964 run osmo-stp_10.42.42.5(pid=31626): ERR: Terminated: ERROR {rc=1} [trial-2382↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31626)] 21:47:35.054114 run osmo-stp_10.42.42.5(pid=31626): stdout: | (launched: 2022-12-12_21:47:33.565208) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:47:35.182756 run osmo-stp_10.42.42.5(pid=31626): stderr: | 20221212214733740 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214733740 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214733740 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214733740 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214733741 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214733741 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214733741 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:47:35.309217 run osmo-stp_10.42.42.5(pid=31626): stdout: | (launched: 2022-12-12_21:47:33.565208) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:47:35.429505 run osmo-stp_10.42.42.5(pid=31626): stderr: | 20221212214733740 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214733740 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214733740 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214733740 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214733741 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214733741 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214733741 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:47:35.573606 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=31626): Process ended prematurely: osmo-stp_10.42.42.5(pid=31626) [trial-2382↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31626)] [trial-2382↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19] 21:47:35.581938 tst emergency_mo_mt_call.py:19: Test FAILED (6.2 sec) 21:47:35.608284 run osmo-hlr_10.42.42.2(pid=31623): ERR: Terminated: ERROR {rc=237} [trial-2382↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31623)] 21:47:35.656694 run osmo-hlr_10.42.42.2(pid=31623): stdout: | (launched: 2022-12-12_21:47:32.608088) 21:47:35.706869 run osmo-hlr_10.42.42.2(pid=31623): stderr: | 20221212214732787 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212214732787 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212214732787 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212214732787 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212214732787 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212214732787 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212214732799 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/emergency:nanobts+band-900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212214732809 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212214732809 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212214732809 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:47:35.777377 run osmo-msc_10.42.42.6(pid=31629): ERR: Terminated: ERROR {rc=2} [trial-2382↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31629)] 21:47:35.825684 run osmo-msc_10.42.42.6(pid=31629): stdout: | (launched: 2022-12-12_21:47:34.699576) 21:47:35.875716 run osmo-msc_10.42.42.6(pid=31629): stderr: | 20221212214734970 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212214734970 DLGLOBAL DEBUG validating counter group 0x7fe6fbfd3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212214734971 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212214734971 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212214734971 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212214734971 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212214734973 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212214734973 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212214734973 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212214734974 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:47:35.926095 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31622): Terminating (SIGTERM) 21:47:35.966310 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31625): Terminating (SIGTERM) 21:47:36.006440 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31628): Terminating (SIGTERM) 21:47:36.046870 --- ParallelTerminationStrategy: PID 31622 died... 21:47:36.066079 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31622): Terminated: ok {rc=0} 21:47:36.111403 --- ParallelTerminationStrategy: PID 31625 died... 21:47:36.130252 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31625): Terminated: ok {rc=0} 21:47:36.174490 --- ParallelTerminationStrategy: PID 31628 died... 21:47:36.193267 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31628): Terminated: ok {rc=0} 21:47:36.280226 bus /sierra_3: Setting Powered False 21:47:37.379199 bus /sierra_3: Setting Powered False 21:47:38.496156 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2382 emergency:nanobts+band-900 emergency_preemptive_call.py ---------------------------------------------- 21:47:39.584734 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 21:47:39.597115 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 21:47:39.648422 tst emergency_preemptive_call.py: using LAC 31717 21:47:39.778760 tst emergency_preemptive_call.py: using RAC 97 21:47:39.906427 tst emergency_preemptive_call.py: using CellId 31717 21:47:40.035062 tst emergency_preemptive_call.py: using BVCI 31718 21:47:40.152839 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 21:47:40.164222 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 21:47:40.175344 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 21:47:40.186644 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 21:47:40.198084 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 21:47:40.209551 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 21:47:40.329499 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 21:47:40.447471 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 21:47:40.566873 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 21:47:40.686033 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:47:41.191021 run create_hlr_db(pid=31631): Launched 21:47:41.315354 bus /sierra_2: Setting Powered False 21:47:42.379884 run create_hlr_db(pid=31631): Terminated: ok {rc=0} 21:47:42.832602 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31633): Launched 21:47:43.157606 run osmo-hlr_10.42.42.2(pid=31634): Launched 21:47:43.283072 run osmo-stp_10.42.42.5: Starting osmo-stp 21:47:43.845209 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31636): Launched 21:47:44.169185 run osmo-stp_10.42.42.5(pid=31637): Launched 21:47:44.303483 tst emergency_preemptive_call.py: using MSISDN 7982 21:47:44.472903 run osmo-msc_10.42.42.6: Starting osmo-msc 21:47:45.054978 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31639): Launched 21:47:45.379995 run osmo-msc_10.42.42.6(pid=31640): Launched 21:47:45.561373 run osmo-stp_10.42.42.5(pid=31637): ERR: Terminated: ERROR {rc=1} [trial-2382↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31637)] 21:47:45.698776 run osmo-stp_10.42.42.5(pid=31637): stdout: | (launched: 2022-12-12_21:47:44.110136) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:47:45.862686 run osmo-stp_10.42.42.5(pid=31637): stderr: | 20221212214744305 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214744305 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214744305 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214744306 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214744306 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214744306 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214744306 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:47:46.042915 run osmo-stp_10.42.42.5(pid=31637): stdout: | (launched: 2022-12-12_21:47:44.110136) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:47:46.175134 run osmo-stp_10.42.42.5(pid=31637): stderr: | 20221212214744305 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214744305 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214744305 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214744306 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214744306 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214744306 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214744306 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:47:46.333976 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=31637): Process ended prematurely: osmo-stp_10.42.42.5(pid=31637) [trial-2382↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31637)] [trial-2382↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32] 21:47:46.344116 tst emergency_preemptive_call.py:32: Test FAILED (6.8 sec) 21:47:46.375843 run osmo-hlr_10.42.42.2(pid=31634): ERR: Terminated: ERROR {rc=237} [trial-2382↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31634)] 21:47:46.429535 run osmo-hlr_10.42.42.2(pid=31634): stdout: | (launched: 2022-12-12_21:47:43.098462) 21:47:46.484671 run osmo-hlr_10.42.42.2(pid=31634): stderr: | 20221212214743298 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212214743298 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212214743299 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212214743299 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212214743299 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212214743299 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212214743311 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/emergency:nanobts+band-900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212214743319 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212214743319 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212214743319 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:47:46.561161 run osmo-msc_10.42.42.6(pid=31640): ERR: Terminated: ERROR {rc=2} [trial-2382↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31640)] 21:47:46.614750 run osmo-msc_10.42.42.6(pid=31640): stdout: | (launched: 2022-12-12_21:47:45.320605) 21:47:46.669611 run osmo-msc_10.42.42.6(pid=31640): stderr: | 20221212214745645 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212214745645 DLGLOBAL DEBUG validating counter group 0x7f3cccdc2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212214745645 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212214745645 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212214745645 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212214745645 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212214745647 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212214745648 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212214745648 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212214745648 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:47:46.725179 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31633): Terminating (SIGTERM) 21:47:46.770657 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31636): Terminating (SIGTERM) 21:47:46.815872 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31639): Terminating (SIGTERM) 21:47:46.861172 --- ParallelTerminationStrategy: PID 31633 died... 21:47:46.882188 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31633): Terminated: ok {rc=0} 21:47:46.932734 --- ParallelTerminationStrategy: PID 31636 died... 21:47:46.953808 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31636): Terminated: ok {rc=0} 21:47:47.004420 --- ParallelTerminationStrategy: PID 31639 died... 21:47:47.025612 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31639): Terminated: ok {rc=0} 21:47:47.124410 bus /sierra_9: Setting Powered False 21:47:48.227698 bus /sierra_9: Setting Powered False 21:47:49.346699 bus /sierra_8: Setting Powered False 21:47:50.447348 bus /sierra_8: Setting Powered False 21:47:51.562194 bus /sierra_3: Setting Powered False 21:47:52.662601 bus /sierra_3: Setting Powered False 21:47:53.778786 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 emergency:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 gprs:nanobts+band-900 --------------------------------------------------------------------- 21:47:55.060575 tst gprs:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:47:55.066399 tst gprs:nanobts+band-900: Verifying 1 x bts (candidates: 11) 21:47:55.099938 tst gprs:nanobts+band-900: Verifying 9 x ip_address (candidates: 9) 21:47:55.139526 tst gprs:nanobts+band-900: Verifying 4 x modem (candidates: 12) 21:47:55.227952 tst gprs:nanobts+band-900: Reserving 1 x bts (candidates: 11) 21:47:55.261186 tst gprs:nanobts+band-900: Reserving 9 x ip_address (candidates: 9) 21:47:55.300639 tst gprs:nanobts+band-900: Reserving 4 x modem (candidates: 12) 21:47:55.894631 tst gprs:nanobts+band-900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2382 gprs:nanobts+band-900 cs_paging_gprs_active.py ---------------------------------------------- 21:47:55.949146 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:47:55.960254 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 21:47:56.008758 tst cs_paging_gprs_active.py: using LAC 31718 21:47:56.138487 tst cs_paging_gprs_active.py: using RAC 98 21:47:56.266552 tst cs_paging_gprs_active.py: using CellId 31718 21:47:56.396069 tst cs_paging_gprs_active.py: using BVCI 31719 21:47:56.516159 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:47:56.527441 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:47:56.538447 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:47:56.549677 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:47:56.560856 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:47:56.572115 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:47:56.583493 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:47:56.594622 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:47:56.605994 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 21:47:56.723802 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 21:47:56.847415 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 21:47:57.072143 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:47:57.403872 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31645): Launched 21:47:57.691139 run iperf3-srv_10.42.42.10(pid=31646): Launched 21:47:57.815601 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 21:47:58.039354 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:47:58.371760 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31647): Launched 21:47:58.658655 run iperf3-srv_10.42.42.10(pid=31648): Launched 21:47:58.782906 tst cs_paging_gprs_active.py:38: start network... 21:47:59.007465 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:47:59.522152 run create_hlr_db(pid=31649): Launched 21:47:59.648370 bus /sierra_2: Setting Powered False 21:48:00.713984 run create_hlr_db(pid=31649): Terminated: ok {rc=0} 21:48:01.209311 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31651): Launched 21:48:01.558097 run osmo-hlr_10.42.42.2(pid=31652): Launched 21:48:01.807231 run osmo-stp_10.42.42.5: Starting osmo-stp 21:48:02.469670 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31654): Launched 21:48:02.801079 run osmo-stp_10.42.42.5(pid=31655): Launched 21:48:02.928081 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:48:03.499561 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31657): Launched 21:48:03.626198 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:48:03.906966 run patchelf(pid=31658): Launched 21:48:04.090161 run osmo-stp_10.42.42.5(pid=31655): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31655)] 21:48:04.229767 run osmo-stp_10.42.42.5(pid=31655): stdout: | (launched: 2022-12-12_21:48:02.740497) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:48:04.371330 run osmo-stp_10.42.42.5(pid=31655): stderr: | 20221212214802936 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214802936 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214802936 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214802936 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214802937 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214802937 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214802937 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:48:04.512510 run osmo-stp_10.42.42.5(pid=31655): stdout: | (launched: 2022-12-12_21:48:02.740497) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:48:04.648421 run osmo-stp_10.42.42.5(pid=31655): stderr: | 20221212214802936 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214802936 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214802936 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214802936 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214802937 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214802937 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214802937 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:48:04.810000 run patchelf(pid=31658): Terminating (SIGINT) 21:48:04.996411 run patchelf(pid=31658): Terminated: ok {rc=0} 21:48:05.131369 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=31655): Process ended prematurely: osmo-stp_10.42.42.5(pid=31655) [trial-2382↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31655)] [trial-2382↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38] 21:48:05.141708 tst cs_paging_gprs_active.py:38: Test FAILED (9.2 sec) 21:48:05.171286 run osmo-hlr_10.42.42.2(pid=31652): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:nanobts+band-900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31652)] 21:48:05.222330 run osmo-hlr_10.42.42.2(pid=31652): stdout: | (launched: 2022-12-12_21:48:01.495461) 21:48:05.275230 run osmo-hlr_10.42.42.2(pid=31652): stderr: | 20221212214801800 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212214801800 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212214801809 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212214801809 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212214801809 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212214801809 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212214801820 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:nanobts+band-900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212214801828 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212214801828 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212214801828 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:48:05.328844 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31645): Terminating (SIGTERM) 21:48:05.371360 run iperf3-srv_10.42.42.10(pid=31646): Terminating (SIGTERM) 21:48:05.413918 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31647): Terminating (SIGTERM) 21:48:05.456320 run iperf3-srv_10.42.42.10(pid=31648): Terminating (SIGTERM) 21:48:05.498689 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31651): Terminating (SIGTERM) 21:48:05.541779 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31654): Terminating (SIGTERM) 21:48:05.584300 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31657): Terminating (SIGTERM) 21:48:05.627228 --- ParallelTerminationStrategy: PID 31645 died... 21:48:05.647504 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31645): Terminated: ok {rc=0} 21:48:05.695270 --- ParallelTerminationStrategy: PID 31646 died... 21:48:05.715066 run iperf3-srv_10.42.42.10(pid=31646): Terminated {rc=256} 21:48:05.762979 --- ParallelTerminationStrategy: PID 31647 died... 21:48:05.782780 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31647): Terminated: ok {rc=0} 21:48:05.829894 --- ParallelTerminationStrategy: PID 31648 died... 21:48:05.849571 run iperf3-srv_10.42.42.10(pid=31648): Terminated {rc=256} 21:48:05.896273 --- ParallelTerminationStrategy: PID 31651 died... 21:48:05.916040 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31651): Terminated: ok {rc=0} 21:48:05.963050 --- ParallelTerminationStrategy: PID 31654 died... 21:48:05.982818 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31654): Terminated: ok {rc=0} 21:48:06.029743 --- ParallelTerminationStrategy: PID 31657 died... 21:48:06.049480 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31657): Terminated: ok {rc=0} 21:48:06.138356 bus /gobi_0: Setting Powered False 21:48:07.236364 bus /gobi_0: Setting Powered False 21:48:08.353220 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:nanobts+band-900 iperf3.py ---------------------------------------------- 21:48:09.502018 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:48:09.513245 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 21:48:09.562403 tst iperf3.py: using LAC 31719 21:48:09.683426 tst iperf3.py: using RAC 99 21:48:09.806063 tst iperf3.py: using CellId 31719 21:48:09.927263 tst iperf3.py: using BVCI 31720 21:48:10.041239 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:48:10.051912 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:48:10.062482 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:48:10.072885 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:48:10.083297 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:48:10.093745 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:48:10.104279 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:48:10.114738 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:48:10.125347 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 21:48:10.239799 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 21:48:10.447383 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:48:10.757111 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31659): Launched 21:48:11.025854 run iperf3-srv_10.42.42.10(pid=31660): Launched 21:48:11.141227 tst iperf3.py:8: start network... 21:48:11.349081 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:48:11.827914 run create_hlr_db(pid=31661): Launched 21:48:11.954078 bus /gobi_6: Setting Powered False 21:48:13.016084 run create_hlr_db(pid=31661): Terminated: ok {rc=0} 21:48:13.467024 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31663): Launched 21:48:13.798915 run osmo-hlr_10.42.42.2(pid=31664): Launched 21:48:13.925966 run osmo-stp_10.42.42.5: Starting osmo-stp 21:48:14.500001 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31666): Launched 21:48:14.830995 run osmo-stp_10.42.42.5(pid=31667): Launched 21:48:14.957306 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:48:15.528300 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31669): Launched 21:48:15.656447 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:48:15.945760 run patchelf(pid=31670): Launched 21:48:16.142623 run osmo-stp_10.42.42.5(pid=31667): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31667)] 21:48:16.279545 run osmo-stp_10.42.42.5(pid=31667): stdout: | (launched: 2022-12-12_21:48:14.770911) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:48:16.418123 run osmo-stp_10.42.42.5(pid=31667): stderr: | 20221212214814963 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214814964 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214814964 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214814964 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214814965 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214814965 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214814965 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:48:16.555655 run osmo-stp_10.42.42.5(pid=31667): stdout: | (launched: 2022-12-12_21:48:14.770911) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:48:16.687819 run osmo-stp_10.42.42.5(pid=31667): stderr: | 20221212214814963 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214814964 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214814964 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214814964 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214814965 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214814965 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214814965 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:48:16.843100 run patchelf(pid=31670): Terminating (SIGINT) 21:48:17.024059 run patchelf(pid=31670): Terminated: ok {rc=0} 21:48:17.154682 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31667): Process ended prematurely: osmo-stp_10.42.42.5(pid=31667) [trial-2382↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31667)] [trial-2382↪gprs:nanobts+band-900↪iperf3.py:8] 21:48:17.164779 tst iperf3.py:8: Test FAILED (7.7 sec) 21:48:17.193484 run osmo-hlr_10.42.42.2(pid=31664): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:nanobts+band-900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31664)] 21:48:17.243100 run osmo-hlr_10.42.42.2(pid=31664): stdout: | (launched: 2022-12-12_21:48:13.738473) 21:48:17.293446 run osmo-hlr_10.42.42.2(pid=31664): stderr: | 20221212214813939 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212214813939 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212214813939 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212214813939 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212214813939 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212214813939 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212214813952 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:nanobts+band-900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212214813962 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212214813962 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212214813962 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:48:17.343868 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31659): Terminating (SIGTERM) 21:48:17.384707 run iperf3-srv_10.42.42.10(pid=31660): Terminating (SIGTERM) 21:48:17.425224 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31663): Terminating (SIGTERM) 21:48:17.465817 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31666): Terminating (SIGTERM) 21:48:17.506297 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31669): Terminating (SIGTERM) 21:48:17.547081 --- ParallelTerminationStrategy: PID 31659 died... 21:48:17.566717 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31659): Terminated: ok {rc=0} 21:48:17.612208 --- ParallelTerminationStrategy: PID 31660 died... 21:48:17.631294 run iperf3-srv_10.42.42.10(pid=31660): Terminated {rc=256} 21:48:17.676268 --- ParallelTerminationStrategy: PID 31663 died... 21:48:17.695158 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31663): Terminated: ok {rc=0} 21:48:17.740217 --- ParallelTerminationStrategy: PID 31666 died... 21:48:17.759310 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31666): Terminated: ok {rc=0} 21:48:17.804296 --- ParallelTerminationStrategy: PID 31669 died... 21:48:17.823347 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31669): Terminated: ok {rc=0} 21:48:17.908375 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:nanobts+band-900 iperf3m4.py ---------------------------------------------- 21:48:19.053747 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:48:19.064987 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 21:48:19.112751 tst iperf3m4.py: using LAC 31720 21:48:19.239627 tst iperf3m4.py: using RAC 100 21:48:19.360287 tst iperf3m4.py: using CellId 31720 21:48:19.480836 tst iperf3m4.py: using BVCI 31721 21:48:19.592878 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:48:19.603747 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:48:19.614348 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:48:19.624842 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:48:19.635408 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:48:19.646023 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:48:19.656765 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:48:19.667283 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:48:19.678166 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 21:48:19.799232 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 21:48:19.922334 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 21:48:20.043985 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 21:48:20.163815 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 21:48:20.372125 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:48:20.681777 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31671): Launched 21:48:20.952027 run iperf3-srv_10.42.42.10(pid=31679): Launched 21:48:21.067556 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 21:48:21.275620 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:48:21.586017 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31680): Launched 21:48:21.853309 run iperf3-srv_10.42.42.10(pid=31681): Launched 21:48:21.968747 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 21:48:22.175775 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:48:22.484875 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31682): Launched 21:48:22.752637 run iperf3-srv_10.42.42.10(pid=31683): Launched 21:48:22.868285 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 21:48:23.074485 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:48:23.384480 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31684): Launched 21:48:23.652127 run iperf3-srv_10.42.42.10(pid=31685): Launched 21:48:23.767802 tst iperf3m4.py:8: start network... 21:48:23.975135 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:48:24.453716 run create_hlr_db(pid=31686): Launched 21:48:24.580018 bus /gobi_6: Setting Powered False 21:48:25.641159 run create_hlr_db(pid=31686): Terminated: ok {rc=0} 21:48:26.093754 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31688): Launched 21:48:26.426354 run osmo-hlr_10.42.42.2(pid=31689): Launched 21:48:26.553812 run osmo-stp_10.42.42.5: Starting osmo-stp 21:48:27.131740 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31691): Launched 21:48:27.465066 run osmo-stp_10.42.42.5(pid=31692): Launched 21:48:27.594036 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:48:28.167521 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31694): Launched 21:48:28.293989 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:48:28.574224 run patchelf(pid=31695): Launched 21:48:28.758959 run osmo-stp_10.42.42.5(pid=31692): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31692)] 21:48:28.899912 run osmo-stp_10.42.42.5(pid=31692): stdout: | (launched: 2022-12-12_21:48:27.404512) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:48:29.041341 run osmo-stp_10.42.42.5(pid=31692): stderr: | 20221212214827600 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214827600 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214827601 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214827601 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214827601 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214827601 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214827602 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:48:29.183097 run osmo-stp_10.42.42.5(pid=31692): stdout: | (launched: 2022-12-12_21:48:27.404512) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:48:29.319213 run osmo-stp_10.42.42.5(pid=31692): stderr: | 20221212214827600 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214827600 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214827601 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214827601 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214827601 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214827601 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214827602 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:48:29.480345 run patchelf(pid=31695): Terminating (SIGINT) 21:48:29.667463 run patchelf(pid=31695): Terminated: ok {rc=0} 21:48:29.802531 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31692): Process ended prematurely: osmo-stp_10.42.42.5(pid=31692) [trial-2382↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31692)] [trial-2382↪gprs:nanobts+band-900↪iperf3m4.py:8] 21:48:29.812873 tst iperf3m4.py:8: Test FAILED (10.8 sec) 21:48:29.842766 run osmo-hlr_10.42.42.2(pid=31689): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:nanobts+band-900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31689)] 21:48:29.894069 run osmo-hlr_10.42.42.2(pid=31689): stdout: | (launched: 2022-12-12_21:48:26.366057) 21:48:29.947080 run osmo-hlr_10.42.42.2(pid=31689): stderr: | 20221212214826566 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212214826566 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212214826566 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212214826566 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212214826566 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212214826566 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212214826583 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:nanobts+band-900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212214826593 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212214826593 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212214826593 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:48:30.000529 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31671): Terminating (SIGTERM) 21:48:30.043430 run iperf3-srv_10.42.42.10(pid=31679): Terminating (SIGTERM) 21:48:30.086238 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31680): Terminating (SIGTERM) 21:48:30.128883 run iperf3-srv_10.42.42.10(pid=31681): Terminating (SIGTERM) 21:48:30.171469 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31682): Terminating (SIGTERM) 21:48:30.214168 run iperf3-srv_10.42.42.10(pid=31683): Terminating (SIGTERM) 21:48:30.256661 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31684): Terminating (SIGTERM) 21:48:30.299297 run iperf3-srv_10.42.42.10(pid=31685): Terminating (SIGTERM) 21:48:30.341846 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31688): Terminating (SIGTERM) 21:48:30.384327 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31691): Terminating (SIGTERM) 21:48:30.427269 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31694): Terminating (SIGTERM) 21:48:30.469952 --- ParallelTerminationStrategy: PID 31671 died... 21:48:30.490352 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31671): Terminated: ok {rc=0} 21:48:30.537601 --- ParallelTerminationStrategy: PID 31679 died... 21:48:30.557353 run iperf3-srv_10.42.42.10(pid=31679): Terminated {rc=256} 21:48:30.604847 --- ParallelTerminationStrategy: PID 31680 died... 21:48:30.625010 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31680): Terminated: ok {rc=0} 21:48:30.672177 --- ParallelTerminationStrategy: PID 31681 died... 21:48:30.691966 run iperf3-srv_10.42.42.10(pid=31681): Terminated {rc=256} 21:48:30.739002 --- ParallelTerminationStrategy: PID 31682 died... 21:48:30.758819 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31682): Terminated: ok {rc=0} 21:48:30.806918 --- ParallelTerminationStrategy: PID 31683 died... 21:48:30.827156 run iperf3-srv_10.42.42.10(pid=31683): Terminated {rc=256} 21:48:30.896647 --- ParallelTerminationStrategy: PID 31684 died... 21:48:30.918967 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31684): Terminated: ok {rc=0} 21:48:30.966807 --- ParallelTerminationStrategy: PID 31685 died... 21:48:30.986708 run iperf3-srv_10.42.42.10(pid=31685): Terminated {rc=256} 21:48:31.033208 --- ParallelTerminationStrategy: PID 31688 died... 21:48:31.052807 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31688): Terminated: ok {rc=0} 21:48:31.100468 --- ParallelTerminationStrategy: PID 31691 died... 21:48:31.120809 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31691): Terminated: ok {rc=0} 21:48:31.169074 --- ParallelTerminationStrategy: PID 31694 died... 21:48:31.189534 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31694): Terminated: ok {rc=0} 21:48:31.278068 bus /gobi_4: Setting Powered False 21:48:32.380560 bus /gobi_4: Setting Powered False 21:48:33.497431 bus /gobi_1: Setting Powered False 21:48:34.596469 bus /gobi_1: Setting Powered False 21:48:35.713549 bus /gobi_0: Setting Powered False 21:48:36.811823 bus /gobi_0: Setting Powered False 21:48:37.929071 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:nanobts+band-900 ping.py ---------------------------------------------- 21:48:39.034104 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:48:39.045530 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 21:48:39.096525 tst ping.py: using LAC 31721 21:48:39.224075 tst ping.py: using RAC 101 21:48:39.350389 tst ping.py: using CellId 31721 21:48:39.469746 tst ping.py: using BVCI 31722 21:48:39.582185 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:48:39.593156 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:48:39.603735 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:48:39.614274 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:48:39.624696 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:48:39.635197 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:48:39.645864 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:48:39.656336 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 21:48:39.770577 tst ping.py:19: start network... 21:48:39.974608 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:48:40.443644 run create_hlr_db(pid=31696): Launched 21:48:40.567571 bus /gobi_6: Setting Powered False 21:48:41.628133 run create_hlr_db(pid=31696): Terminated: ok {rc=0} 21:48:42.050757 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31698): Launched 21:48:42.353269 run osmo-hlr_10.42.42.2(pid=31699): Launched 21:48:42.468336 run osmo-stp_10.42.42.5: Starting osmo-stp 21:48:42.991532 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31701): Launched 21:48:43.293026 run osmo-stp_10.42.42.5(pid=31702): Launched 21:48:43.408255 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:48:43.932266 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31704): Launched 21:48:44.047877 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:48:44.303792 run patchelf(pid=31705): Launched 21:48:44.472631 run osmo-stp_10.42.42.5(pid=31702): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31702)] 21:48:44.601411 run osmo-stp_10.42.42.5(pid=31702): stdout: | (launched: 2022-12-12_21:48:43.237785) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:48:44.731455 run osmo-stp_10.42.42.5(pid=31702): stderr: | 20221212214843409 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214843409 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214843409 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214843410 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214843410 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214843410 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214843410 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:48:44.861593 run osmo-stp_10.42.42.5(pid=31702): stdout: | (launched: 2022-12-12_21:48:43.237785) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:48:44.986128 run osmo-stp_10.42.42.5(pid=31702): stderr: | 20221212214843409 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214843409 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214843409 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214843410 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214843410 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214843410 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214843410 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:48:45.133811 run patchelf(pid=31705): Terminating (SIGINT) 21:48:45.304359 run patchelf(pid=31705): Terminated: ok {rc=0} 21:48:45.428116 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=31702): Process ended prematurely: osmo-stp_10.42.42.5(pid=31702) [trial-2382↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31702)] [trial-2382↪gprs:nanobts+band-900↪ping.py:22] 21:48:45.437082 tst ping.py:22: Test FAILED (6.4 sec) 21:48:45.464594 run osmo-hlr_10.42.42.2(pid=31699): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:nanobts+band-900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31699)] 21:48:45.513249 run osmo-hlr_10.42.42.2(pid=31699): stdout: | (launched: 2022-12-12_21:48:42.297587) 21:48:45.563546 run osmo-hlr_10.42.42.2(pid=31699): stderr: | 20221212214842473 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212214842473 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212214842473 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212214842473 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212214842473 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212214842474 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212214842495 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:nanobts+band-900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212214842504 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212214842504 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212214842505 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:48:45.614282 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31698): Terminating (SIGTERM) 21:48:45.654588 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31701): Terminating (SIGTERM) 21:48:45.694922 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31704): Terminating (SIGTERM) 21:48:45.735478 --- ParallelTerminationStrategy: PID 31698 died... 21:48:45.755072 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31698): Terminated: ok {rc=0} 21:48:45.800285 --- ParallelTerminationStrategy: PID 31701 died... 21:48:45.819614 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31701): Terminated: ok {rc=0} 21:48:45.866271 --- ParallelTerminationStrategy: PID 31704 died... 21:48:45.885966 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31704): Terminated: ok {rc=0} 21:48:45.978150 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:nanobts+band-900 ping_idle_ping.py ---------------------------------------------- 21:48:47.066182 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:48:47.079030 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 21:48:47.132277 tst ping_idle_ping.py: using LAC 31722 21:48:47.263736 tst ping_idle_ping.py: using RAC 102 21:48:47.384476 tst ping_idle_ping.py: using CellId 31722 21:48:47.506831 tst ping_idle_ping.py: using BVCI 31723 21:48:47.618738 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:48:47.629560 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:48:47.640196 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:48:47.650797 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:48:47.661407 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:48:47.671931 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:48:47.682627 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:48:47.693323 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 21:48:47.812890 tst ping_idle_ping.py:24: start network... 21:48:48.033983 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:48:48.542919 run create_hlr_db(pid=31706): Launched 21:48:48.668340 bus /gobi_6: Setting Powered False 21:48:49.733443 run create_hlr_db(pid=31706): Terminated: ok {rc=0} 21:48:50.168304 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31708): Launched 21:48:50.495340 run osmo-hlr_10.42.42.2(pid=31709): Launched 21:48:50.621417 run osmo-stp_10.42.42.5: Starting osmo-stp 21:48:51.185991 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31711): Launched 21:48:51.512173 run osmo-stp_10.42.42.5(pid=31712): Launched 21:48:51.637607 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:48:52.202271 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31714): Launched 21:48:52.326571 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:48:52.602240 run patchelf(pid=31715): Launched 21:48:52.783783 run osmo-stp_10.42.42.5(pid=31712): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31712)] 21:48:52.921878 run osmo-stp_10.42.42.5(pid=31712): stdout: | (launched: 2022-12-12_21:48:51.452471) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:48:53.061591 run osmo-stp_10.42.42.5(pid=31712): stderr: | 20221212214851647 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214851647 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214851647 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214851648 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214851650 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214851650 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214851650 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:48:53.201506 run osmo-stp_10.42.42.5(pid=31712): stdout: | (launched: 2022-12-12_21:48:51.452471) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:48:53.335454 run osmo-stp_10.42.42.5(pid=31712): stderr: | 20221212214851647 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214851647 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214851647 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214851648 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214851650 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214851650 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214851650 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:48:53.494099 run patchelf(pid=31715): Terminating (SIGINT) 21:48:53.678953 run patchelf(pid=31715): Terminated: ok {rc=0} 21:48:53.812340 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=31712): Process ended prematurely: osmo-stp_10.42.42.5(pid=31712) [trial-2382↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31712)] [trial-2382↪gprs:nanobts+band-900↪ping_idle_ping.py:27] 21:48:53.821872 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 21:48:53.851346 run osmo-hlr_10.42.42.2(pid=31709): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:nanobts+band-900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31709)] 21:48:53.902516 run osmo-hlr_10.42.42.2(pid=31709): stdout: | (launched: 2022-12-12_21:48:50.436100) 21:48:53.955582 run osmo-hlr_10.42.42.2(pid=31709): stderr: | 20221212214850634 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212214850634 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212214850634 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212214850634 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212214850634 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212214850634 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212214850648 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:nanobts+band-900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212214850656 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212214850656 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212214850656 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:48:54.009329 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31708): Terminating (SIGTERM) 21:48:54.051997 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31711): Terminating (SIGTERM) 21:48:54.094676 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31714): Terminating (SIGTERM) 21:48:54.137866 --- ParallelTerminationStrategy: PID 31708 died... 21:48:54.158295 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31708): Terminated: ok {rc=0} 21:48:54.205809 --- ParallelTerminationStrategy: PID 31711 died... 21:48:54.225821 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31711): Terminated: ok {rc=0} 21:48:54.273366 --- ParallelTerminationStrategy: PID 31714 died... 21:48:54.293333 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31714): Terminated: ok {rc=0} 21:48:54.382717 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2382 gprs:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 gprs:nanobts+band-900+mod-bts0-egprs --------------------------------------------------------------------- 21:48:55.692054 tst gprs:nanobts+band-900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:48:55.698887 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 21:48:55.732605 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 21:48:55.771973 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 21:48:55.861133 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 21:48:55.894277 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 21:48:55.933770 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 21:48:56.535266 tst gprs:nanobts+band-900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2382 gprs:nanobts+band-900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 21:48:56.588839 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:48:56.600254 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:48:56.650261 tst cs_paging_gprs_active.py: using LAC 31723 21:48:56.779529 tst cs_paging_gprs_active.py: using RAC 103 21:48:56.909380 tst cs_paging_gprs_active.py: using CellId 31723 21:48:57.040810 tst cs_paging_gprs_active.py: using BVCI 31724 21:48:57.161519 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:48:57.173056 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:48:57.184265 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:48:57.195796 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:48:57.207168 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:48:57.218766 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:48:57.230417 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:48:57.241896 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:48:57.253546 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:48:57.371685 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:48:57.492348 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 21:48:57.718332 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:48:58.052400 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31720): Launched 21:48:58.341296 run iperf3-srv_10.42.42.10(pid=31721): Launched 21:48:58.466701 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 21:48:58.692216 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:48:59.027346 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31722): Launched 21:48:59.315956 run iperf3-srv_10.42.42.10(pid=31723): Launched 21:48:59.441063 tst cs_paging_gprs_active.py:38: start network... 21:48:59.666880 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:49:00.183334 run create_hlr_db(pid=31724): Launched 21:49:00.309951 bus /gobi_6: Setting Powered False 21:49:01.375214 run create_hlr_db(pid=31724): Terminated: ok {rc=0} 21:49:01.852369 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31726): Launched 21:49:02.228314 run osmo-hlr_10.42.42.2(pid=31727): Launched 21:49:02.347840 run osmo-stp_10.42.42.5: Starting osmo-stp 21:49:02.881046 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31729): Launched 21:49:03.189575 run osmo-stp_10.42.42.5(pid=31730): Launched 21:49:03.308131 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:49:03.845363 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31732): Launched 21:49:03.963670 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:49:04.227046 run patchelf(pid=31733): Launched 21:49:04.398866 run osmo-stp_10.42.42.5(pid=31730): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31730)] 21:49:04.528927 run osmo-stp_10.42.42.5(pid=31730): stdout: | (launched: 2022-12-12_21:49:03.133081) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:49:04.660854 run osmo-stp_10.42.42.5(pid=31730): stderr: | 20221212214903305 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214903305 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214903306 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214903306 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214903306 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214903307 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214903307 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:49:04.792605 run osmo-stp_10.42.42.5(pid=31730): stdout: | (launched: 2022-12-12_21:49:03.133081) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:49:04.919189 run osmo-stp_10.42.42.5(pid=31730): stderr: | 20221212214903305 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214903305 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214903306 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214903306 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214903306 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214903307 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214903307 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:49:05.068696 run patchelf(pid=31733): Terminating (SIGINT) 21:49:05.242642 run patchelf(pid=31733): Terminated: ok {rc=0} 21:49:05.368218 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=31730): Process ended prematurely: osmo-stp_10.42.42.5(pid=31730) [trial-2382↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31730)] [trial-2382↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 21:49:05.377695 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 21:49:05.405156 run osmo-hlr_10.42.42.2(pid=31727): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31727)] 21:49:05.453318 run osmo-hlr_10.42.42.2(pid=31727): stdout: | (launched: 2022-12-12_21:49:02.172363) 21:49:05.503208 run osmo-hlr_10.42.42.2(pid=31727): stderr: | 20221212214902346 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212214902346 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212214902346 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212214902346 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212214902346 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212214902346 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212214902359 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:nanobts+band-900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212214902369 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212214902369 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212214902370 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:49:05.553589 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31720): Terminating (SIGTERM) 21:49:05.594211 run iperf3-srv_10.42.42.10(pid=31721): Terminating (SIGTERM) 21:49:05.634285 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31722): Terminating (SIGTERM) 21:49:05.674216 run iperf3-srv_10.42.42.10(pid=31723): Terminating (SIGTERM) 21:49:05.715385 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31726): Terminating (SIGTERM) 21:49:05.756009 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31729): Terminating (SIGTERM) 21:49:05.795973 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31732): Terminating (SIGTERM) 21:49:05.836342 --- ParallelTerminationStrategy: PID 31720 died... 21:49:05.855561 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31720): Terminated: ok {rc=0} 21:49:05.900212 --- ParallelTerminationStrategy: PID 31721 died... 21:49:05.918800 run iperf3-srv_10.42.42.10(pid=31721): Terminated {rc=256} 21:49:05.963649 --- ParallelTerminationStrategy: PID 31722 died... 21:49:05.982664 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31722): Terminated: ok {rc=0} 21:49:06.027621 --- ParallelTerminationStrategy: PID 31723 died... 21:49:06.046525 run iperf3-srv_10.42.42.10(pid=31723): Terminated {rc=256} 21:49:06.091439 --- ParallelTerminationStrategy: PID 31726 died... 21:49:06.110355 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31726): Terminated: ok {rc=0} 21:49:06.155324 --- ParallelTerminationStrategy: PID 31729 died... 21:49:06.174140 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31729): Terminated: ok {rc=0} 21:49:06.218319 --- ParallelTerminationStrategy: PID 31732 died... 21:49:06.236916 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31732): Terminated: ok {rc=0} 21:49:06.323796 bus /gobi_0: Setting Powered False 21:49:07.425538 bus /gobi_0: Setting Powered False 21:49:08.539859 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:nanobts+band-900+mod-bts0-egprs iperf3.py ---------------------------------------------- 21:49:09.691548 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:49:09.703444 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:49:09.756843 tst iperf3.py: using LAC 31724 21:49:09.880346 tst iperf3.py: using RAC 104 21:49:10.004696 tst iperf3.py: using CellId 31724 21:49:10.128386 tst iperf3.py: using BVCI 31725 21:49:10.250949 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:49:10.262580 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:49:10.274047 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:49:10.285826 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:49:10.297389 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:49:10.308859 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:49:10.320603 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:49:10.331999 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:49:10.343571 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:49:10.462001 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 21:49:10.671524 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:49:10.982144 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31734): Launched 21:49:11.251881 run iperf3-srv_10.42.42.10(pid=31735): Launched 21:49:11.368068 tst iperf3.py:8: start network... 21:49:11.576731 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:49:12.058041 run create_hlr_db(pid=31736): Launched 21:49:12.184805 bus /gobi_6: Setting Powered False 21:49:13.247419 run create_hlr_db(pid=31736): Terminated: ok {rc=0} 21:49:13.698341 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31738): Launched 21:49:14.031067 run osmo-hlr_10.42.42.2(pid=31739): Launched 21:49:14.158333 run osmo-stp_10.42.42.5: Starting osmo-stp 21:49:14.731861 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31741): Launched 21:49:15.063202 run osmo-stp_10.42.42.5(pid=31742): Launched 21:49:15.189443 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:49:15.761992 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31744): Launched 21:49:15.902890 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:49:16.192203 run patchelf(pid=31745): Launched 21:49:16.391939 run osmo-stp_10.42.42.5(pid=31742): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31742)] 21:49:16.536018 run osmo-stp_10.42.42.5(pid=31742): stdout: | (launched: 2022-12-12_21:49:15.003243) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:49:16.681418 run osmo-stp_10.42.42.5(pid=31742): stderr: | 20221212214915196 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214915196 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214915197 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214915197 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214915197 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214915197 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214915198 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:49:16.827459 run osmo-stp_10.42.42.5(pid=31742): stdout: | (launched: 2022-12-12_21:49:15.003243) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:49:16.967434 run osmo-stp_10.42.42.5(pid=31742): stderr: | 20221212214915196 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214915196 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214915197 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214915197 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214915197 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214915197 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214915198 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:49:17.134064 run patchelf(pid=31745): Terminating (SIGINT) 21:49:17.323569 run patchelf(pid=31745): Terminated: ok {rc=0} 21:49:17.458326 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31742): Process ended prematurely: osmo-stp_10.42.42.5(pid=31742) [trial-2382↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31742)] [trial-2382↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8] 21:49:17.468762 tst iperf3.py:8: Test FAILED (7.8 sec) 21:49:17.498848 run osmo-hlr_10.42.42.2(pid=31739): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31739)] 21:49:17.550038 run osmo-hlr_10.42.42.2(pid=31739): stdout: | (launched: 2022-12-12_21:49:13.971026) 21:49:17.603372 run osmo-hlr_10.42.42.2(pid=31739): stderr: | 20221212214914171 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212214914171 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212214914171 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212214914171 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212214914171 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212214914172 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212214914185 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:nanobts+band-900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212214914194 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212214914195 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212214914195 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:49:17.657125 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31734): Terminating (SIGTERM) 21:49:17.700079 run iperf3-srv_10.42.42.10(pid=31735): Terminating (SIGTERM) 21:49:17.743020 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31738): Terminating (SIGTERM) 21:49:17.786080 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31741): Terminating (SIGTERM) 21:49:17.828561 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31744): Terminating (SIGTERM) 21:49:17.871852 --- ParallelTerminationStrategy: PID 31734 died... 21:49:17.892292 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31734): Terminated: ok {rc=0} 21:49:17.940014 --- ParallelTerminationStrategy: PID 31735 died... 21:49:17.959893 run iperf3-srv_10.42.42.10(pid=31735): Terminated {rc=256} 21:49:18.007322 --- ParallelTerminationStrategy: PID 31738 died... 21:49:18.027413 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31738): Terminated: ok {rc=0} 21:49:18.074992 --- ParallelTerminationStrategy: PID 31741 died... 21:49:18.094911 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31741): Terminated: ok {rc=0} 21:49:18.142778 --- ParallelTerminationStrategy: PID 31744 died... 21:49:18.162778 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31744): Terminated: ok {rc=0} 21:49:18.252896 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:nanobts+band-900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 21:49:19.408021 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:49:19.420136 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:49:19.471214 tst iperf3m4.py: using LAC 31725 21:49:19.596013 tst iperf3m4.py: using RAC 105 21:49:19.720768 tst iperf3m4.py: using CellId 31725 21:49:19.844358 tst iperf3m4.py: using BVCI 31726 21:49:19.960176 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:49:19.971347 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:49:19.982380 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:49:19.993936 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:49:20.005508 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:49:20.016882 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:49:20.028610 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:49:20.040027 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:49:20.051485 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:49:20.172392 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:49:20.297885 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:49:20.418660 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:49:20.540599 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 21:49:20.767723 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:49:21.082176 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31746): Launched 21:49:21.352765 run iperf3-srv_10.42.42.10(pid=31747): Launched 21:49:21.470218 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 21:49:21.679183 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:49:21.990928 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31748): Launched 21:49:22.260577 run iperf3-srv_10.42.42.10(pid=31749): Launched 21:49:22.376240 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 21:49:22.583983 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:49:22.894893 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31750): Launched 21:49:23.164504 run iperf3-srv_10.42.42.10(pid=31751): Launched 21:49:23.280292 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 21:49:23.487520 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:49:23.798667 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31752): Launched 21:49:24.066763 run iperf3-srv_10.42.42.10(pid=31753): Launched 21:49:24.182357 tst iperf3m4.py:8: start network... 21:49:24.389431 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:49:24.868202 run create_hlr_db(pid=31754): Launched 21:49:24.993713 bus /gobi_6: Setting Powered False 21:49:26.056035 run create_hlr_db(pid=31754): Terminated: ok {rc=0} 21:49:26.506561 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31756): Launched 21:49:26.839854 run osmo-hlr_10.42.42.2(pid=31757): Launched 21:49:26.967952 run osmo-stp_10.42.42.5: Starting osmo-stp 21:49:27.542024 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31759): Launched 21:49:27.875895 run osmo-stp_10.42.42.5(pid=31760): Launched 21:49:28.002479 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:49:28.574757 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31762): Launched 21:49:28.701534 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:49:28.983134 run patchelf(pid=31763): Launched 21:49:29.167345 run osmo-stp_10.42.42.5(pid=31760): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31760)] 21:49:29.307481 run osmo-stp_10.42.42.5(pid=31760): stdout: | (launched: 2022-12-12_21:49:27.815090) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:49:29.449173 run osmo-stp_10.42.42.5(pid=31760): stderr: | 20221212214928010 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214928010 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214928010 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214928011 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214928011 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214928011 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214928011 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:49:29.591148 run osmo-stp_10.42.42.5(pid=31760): stdout: | (launched: 2022-12-12_21:49:27.815090) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:49:29.727738 run osmo-stp_10.42.42.5(pid=31760): stderr: | 20221212214928010 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214928010 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214928010 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214928011 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214928011 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214928011 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214928011 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:49:29.890169 run patchelf(pid=31763): Terminating (SIGINT) 21:49:30.076637 run patchelf(pid=31763): Terminated: ok {rc=0} 21:49:30.211338 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31760): Process ended prematurely: osmo-stp_10.42.42.5(pid=31760) [trial-2382↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31760)] [trial-2382↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8] 21:49:30.221706 tst iperf3m4.py:8: Test FAILED (10.9 sec) 21:49:30.251095 run osmo-hlr_10.42.42.2(pid=31757): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31757)] 21:49:30.302721 run osmo-hlr_10.42.42.2(pid=31757): stdout: | (launched: 2022-12-12_21:49:26.778860) 21:49:30.355714 run osmo-hlr_10.42.42.2(pid=31757): stderr: | 20221212214926982 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212214926982 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212214926982 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212214926982 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212214926982 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212214926983 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212214926995 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:nanobts+band-900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212214927003 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212214927004 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212214927004 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:49:30.409221 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31746): Terminating (SIGTERM) 21:49:30.451693 run iperf3-srv_10.42.42.10(pid=31747): Terminating (SIGTERM) 21:49:30.494274 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31748): Terminating (SIGTERM) 21:49:30.536621 run iperf3-srv_10.42.42.10(pid=31749): Terminating (SIGTERM) 21:49:30.580210 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31750): Terminating (SIGTERM) 21:49:30.623139 run iperf3-srv_10.42.42.10(pid=31751): Terminating (SIGTERM) 21:49:30.665079 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31752): Terminating (SIGTERM) 21:49:30.707798 run iperf3-srv_10.42.42.10(pid=31753): Terminating (SIGTERM) 21:49:30.750120 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31756): Terminating (SIGTERM) 21:49:30.792626 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31759): Terminating (SIGTERM) 21:49:30.835422 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31762): Terminating (SIGTERM) 21:49:30.879776 --- ParallelTerminationStrategy: PID 31746 died... 21:49:30.900255 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31746): Terminated: ok {rc=0} 21:49:30.948187 --- ParallelTerminationStrategy: PID 31747 died... 21:49:30.968800 run iperf3-srv_10.42.42.10(pid=31747): Terminated {rc=256} 21:49:31.016577 --- ParallelTerminationStrategy: PID 31748 died... 21:49:31.037187 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31748): Terminated: ok {rc=0} 21:49:31.085199 --- ParallelTerminationStrategy: PID 31749 died... 21:49:31.105520 run iperf3-srv_10.42.42.10(pid=31749): Terminated {rc=256} 21:49:31.153791 --- ParallelTerminationStrategy: PID 31750 died... 21:49:31.174148 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31750): Terminated: ok {rc=0} 21:49:31.222081 --- ParallelTerminationStrategy: PID 31751 died... 21:49:31.242437 run iperf3-srv_10.42.42.10(pid=31751): Terminated {rc=256} 21:49:31.290950 --- ParallelTerminationStrategy: PID 31752 died... 21:49:31.311465 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31752): Terminated: ok {rc=0} 21:49:31.359663 --- ParallelTerminationStrategy: PID 31753 died... 21:49:31.380175 run iperf3-srv_10.42.42.10(pid=31753): Terminated {rc=256} 21:49:31.428239 --- ParallelTerminationStrategy: PID 31756 died... 21:49:31.448694 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31756): Terminated: ok {rc=0} 21:49:31.496911 --- ParallelTerminationStrategy: PID 31759 died... 21:49:31.517513 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31759): Terminated: ok {rc=0} 21:49:31.565701 --- ParallelTerminationStrategy: PID 31762 died... 21:49:31.586317 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31762): Terminated: ok {rc=0} 21:49:31.680082 bus /gobi_4: Setting Powered False 21:49:32.781570 bus /gobi_4: Setting Powered False 21:49:33.901572 bus /gobi_1: Setting Powered False 21:49:35.001991 bus /gobi_1: Setting Powered False 21:49:36.119038 bus /gobi_0: Setting Powered False 21:49:37.219067 bus /gobi_0: Setting Powered False 21:49:38.337432 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:nanobts+band-900+mod-bts0-egprs ping.py ---------------------------------------------- 21:49:39.442949 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:49:39.454740 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:49:39.504650 tst ping.py: using LAC 31726 21:49:39.627648 tst ping.py: using RAC 106 21:49:39.748913 tst ping.py: using CellId 31726 21:49:39.870613 tst ping.py: using BVCI 31727 21:49:39.982677 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:49:39.993845 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:49:40.004725 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:49:40.015564 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:49:40.026362 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:49:40.037139 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:49:40.048098 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:49:40.058984 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:49:40.177201 tst ping.py:19: start network... 21:49:40.397041 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:49:40.902185 run create_hlr_db(pid=31764): Launched 21:49:41.027192 bus /gobi_6: Setting Powered False 21:49:42.091696 run create_hlr_db(pid=31764): Terminated: ok {rc=0} 21:49:42.525200 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31766): Launched 21:49:42.828284 run osmo-hlr_10.42.42.2(pid=31767): Launched 21:49:42.943663 run osmo-stp_10.42.42.5: Starting osmo-stp 21:49:43.468407 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31769): Launched 21:49:43.770273 run osmo-stp_10.42.42.5(pid=31770): Launched 21:49:43.885672 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:49:44.409499 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31772): Launched 21:49:44.526321 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:49:44.785046 run patchelf(pid=31773): Launched 21:49:44.954559 run osmo-stp_10.42.42.5(pid=31770): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31770)] 21:49:45.083269 run osmo-stp_10.42.42.5(pid=31770): stdout: | (launched: 2022-12-12_21:49:43.714813) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:49:45.213465 run osmo-stp_10.42.42.5(pid=31770): stderr: | 20221212214943887 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214943887 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214943887 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214943887 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214943888 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214943888 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214943888 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:49:45.343515 run osmo-stp_10.42.42.5(pid=31770): stdout: | (launched: 2022-12-12_21:49:43.714813) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:49:45.467920 run osmo-stp_10.42.42.5(pid=31770): stderr: | 20221212214943887 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214943887 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214943887 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214943887 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214943888 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214943888 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214943888 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:49:45.615344 run patchelf(pid=31773): Terminating (SIGINT) 21:49:45.786110 run patchelf(pid=31773): Terminated: ok {rc=0} 21:49:45.944426 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=31770): Process ended prematurely: osmo-stp_10.42.42.5(pid=31770) [trial-2382↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31770)] [trial-2382↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22] 21:49:45.954228 tst ping.py:22: Test FAILED (6.5 sec) 21:49:45.981739 run osmo-hlr_10.42.42.2(pid=31767): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31767)] 21:49:46.031483 run osmo-hlr_10.42.42.2(pid=31767): stdout: | (launched: 2022-12-12_21:49:42.772845) 21:49:46.082585 run osmo-hlr_10.42.42.2(pid=31767): stderr: | 20221212214942949 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212214942949 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212214942949 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212214942949 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212214942949 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212214942949 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212214942961 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:nanobts+band-900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212214942970 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212214942970 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212214942970 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:49:46.133940 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31766): Terminating (SIGTERM) 21:49:46.175836 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31769): Terminating (SIGTERM) 21:49:46.219258 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31772): Terminating (SIGTERM) 21:49:46.263109 --- ParallelTerminationStrategy: PID 31766 died... 21:49:46.283130 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31766): Terminated: ok {rc=0} 21:49:46.330425 --- ParallelTerminationStrategy: PID 31769 died... 21:49:46.350035 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31769): Terminated: ok {rc=0} 21:49:46.395568 --- ParallelTerminationStrategy: PID 31772 died... 21:49:46.415217 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31772): Terminated: ok {rc=0} 21:49:46.501421 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:nanobts+band-900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 21:49:47.586326 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:49:47.597936 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:49:47.650420 tst ping_idle_ping.py: using LAC 31727 21:49:47.769732 tst ping_idle_ping.py: using RAC 107 21:49:47.888074 tst ping_idle_ping.py: using CellId 31727 21:49:48.006224 tst ping_idle_ping.py: using BVCI 31728 21:49:48.116175 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:49:48.127309 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:49:48.138185 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:49:48.148933 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:49:48.159742 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:49:48.170522 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:49:48.181618 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:49:48.192438 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:49:48.311028 tst ping_idle_ping.py:24: start network... 21:49:48.532424 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:49:49.042113 run create_hlr_db(pid=31774): Launched 21:49:49.167396 bus /gobi_6: Setting Powered False 21:49:50.232190 run create_hlr_db(pid=31774): Terminated: ok {rc=0} 21:49:50.669157 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31776): Launched 21:49:50.973956 run osmo-hlr_10.42.42.2(pid=31777): Launched 21:49:51.090152 run osmo-stp_10.42.42.5: Starting osmo-stp 21:49:51.617133 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31779): Launched 21:49:51.919920 run osmo-stp_10.42.42.5(pid=31780): Launched 21:49:52.036149 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:49:52.561189 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31782): Launched 21:49:52.677129 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:49:52.934923 run patchelf(pid=31783): Launched 21:49:53.104068 run osmo-stp_10.42.42.5(pid=31780): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31780)] 21:49:53.232478 run osmo-stp_10.42.42.5(pid=31780): stdout: | (launched: 2022-12-12_21:49:51.864499) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:49:53.363770 run osmo-stp_10.42.42.5(pid=31780): stderr: | 20221212214952037 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214952037 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214952038 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214952038 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214952038 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214952039 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214952039 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:49:53.494258 run osmo-stp_10.42.42.5(pid=31780): stdout: | (launched: 2022-12-12_21:49:51.864499) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:49:53.618789 run osmo-stp_10.42.42.5(pid=31780): stderr: | 20221212214952037 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212214952037 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212214952038 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212214952038 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212214952038 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212214952039 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212214952039 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:49:53.766196 run patchelf(pid=31783): Terminating (SIGINT) 21:49:53.937747 run patchelf(pid=31783): Terminated: ok {rc=0} 21:49:54.062014 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=31780): Process ended prematurely: osmo-stp_10.42.42.5(pid=31780) [trial-2382↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31780)] [trial-2382↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27] 21:49:54.070902 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 21:49:54.098184 run osmo-hlr_10.42.42.2(pid=31777): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31777)] 21:49:54.146254 run osmo-hlr_10.42.42.2(pid=31777): stdout: | (launched: 2022-12-12_21:49:50.917870) 21:49:54.196125 run osmo-hlr_10.42.42.2(pid=31777): stderr: | 20221212214951095 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212214951095 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212214951095 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212214951095 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212214951095 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212214951095 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212214951107 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:nanobts+band-900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212214951115 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212214951116 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212214951116 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:49:54.246300 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31776): Terminating (SIGTERM) 21:49:54.286442 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31779): Terminating (SIGTERM) 21:49:54.326709 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31782): Terminating (SIGTERM) 21:49:54.367406 --- ParallelTerminationStrategy: PID 31776 died... 21:49:54.386809 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31776): Terminated: ok {rc=0} 21:49:54.431880 --- ParallelTerminationStrategy: PID 31779 died... 21:49:54.451037 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31779): Terminated: ok {rc=0} 21:49:54.495612 --- ParallelTerminationStrategy: PID 31782 died... 21:49:54.514724 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31782): Terminated: ok {rc=0} 21:49:54.602572 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2382 gprs:nanobts+band-900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 gprs:nanobts+band-900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 21:49:55.916530 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:49:55.924118 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 21:49:55.960173 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 21:49:55.998505 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 21:49:56.083908 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 21:49:56.116030 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 21:49:56.154510 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 21:49:56.754621 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2382 gprs:nanobts+band-900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 21:49:56.810969 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:49:56.822640 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 21:49:56.892095 tst cs_paging_gprs_active.py: using LAC 31728 21:49:57.021655 tst cs_paging_gprs_active.py: using RAC 108 21:49:57.144909 tst cs_paging_gprs_active.py: using CellId 31728 21:49:57.269057 tst cs_paging_gprs_active.py: using BVCI 31729 21:49:57.383819 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:49:57.394993 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:49:57.406045 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:49:57.417436 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:49:57.428336 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:49:57.439288 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:49:57.450342 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:49:57.461218 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:49:57.472238 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:49:57.591357 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:49:57.707862 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 21:49:57.917764 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:49:58.230882 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31787): Launched 21:49:58.499636 run iperf3-srv_10.42.42.10(pid=31788): Launched 21:49:58.616074 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 21:49:58.824766 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:49:59.135964 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31789): Launched 21:49:59.404642 run iperf3-srv_10.42.42.10(pid=31790): Launched 21:49:59.520833 tst cs_paging_gprs_active.py:38: start network... 21:49:59.728809 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:50:00.208418 run create_hlr_db(pid=31791): Launched 21:50:00.335394 bus /gobi_6: Setting Powered False 21:50:01.396913 run create_hlr_db(pid=31791): Terminated: ok {rc=0} 21:50:01.841197 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31796): Launched 21:50:02.178755 run osmo-hlr_10.42.42.2(pid=31797): Launched 21:50:02.321291 run osmo-stp_10.42.42.5: Starting osmo-stp 21:50:02.893915 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31799): Launched 21:50:03.226078 run osmo-stp_10.42.42.5(pid=31800): Launched 21:50:03.354208 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:50:03.927800 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31802): Launched 21:50:04.055636 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:50:04.337915 run patchelf(pid=31804): Launched 21:50:04.523648 run osmo-stp_10.42.42.5(pid=31800): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31800)] 21:50:04.664881 run osmo-stp_10.42.42.5(pid=31800): stdout: | (launched: 2022-12-12_21:50:03.166091) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:50:04.807612 run osmo-stp_10.42.42.5(pid=31800): stderr: | 20221212215003359 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212215003359 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212215003359 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212215003359 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212215003362 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212215003362 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212215003362 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:50:04.950862 run osmo-stp_10.42.42.5(pid=31800): stdout: | (launched: 2022-12-12_21:50:03.166091) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:50:05.087785 run osmo-stp_10.42.42.5(pid=31800): stderr: | 20221212215003359 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212215003359 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212215003359 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212215003359 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212215003362 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212215003362 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212215003362 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:50:05.250852 run patchelf(pid=31804): Terminating (SIGINT) 21:50:05.439235 run patchelf(pid=31804): Terminated: ok {rc=0} 21:50:05.574693 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=31800): Process ended prematurely: osmo-stp_10.42.42.5(pid=31800) [trial-2382↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31800)] [trial-2382↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 21:50:05.585003 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 21:50:05.615026 run osmo-hlr_10.42.42.2(pid=31797): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31797)] 21:50:05.666443 run osmo-hlr_10.42.42.2(pid=31797): stdout: | (launched: 2022-12-12_21:50:02.115126) 21:50:05.720061 run osmo-hlr_10.42.42.2(pid=31797): stderr: | 20221212215002315 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212215002315 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212215002315 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212215002315 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212215002315 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212215002315 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212215002327 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:nanobts+band-900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212215002335 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212215002335 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212215002336 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:50:05.773774 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31787): Terminating (SIGTERM) 21:50:05.816795 run iperf3-srv_10.42.42.10(pid=31788): Terminating (SIGTERM) 21:50:05.859777 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31789): Terminating (SIGTERM) 21:50:05.903051 run iperf3-srv_10.42.42.10(pid=31790): Terminating (SIGTERM) 21:50:05.945805 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31796): Terminating (SIGTERM) 21:50:05.988536 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31799): Terminating (SIGTERM) 21:50:06.031380 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31802): Terminating (SIGTERM) 21:50:06.074516 --- ParallelTerminationStrategy: PID 31787 died... 21:50:06.095144 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31787): Terminated: ok {rc=0} 21:50:06.142844 --- ParallelTerminationStrategy: PID 31788 died... 21:50:06.162563 run iperf3-srv_10.42.42.10(pid=31788): Terminated {rc=256} 21:50:06.210148 --- ParallelTerminationStrategy: PID 31789 died... 21:50:06.230044 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31789): Terminated: ok {rc=0} 21:50:06.277379 --- ParallelTerminationStrategy: PID 31790 died... 21:50:06.297247 run iperf3-srv_10.42.42.10(pid=31790): Terminated {rc=256} 21:50:06.344499 --- ParallelTerminationStrategy: PID 31796 died... 21:50:06.364487 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31796): Terminated: ok {rc=0} 21:50:06.411981 --- ParallelTerminationStrategy: PID 31799 died... 21:50:06.431889 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31799): Terminated: ok {rc=0} 21:50:06.479373 --- ParallelTerminationStrategy: PID 31802 died... 21:50:06.499266 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31802): Terminated: ok {rc=0} 21:50:06.589262 bus /gobi_0: Setting Powered False 21:50:07.690734 bus /gobi_0: Setting Powered False 21:50:08.808481 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 21:50:09.960126 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:50:09.972297 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 21:50:10.047416 tst iperf3.py: using LAC 31729 21:50:10.177359 tst iperf3.py: using RAC 109 21:50:10.305442 tst iperf3.py: using CellId 31729 21:50:10.432444 tst iperf3.py: using BVCI 31730 21:50:10.553873 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:50:10.565556 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:50:10.577007 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:50:10.588918 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:50:10.600921 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:50:10.613073 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:50:10.624807 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:50:10.636617 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:50:10.648616 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:50:10.766675 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 21:50:10.975191 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:50:11.285945 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31805): Launched 21:50:11.555747 run iperf3-srv_10.42.42.10(pid=31806): Launched 21:50:11.672388 tst iperf3.py:8: start network... 21:50:11.880917 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:50:12.362441 run create_hlr_db(pid=31807): Launched 21:50:12.489181 bus /gobi_6: Setting Powered False 21:50:13.551917 run create_hlr_db(pid=31807): Terminated: ok {rc=0} 21:50:13.982463 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31809): Launched 21:50:14.293783 run osmo-hlr_10.42.42.2(pid=31810): Launched 21:50:14.412271 run osmo-stp_10.42.42.5: Starting osmo-stp 21:50:14.947258 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31812): Launched 21:50:15.255844 run osmo-stp_10.42.42.5(pid=31813): Launched 21:50:15.373531 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:50:15.921880 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31815): Launched 21:50:16.074117 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:50:16.373748 run patchelf(pid=31816): Launched 21:50:16.569082 run osmo-stp_10.42.42.5(pid=31813): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31813)] 21:50:16.716062 run osmo-stp_10.42.42.5(pid=31813): stdout: | (launched: 2022-12-12_21:50:15.198972) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:50:16.869722 run osmo-stp_10.42.42.5(pid=31813): stderr: | 20221212215015372 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212215015372 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212215015372 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212215015373 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212215015373 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212215015373 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212215015373 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:50:17.018634 run osmo-stp_10.42.42.5(pid=31813): stdout: | (launched: 2022-12-12_21:50:15.198972) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:50:17.160088 run osmo-stp_10.42.42.5(pid=31813): stderr: | 20221212215015372 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212215015372 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212215015372 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212215015373 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212215015373 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212215015373 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212215015373 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:50:17.323419 run patchelf(pid=31816): Terminating (SIGINT) 21:50:17.512503 run patchelf(pid=31816): Terminated: ok {rc=0} 21:50:17.648690 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31813): Process ended prematurely: osmo-stp_10.42.42.5(pid=31813) [trial-2382↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31813)] [trial-2382↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8] 21:50:17.659115 tst iperf3.py:8: Test FAILED (7.7 sec) 21:50:17.688727 run osmo-hlr_10.42.42.2(pid=31810): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31810)] 21:50:17.740098 run osmo-hlr_10.42.42.2(pid=31810): stdout: | (launched: 2022-12-12_21:50:14.236623) 21:50:17.793150 run osmo-hlr_10.42.42.2(pid=31810): stderr: | 20221212215014414 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212215014414 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212215014414 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212215014414 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212215014414 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212215014415 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212215014427 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212215014435 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212215014435 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212215014435 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:50:17.847154 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31805): Terminating (SIGTERM) 21:50:17.890036 run iperf3-srv_10.42.42.10(pid=31806): Terminating (SIGTERM) 21:50:17.932342 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31809): Terminating (SIGTERM) 21:50:17.974920 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31812): Terminating (SIGTERM) 21:50:18.017217 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31815): Terminating (SIGTERM) 21:50:18.060218 --- ParallelTerminationStrategy: PID 31805 died... 21:50:18.080650 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31805): Terminated: ok {rc=0} 21:50:18.128652 --- ParallelTerminationStrategy: PID 31806 died... 21:50:18.148556 run iperf3-srv_10.42.42.10(pid=31806): Terminated {rc=256} 21:50:18.195966 --- ParallelTerminationStrategy: PID 31809 died... 21:50:18.215995 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31809): Terminated: ok {rc=0} 21:50:18.263390 --- ParallelTerminationStrategy: PID 31812 died... 21:50:18.283553 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31812): Terminated: ok {rc=0} 21:50:18.331105 --- ParallelTerminationStrategy: PID 31815 died... 21:50:18.351271 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31815): Terminated: ok {rc=0} 21:50:18.441267 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 21:50:19.589129 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:50:19.600661 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 21:50:19.669646 tst iperf3m4.py: using LAC 31730 21:50:19.790250 tst iperf3m4.py: using RAC 110 21:50:19.909375 tst iperf3m4.py: using CellId 31730 21:50:20.028831 tst iperf3m4.py: using BVCI 31731 21:50:20.141422 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:50:20.152322 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:50:20.163162 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:50:20.174543 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:50:20.185535 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:50:20.196333 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:50:20.207452 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:50:20.218249 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:50:20.229198 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:50:20.349144 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:50:20.471442 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:50:20.591574 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:50:20.711671 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 21:50:20.920613 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:50:21.231166 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31819): Launched 21:50:21.500515 run iperf3-srv_10.42.42.10(pid=31820): Launched 21:50:21.617455 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 21:50:21.824787 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:50:22.134957 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31821): Launched 21:50:22.405509 run iperf3-srv_10.42.42.10(pid=31822): Launched 21:50:22.522513 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 21:50:22.731494 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:50:23.043324 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31823): Launched 21:50:23.312692 run iperf3-srv_10.42.42.10(pid=31824): Launched 21:50:23.428227 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 21:50:23.636287 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:50:23.947094 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31825): Launched 21:50:24.217220 run iperf3-srv_10.42.42.10(pid=31826): Launched 21:50:24.333440 tst iperf3m4.py:8: start network... 21:50:24.541688 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:50:25.021263 run create_hlr_db(pid=31827): Launched 21:50:25.151078 bus /gobi_6: Setting Powered False 21:50:26.216758 run create_hlr_db(pid=31827): Terminated: ok {rc=0} 21:50:26.678515 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31829): Launched 21:50:27.011901 run osmo-hlr_10.42.42.2(pid=31830): Launched 21:50:27.139743 run osmo-stp_10.42.42.5: Starting osmo-stp 21:50:27.713473 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31832): Launched 21:50:28.049082 run osmo-stp_10.42.42.5(pid=31833): Launched 21:50:28.176633 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:50:28.750323 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31835): Launched 21:50:28.878660 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:50:29.159764 run patchelf(pid=31836): Launched 21:50:29.343981 run osmo-stp_10.42.42.5(pid=31833): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31833)] 21:50:29.484461 run osmo-stp_10.42.42.5(pid=31833): stdout: | (launched: 2022-12-12_21:50:27.988047) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:50:29.626579 run osmo-stp_10.42.42.5(pid=31833): stderr: | 20221212215028182 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212215028182 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212215028182 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212215028183 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212215028183 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212215028183 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212215028183 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:50:29.768476 run osmo-stp_10.42.42.5(pid=31833): stdout: | (launched: 2022-12-12_21:50:27.988047) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:50:29.905620 run osmo-stp_10.42.42.5(pid=31833): stderr: | 20221212215028182 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212215028182 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212215028182 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212215028183 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212215028183 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212215028183 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212215028183 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:50:30.066951 run patchelf(pid=31836): Terminating (SIGINT) 21:50:30.253978 run patchelf(pid=31836): Terminated: ok {rc=0} 21:50:30.389082 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31833): Process ended prematurely: osmo-stp_10.42.42.5(pid=31833) [trial-2382↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31833)] [trial-2382↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 21:50:30.399430 tst iperf3m4.py:8: Test FAILED (10.8 sec) 21:50:30.429222 run osmo-hlr_10.42.42.2(pid=31830): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31830)] 21:50:30.480652 run osmo-hlr_10.42.42.2(pid=31830): stdout: | (launched: 2022-12-12_21:50:26.951508) 21:50:30.533645 run osmo-hlr_10.42.42.2(pid=31830): stderr: | 20221212215027152 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212215027152 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212215027152 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212215027152 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212215027152 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212215027152 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212215027163 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212215027172 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212215027172 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212215027172 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:50:30.587216 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31819): Terminating (SIGTERM) 21:50:30.630151 run iperf3-srv_10.42.42.10(pid=31820): Terminating (SIGTERM) 21:50:30.672908 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31821): Terminating (SIGTERM) 21:50:30.715782 run iperf3-srv_10.42.42.10(pid=31822): Terminating (SIGTERM) 21:50:30.758443 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31823): Terminating (SIGTERM) 21:50:30.801377 run iperf3-srv_10.42.42.10(pid=31824): Terminating (SIGTERM) 21:50:30.853877 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31825): Terminating (SIGTERM) 21:50:30.898498 run iperf3-srv_10.42.42.10(pid=31826): Terminating (SIGTERM) 21:50:30.953481 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31829): Terminating (SIGTERM) 21:50:30.997629 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31832): Terminating (SIGTERM) 21:50:31.041357 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31835): Terminating (SIGTERM) 21:50:31.085696 --- ParallelTerminationStrategy: PID 31819 died... 21:50:31.106196 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31819): Terminated: ok {rc=0} 21:50:31.155187 --- ParallelTerminationStrategy: PID 31820 died... 21:50:31.175684 run iperf3-srv_10.42.42.10(pid=31820): Terminated {rc=256} 21:50:31.224223 --- ParallelTerminationStrategy: PID 31821 died... 21:50:31.244871 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31821): Terminated: ok {rc=0} 21:50:31.293705 --- ParallelTerminationStrategy: PID 31822 died... 21:50:31.314396 run iperf3-srv_10.42.42.10(pid=31822): Terminated {rc=256} 21:50:31.363026 --- ParallelTerminationStrategy: PID 31823 died... 21:50:31.383753 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31823): Terminated: ok {rc=0} 21:50:31.432470 --- ParallelTerminationStrategy: PID 31824 died... 21:50:31.453223 run iperf3-srv_10.42.42.10(pid=31824): Terminated {rc=256} 21:50:31.501678 --- ParallelTerminationStrategy: PID 31825 died... 21:50:31.522252 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31825): Terminated: ok {rc=0} 21:50:31.570925 --- ParallelTerminationStrategy: PID 31826 died... 21:50:31.591587 run iperf3-srv_10.42.42.10(pid=31826): Terminated {rc=256} 21:50:31.640388 --- ParallelTerminationStrategy: PID 31829 died... 21:50:31.661089 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31829): Terminated: ok {rc=0} 21:50:31.709956 --- ParallelTerminationStrategy: PID 31832 died... 21:50:31.730447 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31832): Terminated: ok {rc=0} 21:50:31.779783 --- ParallelTerminationStrategy: PID 31835 died... 21:50:31.800474 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31835): Terminated: ok {rc=0} 21:50:31.892932 bus /gobi_4: Setting Powered False 21:50:32.994700 bus /gobi_4: Setting Powered False 21:50:34.111939 bus /gobi_1: Setting Powered False 21:50:35.209334 bus /gobi_1: Setting Powered False 21:50:36.326936 bus /gobi_0: Setting Powered False 21:50:37.428028 bus /gobi_0: Setting Powered False 21:50:38.546667 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 21:50:39.649997 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:50:39.662084 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 21:50:39.731755 tst ping.py: using LAC 31731 21:50:39.860506 tst ping.py: using RAC 111 21:50:39.989838 tst ping.py: using CellId 31731 21:50:40.110187 tst ping.py: using BVCI 31732 21:50:40.230119 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:50:40.242032 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:50:40.253634 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:50:40.265366 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:50:40.277206 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:50:40.289278 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:50:40.301094 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:50:40.312713 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:50:40.433433 tst ping.py:19: start network... 21:50:40.638170 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:50:41.107662 run create_hlr_db(pid=31837): Launched 21:50:41.224043 bus /gobi_6: Setting Powered False 21:50:42.285672 run create_hlr_db(pid=31837): Terminated: ok {rc=0} 21:50:42.731389 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31839): Launched 21:50:43.058121 run osmo-hlr_10.42.42.2(pid=31840): Launched 21:50:43.184365 run osmo-stp_10.42.42.5: Starting osmo-stp 21:50:43.754138 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31842): Launched 21:50:44.081674 run osmo-stp_10.42.42.5(pid=31843): Launched 21:50:44.205713 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:50:44.773820 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31845): Launched 21:50:44.898978 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:50:45.175994 run patchelf(pid=31846): Launched 21:50:45.358725 run osmo-stp_10.42.42.5(pid=31843): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31843)] 21:50:45.496771 run osmo-stp_10.42.42.5(pid=31843): stdout: | (launched: 2022-12-12_21:50:44.022127) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:50:45.636864 run osmo-stp_10.42.42.5(pid=31843): stderr: | 20221212215044216 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212215044216 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212215044216 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212215044217 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212215044217 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212215044217 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212215044217 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:50:45.777132 run osmo-stp_10.42.42.5(pid=31843): stdout: | (launched: 2022-12-12_21:50:44.022127) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:50:45.932376 run osmo-stp_10.42.42.5(pid=31843): stderr: | 20221212215044216 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212215044216 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212215044216 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212215044217 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212215044217 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212215044217 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212215044217 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:50:46.093396 run patchelf(pid=31846): Terminating (SIGINT) 21:50:46.270401 run patchelf(pid=31846): Terminated: ok {rc=0} 21:50:46.400442 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=31843): Process ended prematurely: osmo-stp_10.42.42.5(pid=31843) [trial-2382↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31843)] [trial-2382↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22] 21:50:46.410109 tst ping.py:22: Test FAILED (6.8 sec) 21:50:46.439110 run osmo-hlr_10.42.42.2(pid=31840): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31840)] 21:50:46.489602 run osmo-hlr_10.42.42.2(pid=31840): stdout: | (launched: 2022-12-12_21:50:42.998860) 21:50:46.541734 run osmo-hlr_10.42.42.2(pid=31840): stderr: | 20221212215043199 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212215043199 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212215043199 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212215043199 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212215043199 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212215043199 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212215043212 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212215043220 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212215043220 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212215043220 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:50:46.594663 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31839): Terminating (SIGTERM) 21:50:46.637291 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31842): Terminating (SIGTERM) 21:50:46.681734 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31845): Terminating (SIGTERM) 21:50:46.727438 --- ParallelTerminationStrategy: PID 31839 died... 21:50:46.747541 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31839): Terminated: ok {rc=0} 21:50:46.796069 --- ParallelTerminationStrategy: PID 31842 died... 21:50:46.815901 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31842): Terminated: ok {rc=0} 21:50:46.862217 --- ParallelTerminationStrategy: PID 31845 died... 21:50:46.882566 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31845): Terminated: ok {rc=0} 21:50:46.971073 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 21:50:48.059861 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:50:48.071549 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 21:50:48.139597 tst ping_idle_ping.py: using LAC 31732 21:50:48.260719 tst ping_idle_ping.py: using RAC 112 21:50:48.381684 tst ping_idle_ping.py: using CellId 31732 21:50:48.503394 tst ping_idle_ping.py: using BVCI 31733 21:50:48.614221 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:50:48.625228 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:50:48.635987 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:50:48.646937 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:50:48.657858 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:50:48.668821 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:50:48.679791 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:50:48.690804 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:50:48.806372 tst ping_idle_ping.py:24: start network... 21:50:49.011544 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:50:49.487920 run create_hlr_db(pid=31847): Launched 21:50:49.604099 bus /gobi_6: Setting Powered False 21:50:50.664751 run create_hlr_db(pid=31847): Terminated: ok {rc=0} 21:50:51.112442 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31849): Launched 21:50:51.440721 run osmo-hlr_10.42.42.2(pid=31850): Launched 21:50:51.566684 run osmo-stp_10.42.42.5: Starting osmo-stp 21:50:52.136732 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31852): Launched 21:50:52.464646 run osmo-stp_10.42.42.5(pid=31853): Launched 21:50:52.590612 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:50:53.157774 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31855): Launched 21:50:53.283108 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:50:53.560631 run patchelf(pid=31856): Launched 21:50:53.743808 run osmo-stp_10.42.42.5(pid=31853): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31853)] 21:50:53.883524 run osmo-stp_10.42.42.5(pid=31853): stdout: | (launched: 2022-12-12_21:50:52.404653) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:50:54.024104 run osmo-stp_10.42.42.5(pid=31853): stderr: | 20221212215052598 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212215052598 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212215052598 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212215052599 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212215052599 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212215052599 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212215052599 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:50:54.164608 run osmo-stp_10.42.42.5(pid=31853): stdout: | (launched: 2022-12-12_21:50:52.404653) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:50:54.299661 run osmo-stp_10.42.42.5(pid=31853): stderr: | 20221212215052598 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212215052598 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212215052598 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212215052599 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212215052599 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212215052599 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212215052599 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:50:54.459911 run patchelf(pid=31856): Terminating (SIGINT) 21:50:54.644893 run patchelf(pid=31856): Terminated: ok {rc=0} 21:50:54.777909 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=31853): Process ended prematurely: osmo-stp_10.42.42.5(pid=31853) [trial-2382↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31853)] [trial-2382↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 21:50:54.787570 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 21:50:54.816638 run osmo-hlr_10.42.42.2(pid=31850): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31850)] 21:50:54.868461 run osmo-hlr_10.42.42.2(pid=31850): stdout: | (launched: 2022-12-12_21:50:51.381223) 21:50:54.921800 run osmo-hlr_10.42.42.2(pid=31850): stderr: | 20221212215051580 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212215051580 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212215051580 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212215051580 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212215051580 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212215051580 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212215051594 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212215051604 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212215051605 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212215051605 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:50:54.975259 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31849): Terminating (SIGTERM) 21:50:55.018145 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31852): Terminating (SIGTERM) 21:50:55.061215 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31855): Terminating (SIGTERM) 21:50:55.104575 --- ParallelTerminationStrategy: PID 31849 died... 21:50:55.125091 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31849): Terminated: ok {rc=0} 21:50:55.173083 --- ParallelTerminationStrategy: PID 31852 died... 21:50:55.193248 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31852): Terminated: ok {rc=0} 21:50:55.241451 --- ParallelTerminationStrategy: PID 31855 died... 21:50:55.261481 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31855): Terminated: ok {rc=0} 21:50:55.351331 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2382 gprs:nanobts+band-900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 21:50:56.677433 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:50:56.685357 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 21:50:56.719201 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 21:50:56.758906 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 21:50:56.847061 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 21:50:56.879953 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 21:50:56.919157 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 21:50:57.518109 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2382 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 21:50:57.569520 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:50:57.581006 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 21:50:57.629971 tst cs_paging_gprs_active.py: using LAC 31733 21:50:57.752249 tst cs_paging_gprs_active.py: using RAC 113 21:50:57.873310 tst cs_paging_gprs_active.py: using CellId 31733 21:50:57.993741 tst cs_paging_gprs_active.py: using BVCI 31734 21:50:58.106867 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:50:58.118172 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:50:58.129309 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:50:58.140319 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:50:58.151323 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:50:58.162254 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:50:58.173389 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:50:58.184289 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:50:58.195479 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 21:50:58.316316 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 21:50:58.437740 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 21:50:58.661224 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:50:58.990886 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31860): Launched 21:50:59.275424 run iperf3-srv_10.42.42.10(pid=31861): Launched 21:50:59.399293 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 21:50:59.621223 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:50:59.951101 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31862): Launched 21:51:00.235840 run iperf3-srv_10.42.42.10(pid=31863): Launched 21:51:00.359499 tst cs_paging_gprs_active.py:38: start network... 21:51:00.582165 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:51:01.105934 run create_hlr_db(pid=31864): Launched 21:51:01.253390 bus /gobi_6: Setting Powered False 21:51:02.313303 run create_hlr_db(pid=31864): Terminated: ok {rc=0} 21:51:02.741791 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31866): Launched 21:51:03.050010 run osmo-hlr_10.42.42.2(pid=31867): Launched 21:51:03.166996 run osmo-stp_10.42.42.5: Starting osmo-stp 21:51:03.733256 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31869): Launched 21:51:04.062151 run osmo-stp_10.42.42.5(pid=31870): Launched 21:51:04.187828 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:51:04.754448 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31872): Launched 21:51:04.880395 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:51:05.158781 run patchelf(pid=31873): Launched 21:51:05.330395 run osmo-stp_10.42.42.5(pid=31870): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31870)] 21:51:05.460814 run osmo-stp_10.42.42.5(pid=31870): stdout: | (launched: 2022-12-12_21:51:04.002483) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:51:05.592662 run osmo-stp_10.42.42.5(pid=31870): stderr: | 20221212215104195 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212215104195 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212215104196 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212215104196 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212215104196 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212215104197 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212215104197 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:51:05.724626 run osmo-stp_10.42.42.5(pid=31870): stdout: | (launched: 2022-12-12_21:51:04.002483) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:51:05.851060 run osmo-stp_10.42.42.5(pid=31870): stderr: | 20221212215104195 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212215104195 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212215104196 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212215104196 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212215104196 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212215104197 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212215104197 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:51:06.000157 run patchelf(pid=31873): Terminating (SIGINT) 21:51:06.173717 run patchelf(pid=31873): Terminated: ok {rc=0} 21:51:06.298839 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=31870): Process ended prematurely: osmo-stp_10.42.42.5(pid=31870) [trial-2382↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31870)] [trial-2382↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 21:51:06.308373 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 21:51:06.335774 run osmo-hlr_10.42.42.2(pid=31867): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31867)] 21:51:06.384481 run osmo-hlr_10.42.42.2(pid=31867): stdout: | (launched: 2022-12-12_21:51:02.994087) 21:51:06.434785 run osmo-hlr_10.42.42.2(pid=31867): stderr: | 20221212215103172 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212215103172 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212215103172 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212215103172 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212215103172 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212215103172 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212215103185 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212215103194 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212215103194 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212215103194 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:51:06.485741 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31860): Terminating (SIGTERM) 21:51:06.526066 run iperf3-srv_10.42.42.10(pid=31861): Terminating (SIGTERM) 21:51:06.567175 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31862): Terminating (SIGTERM) 21:51:06.607747 run iperf3-srv_10.42.42.10(pid=31863): Terminating (SIGTERM) 21:51:06.648188 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31866): Terminating (SIGTERM) 21:51:06.689071 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31869): Terminating (SIGTERM) 21:51:06.729638 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31872): Terminating (SIGTERM) 21:51:06.770393 --- ParallelTerminationStrategy: PID 31860 died... 21:51:06.789892 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31860): Terminated: ok {rc=0} 21:51:06.835260 --- ParallelTerminationStrategy: PID 31861 died... 21:51:06.854308 run iperf3-srv_10.42.42.10(pid=31861): Terminated {rc=256} 21:51:06.899064 --- ParallelTerminationStrategy: PID 31862 died... 21:51:06.918052 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31862): Terminated: ok {rc=0} 21:51:06.962615 --- ParallelTerminationStrategy: PID 31863 died... 21:51:06.981635 run iperf3-srv_10.42.42.10(pid=31863): Terminated {rc=256} 21:51:07.026371 --- ParallelTerminationStrategy: PID 31866 died... 21:51:07.045369 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31866): Terminated: ok {rc=0} 21:51:07.090101 --- ParallelTerminationStrategy: PID 31869 died... 21:51:07.108863 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31869): Terminated: ok {rc=0} 21:51:07.153481 --- ParallelTerminationStrategy: PID 31872 died... 21:51:07.172584 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31872): Terminated: ok {rc=0} 21:51:07.257056 bus /gobi_0: Setting Powered False 21:51:08.356291 bus /gobi_0: Setting Powered False 21:51:09.473930 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 21:51:10.625365 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:51:10.638095 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 21:51:10.689734 tst iperf3.py: using LAC 31734 21:51:10.810860 tst iperf3.py: using RAC 114 21:51:10.932051 tst iperf3.py: using CellId 31734 21:51:11.051992 tst iperf3.py: using BVCI 31735 21:51:11.164469 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:51:11.175857 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:51:11.186950 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:51:11.198093 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:51:11.209160 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:51:11.220235 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:51:11.231395 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:51:11.242357 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:51:11.253595 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 21:51:11.374479 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 21:51:11.595939 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:51:11.924050 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31874): Launched 21:51:12.207844 run iperf3-srv_10.42.42.10(pid=31875): Launched 21:51:12.331122 tst iperf3.py:8: start network... 21:51:12.551993 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:51:13.061078 run create_hlr_db(pid=31876): Launched 21:51:13.195024 bus /gobi_6: Setting Powered False 21:51:14.260485 run create_hlr_db(pid=31876): Terminated: ok {rc=0} 21:51:14.698534 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31878): Launched 21:51:15.005057 run osmo-hlr_10.42.42.2(pid=31879): Launched 21:51:15.122202 run osmo-stp_10.42.42.5: Starting osmo-stp 21:51:15.658654 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31881): Launched 21:51:15.993703 run osmo-stp_10.42.42.5(pid=31882): Launched 21:51:16.280463 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:51:17.011864 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31884): Launched 21:51:17.162258 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:51:17.445830 run patchelf(pid=31885): Launched 21:51:17.628807 run osmo-stp_10.42.42.5(pid=31882): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31882)] 21:51:17.768185 run osmo-stp_10.42.42.5(pid=31882): stdout: | (launched: 2022-12-12_21:51:15.927990) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:51:17.909433 run osmo-stp_10.42.42.5(pid=31882): stderr: | 20221212215116383 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212215116383 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212215116384 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212215116384 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212215116385 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212215116385 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212215116385 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:51:18.050366 run osmo-stp_10.42.42.5(pid=31882): stdout: | (launched: 2022-12-12_21:51:15.927990) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:51:18.185566 run osmo-stp_10.42.42.5(pid=31882): stderr: | 20221212215116383 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212215116383 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212215116384 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212215116384 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212215116385 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212215116385 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212215116385 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:51:18.346034 run patchelf(pid=31885): Terminating (SIGINT) 21:51:18.530831 run patchelf(pid=31885): Terminated: ok {rc=0} 21:51:18.664457 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31882): Process ended prematurely: osmo-stp_10.42.42.5(pid=31882) [trial-2382↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31882)] [trial-2382↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 21:51:18.675016 tst iperf3.py:8: Test FAILED (8.1 sec) 21:51:18.703855 run osmo-hlr_10.42.42.2(pid=31879): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31879)] 21:51:18.754999 run osmo-hlr_10.42.42.2(pid=31879): stdout: | (launched: 2022-12-12_21:51:14.949403) 21:51:18.808084 run osmo-hlr_10.42.42.2(pid=31879): stderr: | 20221212215115126 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212215115126 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212215115126 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212215115126 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212215115126 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212215115126 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212215115142 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212215115152 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212215115152 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212215115152 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:51:18.862186 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31874): Terminating (SIGTERM) 21:51:18.905159 run iperf3-srv_10.42.42.10(pid=31875): Terminating (SIGTERM) 21:51:18.947783 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31878): Terminating (SIGTERM) 21:51:18.990531 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31881): Terminating (SIGTERM) 21:51:19.033782 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31884): Terminating (SIGTERM) 21:51:19.076797 --- ParallelTerminationStrategy: PID 31874 died... 21:51:19.097176 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31874): Terminated: ok {rc=0} 21:51:19.144347 --- ParallelTerminationStrategy: PID 31875 died... 21:51:19.164228 run iperf3-srv_10.42.42.10(pid=31875): Terminated {rc=256} 21:51:19.211017 --- ParallelTerminationStrategy: PID 31878 died... 21:51:19.230937 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31878): Terminated: ok {rc=0} 21:51:19.278034 --- ParallelTerminationStrategy: PID 31881 died... 21:51:19.297948 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31881): Terminated: ok {rc=0} 21:51:19.345145 --- ParallelTerminationStrategy: PID 31884 died... 21:51:19.365073 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31884): Terminated: ok {rc=0} 21:51:19.454550 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 21:51:20.609488 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:51:20.622238 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 21:51:20.676339 tst iperf3m4.py: using LAC 31735 21:51:20.807350 tst iperf3m4.py: using RAC 115 21:51:20.939234 tst iperf3m4.py: using CellId 31735 21:51:21.069329 tst iperf3m4.py: using BVCI 31736 21:51:21.189554 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:51:21.201478 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:51:21.213378 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:51:21.225423 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:51:21.237424 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:51:21.249400 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:51:21.261599 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:51:21.273506 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:51:21.285762 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 21:51:21.403999 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 21:51:21.526278 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 21:51:21.646299 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 21:51:21.763559 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 21:51:21.973363 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:51:22.282034 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31886): Launched 21:51:22.549436 run iperf3-srv_10.42.42.10(pid=31887): Launched 21:51:22.666050 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 21:51:22.874185 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:51:23.184769 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31888): Launched 21:51:23.452165 run iperf3-srv_10.42.42.10(pid=31889): Launched 21:51:23.567632 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 21:51:23.774158 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:51:24.082580 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31890): Launched 21:51:24.349049 run iperf3-srv_10.42.42.10(pid=31891): Launched 21:51:24.464069 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 21:51:24.669970 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:51:24.979843 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31892): Launched 21:51:25.247446 run iperf3-srv_10.42.42.10(pid=31893): Launched 21:51:25.362812 tst iperf3m4.py:8: start network... 21:51:25.568141 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:51:26.042767 run create_hlr_db(pid=31894): Launched 21:51:26.160748 bus /gobi_6: Setting Powered False 21:51:27.221211 run create_hlr_db(pid=31894): Terminated: ok {rc=0} 21:51:27.648021 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31896): Launched 21:51:27.954508 run osmo-hlr_10.42.42.2(pid=31897): Launched 21:51:28.071249 run osmo-stp_10.42.42.5: Starting osmo-stp 21:51:28.612579 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31899): Launched 21:51:28.920715 run osmo-stp_10.42.42.5(pid=31900): Launched 21:51:29.038605 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:51:29.568796 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31902): Launched 21:51:29.686670 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:51:29.946471 run patchelf(pid=31903): Launched 21:51:30.117464 run osmo-stp_10.42.42.5(pid=31900): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31900)] 21:51:30.247496 run osmo-stp_10.42.42.5(pid=31900): stdout: | (launched: 2022-12-12_21:51:28.864642) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:51:30.379152 run osmo-stp_10.42.42.5(pid=31900): stderr: | 20221212215129037 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212215129037 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212215129037 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212215129038 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212215129038 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212215129038 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212215129038 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:51:30.510943 run osmo-stp_10.42.42.5(pid=31900): stdout: | (launched: 2022-12-12_21:51:28.864642) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:51:30.637319 run osmo-stp_10.42.42.5(pid=31900): stderr: | 20221212215129037 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212215129037 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212215129037 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212215129038 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212215129038 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212215129038 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212215129038 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:51:30.786912 run patchelf(pid=31903): Terminating (SIGINT) 21:51:30.978048 run patchelf(pid=31903): Terminated: ok {rc=0} 21:51:31.106442 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31900): Process ended prematurely: osmo-stp_10.42.42.5(pid=31900) [trial-2382↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31900)] [trial-2382↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 21:51:31.116566 tst iperf3m4.py:8: Test FAILED (10.5 sec) 21:51:31.146055 run osmo-hlr_10.42.42.2(pid=31897): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31897)] 21:51:31.195751 run osmo-hlr_10.42.42.2(pid=31897): stdout: | (launched: 2022-12-12_21:51:27.898218) 21:51:31.247356 run osmo-hlr_10.42.42.2(pid=31897): stderr: | 20221212215128077 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212215128077 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212215128077 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212215128077 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212215128077 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212215128077 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212215128089 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212215128098 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212215128098 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212215128099 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:51:31.299550 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31886): Terminating (SIGTERM) 21:51:31.340878 run iperf3-srv_10.42.42.10(pid=31887): Terminating (SIGTERM) 21:51:31.383670 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31888): Terminating (SIGTERM) 21:51:31.425445 run iperf3-srv_10.42.42.10(pid=31889): Terminating (SIGTERM) 21:51:31.466788 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31890): Terminating (SIGTERM) 21:51:31.508138 run iperf3-srv_10.42.42.10(pid=31891): Terminating (SIGTERM) 21:51:31.549704 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31892): Terminating (SIGTERM) 21:51:31.590818 run iperf3-srv_10.42.42.10(pid=31893): Terminating (SIGTERM) 21:51:31.632073 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31896): Terminating (SIGTERM) 21:51:31.673732 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31899): Terminating (SIGTERM) 21:51:31.715216 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31902): Terminating (SIGTERM) 21:51:31.757078 --- ParallelTerminationStrategy: PID 31886 died... 21:51:31.776462 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31886): Terminated: ok {rc=0} 21:51:31.834818 --- ParallelTerminationStrategy: PID 31887 died... 21:51:31.863369 run iperf3-srv_10.42.42.10(pid=31887): Terminated {rc=256} 21:51:31.914542 --- ParallelTerminationStrategy: PID 31888 died... 21:51:31.934645 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31888): Terminated: ok {rc=0} 21:51:31.982507 --- ParallelTerminationStrategy: PID 31889 died... 21:51:32.002416 run iperf3-srv_10.42.42.10(pid=31889): Terminated {rc=256} 21:51:32.050446 --- ParallelTerminationStrategy: PID 31890 died... 21:51:32.070257 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31890): Terminated: ok {rc=0} 21:51:32.118161 --- ParallelTerminationStrategy: PID 31891 died... 21:51:32.137936 run iperf3-srv_10.42.42.10(pid=31891): Terminated {rc=256} 21:51:32.185838 --- ParallelTerminationStrategy: PID 31892 died... 21:51:32.205767 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31892): Terminated: ok {rc=0} 21:51:32.253648 --- ParallelTerminationStrategy: PID 31893 died... 21:51:32.273353 run iperf3-srv_10.42.42.10(pid=31893): Terminated {rc=256} 21:51:32.321294 --- ParallelTerminationStrategy: PID 31896 died... 21:51:32.340238 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31896): Terminated: ok {rc=0} 21:51:32.386275 --- ParallelTerminationStrategy: PID 31899 died... 21:51:32.405103 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31899): Terminated: ok {rc=0} 21:51:32.451231 --- ParallelTerminationStrategy: PID 31902 died... 21:51:32.470133 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31902): Terminated: ok {rc=0} 21:51:32.559919 bus /gobi_4: Setting Powered False 21:51:33.662815 bus /gobi_4: Setting Powered False 21:51:34.783895 bus /gobi_1: Setting Powered False 21:51:35.883108 bus /gobi_1: Setting Powered False 21:51:37.000237 bus /gobi_0: Setting Powered False 21:51:38.100214 bus /gobi_0: Setting Powered False 21:51:39.217669 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 21:51:40.321379 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:51:40.333772 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 21:51:40.382274 tst ping.py: using LAC 31736 21:51:40.500917 tst ping.py: using RAC 116 21:51:40.618457 tst ping.py: using CellId 31736 21:51:40.736774 tst ping.py: using BVCI 31737 21:51:40.847097 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:51:40.858799 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:51:40.870162 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:51:40.881808 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:51:40.893361 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:51:40.904939 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:51:40.917046 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:51:40.928317 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 21:51:41.043642 tst ping.py:19: start network... 21:51:41.245122 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:51:41.712298 run create_hlr_db(pid=31904): Launched 21:51:41.827366 bus /gobi_6: Setting Powered False 21:51:42.887132 run create_hlr_db(pid=31904): Terminated: ok {rc=0} 21:51:43.327129 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31906): Launched 21:51:43.649466 run osmo-hlr_10.42.42.2(pid=31907): Launched 21:51:43.773456 run osmo-stp_10.42.42.5: Starting osmo-stp 21:51:44.333143 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31909): Launched 21:51:44.655014 run osmo-stp_10.42.42.5(pid=31910): Launched 21:51:44.778336 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:51:45.337633 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31912): Launched 21:51:45.461679 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:51:45.735118 run patchelf(pid=31913): Launched 21:51:45.942124 run osmo-stp_10.42.42.5(pid=31910): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31910)] 21:51:46.075356 run osmo-stp_10.42.42.5(pid=31910): stdout: | (launched: 2022-12-12_21:51:44.596410) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:51:46.210562 run osmo-stp_10.42.42.5(pid=31910): stderr: | 20221212215144789 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212215144789 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212215144790 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212215144790 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212215144792 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212215144792 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212215144793 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:51:46.344811 run osmo-stp_10.42.42.5(pid=31910): stdout: | (launched: 2022-12-12_21:51:44.596410) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:51:46.474584 run osmo-stp_10.42.42.5(pid=31910): stderr: | 20221212215144789 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212215144789 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212215144790 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212215144790 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212215144792 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212215144792 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212215144793 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:51:46.627212 run patchelf(pid=31913): Terminating (SIGINT) 21:51:46.806300 run patchelf(pid=31913): Terminated: ok {rc=0} 21:51:46.934354 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=31910): Process ended prematurely: osmo-stp_10.42.42.5(pid=31910) [trial-2382↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31910)] [trial-2382↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 21:51:46.944372 tst ping.py:22: Test FAILED (6.6 sec) 21:51:46.976842 run osmo-hlr_10.42.42.2(pid=31907): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31907)] 21:51:47.028712 run osmo-hlr_10.42.42.2(pid=31907): stdout: | (launched: 2022-12-12_21:51:43.590832) 21:51:47.082465 run osmo-hlr_10.42.42.2(pid=31907): stderr: | 20221212215143790 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212215143790 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212215143790 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212215143790 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212215143790 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212215143790 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212215143806 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212215143815 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212215143815 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212215143815 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:51:47.136829 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31906): Terminating (SIGTERM) 21:51:47.181519 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31909): Terminating (SIGTERM) 21:51:47.225306 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31912): Terminating (SIGTERM) 21:51:47.267161 --- ParallelTerminationStrategy: PID 31906 died... 21:51:47.286663 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31906): Terminated: ok {rc=0} 21:51:47.333513 --- ParallelTerminationStrategy: PID 31909 died... 21:51:47.352664 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31909): Terminated: ok {rc=0} 21:51:47.399487 --- ParallelTerminationStrategy: PID 31912 died... 21:51:47.418643 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31912): Terminated: ok {rc=0} 21:51:47.506004 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2382 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 21:51:48.593017 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:51:48.604874 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 21:51:48.656670 tst ping_idle_ping.py: using LAC 31737 21:51:48.776606 tst ping_idle_ping.py: using RAC 117 21:51:48.894939 tst ping_idle_ping.py: using CellId 31737 21:51:49.013546 tst ping_idle_ping.py: using BVCI 31738 21:51:49.132906 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:51:49.145176 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:51:49.157169 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:51:49.171972 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:51:49.184402 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:51:49.196337 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:51:49.208538 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:51:49.220580 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 21:51:49.343215 tst ping_idle_ping.py:24: start network... 21:51:49.560496 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:51:50.061904 run create_hlr_db(pid=31914): Launched 21:51:50.191600 bus /gobi_6: Setting Powered False 21:51:51.254808 run create_hlr_db(pid=31914): Terminated: ok {rc=0} 21:51:51.701993 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31916): Launched 21:51:52.024603 run osmo-hlr_10.42.42.2(pid=31917): Launched 21:51:52.147305 run osmo-stp_10.42.42.5: Starting osmo-stp 21:51:52.706136 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31919): Launched 21:51:53.026559 run osmo-stp_10.42.42.5(pid=31920): Launched 21:51:53.149043 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:51:53.703542 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31922): Launched 21:51:53.826447 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:51:54.097928 run patchelf(pid=31923): Launched 21:51:54.276844 run osmo-stp_10.42.42.5(pid=31920): ERR: Terminated: ERROR {rc=1} [trial-2382↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31920)] 21:51:54.413059 run osmo-stp_10.42.42.5(pid=31920): stdout: | (launched: 2022-12-12_21:51:52.968438) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:51:54.550827 run osmo-stp_10.42.42.5(pid=31920): stderr: | 20221212215153162 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212215153162 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212215153162 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212215153163 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212215153163 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212215153163 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212215153163 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:51:54.688406 run osmo-stp_10.42.42.5(pid=31920): stdout: | (launched: 2022-12-12_21:51:52.968438) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:51:54.820143 run osmo-stp_10.42.42.5(pid=31920): stderr: | 20221212215153162 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212215153162 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212215153162 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212215153163 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212215153163 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212215153163 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212215153163 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:51:54.977449 run patchelf(pid=31923): Terminating (SIGINT) 21:51:55.158701 run patchelf(pid=31923): Terminated: ok {rc=0} 21:51:55.289187 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=31920): Process ended prematurely: osmo-stp_10.42.42.5(pid=31920) [trial-2382↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31920)] [trial-2382↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 21:51:55.298780 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 21:51:55.327088 run osmo-hlr_10.42.42.2(pid=31917): ERR: Terminated: ERROR {rc=237} [trial-2382↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31917)] 21:51:55.378649 run osmo-hlr_10.42.42.2(pid=31917): stdout: | (launched: 2022-12-12_21:51:51.966436) 21:51:55.431716 run osmo-hlr_10.42.42.2(pid=31917): stderr: | 20221212215152167 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212215152167 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212215152167 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212215152167 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212215152167 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212215152167 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212215152181 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212215152190 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212215152191 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212215152191 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:51:55.485354 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31916): Terminating (SIGTERM) 21:51:55.527895 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31919): Terminating (SIGTERM) 21:51:55.570533 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31922): Terminating (SIGTERM) 21:51:55.613417 --- ParallelTerminationStrategy: PID 31916 died... 21:51:55.633783 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31916): Terminated: ok {rc=0} 21:51:55.681020 --- ParallelTerminationStrategy: PID 31919 died... 21:51:55.701329 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31919): Terminated: ok {rc=0} 21:51:55.748335 --- ParallelTerminationStrategy: PID 31922 died... 21:51:55.768430 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31922): Terminated: ok {rc=0} 21:51:55.857255 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2382 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 21:51:57.170789 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:51:57.178297 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 21:51:57.210849 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 21:51:57.247125 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 21:51:57.303639 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 21:51:57.336664 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 21:51:57.371641 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 21:51:57.933861 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2382 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 21:51:57.939544 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:51:57.951720 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 21:51:58.020198 tst switch_tch_pdch.py: using LAC 31738 21:51:58.146430 tst switch_tch_pdch.py: using RAC 118 21:51:58.274340 tst switch_tch_pdch.py: using CellId 31738 21:51:58.401349 tst switch_tch_pdch.py: using BVCI 31739 21:51:58.517921 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:51:58.530038 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:51:58.541902 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:51:58.553858 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:51:58.565752 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:51:58.577611 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:51:58.589575 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:51:58.601546 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:51:58.718452 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:51:58.834692 tst switch_tch_pdch.py:51: start network... 21:51:59.034818 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:51:59.495174 run create_hlr_db(pid=31927): Launched 21:51:59.610115 bus /gobi_6: Setting Powered False 21:52:00.670140 run create_hlr_db(pid=31927): Terminated: ok {rc=0} 21:52:01.102341 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31929): Launched 21:52:01.489878 run osmo-hlr_10.42.42.2(pid=31930): Launched 21:52:01.651664 run osmo-stp_10.42.42.5: Starting osmo-stp 21:52:02.300079 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31932): Launched 21:52:02.625379 run osmo-stp_10.42.42.5(pid=31933): Launched 21:52:02.749240 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:52:03.309970 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31935): Launched 21:52:03.431354 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:52:03.701341 run patchelf(pid=31936): Launched 21:52:03.879363 run osmo-stp_10.42.42.5(pid=31933): ERR: Terminated: ERROR {rc=1} [trial-2382↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31933)] 21:52:04.015325 run osmo-stp_10.42.42.5(pid=31933): stdout: | (launched: 2022-12-12_21:52:02.567684) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:52:04.153365 run osmo-stp_10.42.42.5(pid=31933): stderr: | 20221212215202756 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212215202756 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212215202757 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212215202757 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212215202758 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212215202758 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212215202758 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:52:04.290948 run osmo-stp_10.42.42.5(pid=31933): stdout: | (launched: 2022-12-12_21:52:02.567684) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:52:04.422910 run osmo-stp_10.42.42.5(pid=31933): stderr: | 20221212215202756 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212215202756 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212215202757 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212215202757 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212215202758 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212215202758 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212215202758 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:52:04.578957 run patchelf(pid=31936): Terminating (SIGINT) 21:52:04.759023 run patchelf(pid=31936): Terminated: ok {rc=0} 21:52:04.889256 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=31933): Process ended prematurely: osmo-stp_10.42.42.5(pid=31933) [trial-2382↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31933)] [trial-2382↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 21:52:04.898878 tst switch_tch_pdch.py:54: Test FAILED (7.0 sec) 21:52:04.926826 run osmo-hlr_10.42.42.2(pid=31930): ERR: Terminated: ERROR {rc=237} [trial-2382↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31930)] 21:52:04.977342 run osmo-hlr_10.42.42.2(pid=31930): stdout: | (launched: 2022-12-12_21:52:01.426902) 21:52:05.030393 run osmo-hlr_10.42.42.2(pid=31930): stderr: | 20221212215201854 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212215201854 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212215201854 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212215201854 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212215201854 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212215201854 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212215201877 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212215201891 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212215201892 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212215201892 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:52:05.083353 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31929): Terminating (SIGTERM) 21:52:05.125834 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31932): Terminating (SIGTERM) 21:52:05.167928 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31935): Terminating (SIGTERM) 21:52:05.210573 --- ParallelTerminationStrategy: PID 31929 died... 21:52:05.230761 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31929): Terminated: ok {rc=0} 21:52:05.277453 --- ParallelTerminationStrategy: PID 31932 died... 21:52:05.296905 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31932): Terminated: ok {rc=0} 21:52:05.343814 --- ParallelTerminationStrategy: PID 31935 died... 21:52:05.363510 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31935): Terminated: ok {rc=0} 21:52:05.451827 bus /gobi_0: Setting Powered False 21:52:06.552527 bus /gobi_0: Setting Powered False 21:52:07.670284 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2382 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 nitb_smpp --------------------------------------------------------------------- 21:52:08.924497 tst nitb_smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:52:08.926961 tst nitb_smpp: Verifying 1 x bts (candidates: 11) 21:52:08.947166 tst nitb_smpp: Verifying 1 x ip_address (candidates: 9) 21:52:08.954526 tst nitb_smpp: Verifying 1 x modem (candidates: 12) 21:52:08.987602 tst nitb_smpp: Reserving 1 x bts (candidates: 11) 21:52:09.007826 tst nitb_smpp: Reserving 1 x ip_address (candidates: 9) 21:52:09.015090 tst nitb_smpp: Reserving 1 x modem (candidates: 12) 21:52:09.535613 tst nitb_smpp: RESERVED RESOURCES for nitb_smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2382 nitb_smpp esme_connect_policy_acceptall.py ---------------------------------------------- 21:52:09.540432 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 21:52:09.558598 tst esme_connect_policy_acceptall.py: using MSISDN 7983 21:52:09.693960 run osmo-nitb_10.42.42.2: Starting osmo-nitb 21:52:10.262277 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=31940): Launched 21:52:10.567219 run osmo-nitb_10.42.42.2(pid=31941): Launched 21:52:10.737164 run osmo-nitb_10.42.42.2(pid=31941): ERR: Terminated: ERROR {rc=2} [trial-2382↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31941)] 21:52:10.874828 run osmo-nitb_10.42.42.2(pid=31941): stdout: | (launched: 2022-12-12_21:52:10.512108) 21:52:11.013830 run osmo-nitb_10.42.42.2(pid=31941): stderr: | (launched: 2022-12-12_21:52:10.557489) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 21:52:11.153312 run osmo-nitb_10.42.42.2(pid=31941): stdout: | (launched: 2022-12-12_21:52:10.512108) 21:52:11.286849 run osmo-nitb_10.42.42.2(pid=31941): stderr: | (launched: 2022-12-12_21:52:10.557489) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7ff6b86c2268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=31941): Process ended prematurely: osmo-nitb_10.42.42.2(pid=31941) [trial-2382↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31941)] 21:52:11.683731 tst osmo-nitb_10.42.42.2(pid=31941): stdout: | (launched: 2022-12-12_21:52:10.512108) 21:52:11.808112 tst osmo-nitb_10.42.42.2(pid=31941): stderr: | (launched: 2022-12-12_21:52:10.557489) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 21:52:11.954449 tst esme_connect_policy_acceptall.py:18: ERR: Error: osmo-nitb_10.42.42.2(pid=31941): Process ended prematurely: osmo-nitb_10.42.42.2(pid=31941) [trial-2382↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31941)] [trial-2382↪nitb_smpp↪esme_connect_policy_acceptall.py:18] 21:52:11.962605 tst esme_connect_policy_acceptall.py:18: Test FAILED (2.4 sec) 21:52:11.968861 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=31940): Terminating (SIGTERM) 21:52:12.178694 --- ParallelTerminationStrategy: PID 31940 died... 21:52:12.199594 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=31940): Terminated: ok {rc=0} ---------------------------------------------- trial-2382 nitb_smpp esme_connect_policy_closed.py ---------------------------------------------- 21:52:12.248622 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 21:52:12.268917 tst esme_connect_policy_closed.py: using MSISDN 7984 21:52:12.392897 tst esme_connect_policy_closed.py: using MSISDN 7985 21:52:12.512502 run osmo-nitb_10.42.42.2: Starting osmo-nitb 21:52:13.122806 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=31942): Launched 21:52:13.449471 run osmo-nitb_10.42.42.2(pid=31943): Launched 21:52:13.625920 run osmo-nitb_10.42.42.2(pid=31943): ERR: Terminated: ERROR {rc=2} [trial-2382↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31943)] 21:52:13.760922 run osmo-nitb_10.42.42.2(pid=31943): stdout: | (launched: 2022-12-12_21:52:13.390887) 21:52:13.898295 run osmo-nitb_10.42.42.2(pid=31943): stderr: | (launched: 2022-12-12_21:52:13.439583) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 21:52:14.035543 run osmo-nitb_10.42.42.2(pid=31943): stdout: | (launched: 2022-12-12_21:52:13.390887) 21:52:14.166307 run osmo-nitb_10.42.42.2(pid=31943): stderr: | (launched: 2022-12-12_21:52:13.439583) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 21:52:14.322753 tst esme_connect_policy_closed.py:24: ERR: Error: osmo-nitb_10.42.42.2(pid=31943): Process ended prematurely: osmo-nitb_10.42.42.2(pid=31943) [trial-2382↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31943)] [trial-2382↪nitb_smpp↪esme_connect_policy_closed.py:24] 21:52:14.331572 tst esme_connect_policy_closed.py:24: Test FAILED (2.1 sec) 21:52:14.338440 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=31942): Terminating (SIGTERM) 21:52:14.548824 --- ParallelTerminationStrategy: PID 31942 died... 21:52:14.570422 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=31942): Terminated: ok {rc=0} ---------------------------------------------- trial-2382 nitb_smpp esme_ms_sms_storeforward.py ---------------------------------------------- 21:52:14.621723 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 21:52:14.633135 tst nitb_smpp: Using 1 x bts (candidates: 1) 21:52:14.669388 tst esme_ms_sms_storeforward.py: using LAC 31739 21:52:14.799397 tst esme_ms_sms_storeforward.py: using RAC 119 21:52:14.929781 tst esme_ms_sms_storeforward.py: using CellId 31739 21:52:15.059750 tst esme_ms_sms_storeforward.py: using BVCI 31740 21:52:15.173343 tst nitb_smpp: Using 1 x modem (candidates: 1) 21:52:15.308293 tst esme_ms_sms_storeforward.py: using MSISDN 7986 21:52:15.429076 tst esme_ms_sms_storeforward.py:20: start nitb and bts... 21:52:15.652501 run osmo-nitb_10.42.42.2: Starting osmo-nitb 21:52:16.333720 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=31944): Launched 21:52:16.679795 run osmo-nitb_10.42.42.2(pid=31945): Launched 21:52:16.877330 run osmo-nitb_10.42.42.2(pid=31945): ERR: Terminated: ERROR {rc=2} [trial-2382↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31945)] 21:52:17.015230 run osmo-nitb_10.42.42.2(pid=31945): stdout: | (launched: 2022-12-12_21:52:16.616090) 21:52:17.156067 run osmo-nitb_10.42.42.2(pid=31945): stderr: | (launched: 2022-12-12_21:52:16.665988) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 21:52:17.295678 run osmo-nitb_10.42.42.2(pid=31945): stdout: | (launched: 2022-12-12_21:52:16.616090) 21:52:17.426493 run osmo-nitb_10.42.42.2(pid=31945): stderr: | (launched: 2022-12-12_21:52:16.665988) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 21:52:17.583014 tst esme_ms_sms_storeforward.py:23: ERR: Error: osmo-nitb_10.42.42.2(pid=31945): Process ended prematurely: osmo-nitb_10.42.42.2(pid=31945) [trial-2382↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31945)] [trial-2382↪nitb_smpp↪esme_ms_sms_storeforward.py:23] 21:52:17.591792 tst esme_ms_sms_storeforward.py:23: Test FAILED (3.0 sec) 21:52:17.599155 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=31944): Terminating (SIGTERM) 21:52:17.809976 --- ParallelTerminationStrategy: PID 31944 died... 21:52:17.831832 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=31944): Terminated: ok {rc=0} 21:52:17.920189 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2382 nitb_smpp esme_ms_sms_transaction.py ---------------------------------------------- 21:52:19.009904 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 21:52:19.022078 tst nitb_smpp: Using 1 x bts (candidates: 1) 21:52:19.058810 tst esme_ms_sms_transaction.py: using LAC 31740 21:52:19.186509 tst esme_ms_sms_transaction.py: using RAC 120 21:52:19.306697 tst esme_ms_sms_transaction.py: using CellId 31740 21:52:19.425776 tst esme_ms_sms_transaction.py: using BVCI 31741 21:52:19.546688 tst nitb_smpp: Using 1 x modem (candidates: 1) 21:52:19.680089 tst esme_ms_sms_transaction.py: using MSISDN 7987 21:52:19.801705 tst esme_ms_sms_transaction.py:18: start nitb and bts... 21:52:20.025906 run osmo-nitb_10.42.42.2: Starting osmo-nitb 21:52:20.693078 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=31946): Launched 21:52:21.019820 run osmo-nitb_10.42.42.2(pid=31947): Launched 21:52:21.200934 run osmo-nitb_10.42.42.2(pid=31947): ERR: Terminated: ERROR {rc=2} [trial-2382↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31947)] 21:52:21.347208 run osmo-nitb_10.42.42.2(pid=31947): stdout: | (launched: 2022-12-12_21:52:20.961074) 21:52:21.494880 run osmo-nitb_10.42.42.2(pid=31947): stderr: | (launched: 2022-12-12_21:52:21.009936) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 21:52:21.642506 run osmo-nitb_10.42.42.2(pid=31947): stdout: | (launched: 2022-12-12_21:52:20.961074) 21:52:21.784488 run osmo-nitb_10.42.42.2(pid=31947): stderr: | (launched: 2022-12-12_21:52:21.009936) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7ff6b86c2268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=31947): Process ended prematurely: osmo-nitb_10.42.42.2(pid=31947) [trial-2382↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31947)] 21:52:22.143229 tst osmo-nitb_10.42.42.2(pid=31947): stdout: | (launched: 2022-12-12_21:52:20.961074) 21:52:22.276236 tst osmo-nitb_10.42.42.2(pid=31947): stderr: | (launched: 2022-12-12_21:52:21.009936) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 21:52:22.432742 tst esme_ms_sms_transaction.py:21: ERR: Error: osmo-nitb_10.42.42.2(pid=31947): Process ended prematurely: osmo-nitb_10.42.42.2(pid=31947) [trial-2382↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31947)] [trial-2382↪nitb_smpp↪esme_ms_sms_transaction.py:21] 21:52:22.441749 tst esme_ms_sms_transaction.py:21: Test FAILED (3.4 sec) 21:52:22.449109 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=31946): Terminating (SIGTERM) 21:52:22.659551 --- ParallelTerminationStrategy: PID 31946 died... 21:52:22.681216 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=31946): Terminated: ok {rc=0} 21:52:22.769458 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 nitb_smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 smpp --------------------------------------------------------------------- 21:52:23.934021 tst smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:52:23.937360 tst smpp: Verifying 1 x bts (candidates: 11) 21:52:23.958419 tst smpp: Verifying 6 x ip_address (candidates: 9) 21:52:23.985876 tst smpp: Verifying 1 x modem (candidates: 12) 21:52:24.023089 tst smpp: Reserving 1 x bts (candidates: 11) 21:52:24.043549 tst smpp: Reserving 6 x ip_address (candidates: 9) 21:52:24.070005 tst smpp: Reserving 1 x modem (candidates: 12) 21:52:24.598874 tst smpp: RESERVED RESOURCES for smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2382 smpp esme_connect_policy_acceptall.py ---------------------------------------------- 21:52:24.603983 tst smpp: Using 1 x ip_address (candidates: 6) 21:52:24.614822 tst smpp: Using 1 x ip_address (candidates: 6) 21:52:24.625538 tst smpp: Using 1 x ip_address (candidates: 6) 21:52:24.636062 tst smpp: Using 1 x ip_address (candidates: 6) 21:52:24.654737 tst esme_connect_policy_acceptall.py: using MSISDN 7988 21:52:24.774115 run osmo-stp_10.42.42.4: Starting osmo-stp 21:52:25.334100 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=31953): Launched 21:52:25.660350 run osmo-stp_10.42.42.4(pid=31954): Launched 21:52:25.785534 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:52:26.294100 run create_hlr_db(pid=31955): Launched 21:52:26.428856 bus /sierra_2: Setting Powered False 21:52:27.493610 run create_hlr_db(pid=31955): Terminated: ok {rc=0} 21:52:27.929123 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31957): Launched 21:52:28.234402 run osmo-hlr_10.42.42.2(pid=31958): Launched 21:52:28.351011 run osmo-msc_10.42.42.5: Starting osmo-msc 21:52:28.922204 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31960): Launched 21:52:29.227650 run osmo-msc_10.42.42.5(pid=31961): Launched 21:52:29.401237 run osmo-hlr_10.42.42.2(pid=31958): ERR: Terminated: ERROR {rc=237} [trial-2382↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31958)] 21:52:29.536359 run osmo-hlr_10.42.42.2(pid=31958): stdout: | (launched: 2022-12-12_21:52:28.179187) 21:52:29.678800 run osmo-hlr_10.42.42.2(pid=31958): stderr: | 20221212215228353 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212215228353 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212215228353 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212215228353 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212215228354 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212215228354 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212215228366 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212215228375 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212215228375 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212215228375 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:52:29.817524 run osmo-hlr_10.42.42.2(pid=31958): stdout: | (launched: 2022-12-12_21:52:28.179187) 21:52:29.948851 run osmo-hlr_10.42.42.2(pid=31958): stderr: | 20221212215228353 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212215228353 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212215228353 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212215228353 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212215228354 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212215228354 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212215228366 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212215228375 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212215228375 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212215228375 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:52:30.105085 tst esme_connect_policy_acceptall.py:23: ERR: Error: osmo-hlr_10.42.42.2(pid=31958): Process ended prematurely: osmo-hlr_10.42.42.2(pid=31958) [trial-2382↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31958)] [trial-2382↪smpp↪esme_connect_policy_acceptall.py:23] 21:52:30.113861 tst esme_connect_policy_acceptall.py:23: Test FAILED (5.5 sec) 21:52:30.141432 run osmo-msc_10.42.42.5(pid=31961): ERR: Terminated: ERROR {rc=9} [trial-2382↪smpp↪esme_connect_policy_acceptall.py↪esme_connect_policy_acceptall.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=31961)] 21:52:30.192094 run osmo-msc_10.42.42.5(pid=31961): stdout: | (launched: 2022-12-12_21:52:29.171899) 21:52:30.244417 run osmo-msc_10.42.42.5(pid=31961): stderr: | 20221212215229489 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | 20221212215229489 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | 20221212215229489 DLSS7 DEBUG XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212215229489 DLSCCP NOTICE OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | 20221212215229489 DLSS7 NOTICE 0: Creating SCCP instance (osmo_ss7.c:458) | 20221212215229489 DLSCCP INFO Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | 20221212215229490 DLSS7 DEBUG registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | 20221212215229490 DLGLOBAL NOTICE unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221212215229490 DSGS ERROR SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 21:52:30.297271 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=31953): Terminating (SIGTERM) 21:52:30.339325 run osmo-stp_10.42.42.4(pid=31954): Terminating (SIGTERM) 21:52:30.381567 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31957): Terminating (SIGTERM) 21:52:30.425368 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31960): Terminating (SIGTERM) 21:52:30.470542 --- ParallelTerminationStrategy: PID 31953 died... 21:52:30.491280 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=31953): Terminated: ok {rc=0} 21:52:30.540454 --- ParallelTerminationStrategy: PID 31954 died... 21:52:30.560279 run osmo-stp_10.42.42.4(pid=31954): Terminated: ok {rc=0} 21:52:30.606828 --- ParallelTerminationStrategy: PID 31957 died... 21:52:30.626537 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31957): Terminated: ok {rc=0} 21:52:30.673266 --- ParallelTerminationStrategy: PID 31960 died... 21:52:30.692925 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31960): Terminated: ok {rc=0} ---------------------------------------------- trial-2382 smpp esme_connect_policy_closed.py ---------------------------------------------- 21:52:30.744304 tst smpp: Using 1 x ip_address (candidates: 6) 21:52:30.755746 tst smpp: Using 1 x bts (candidates: 1) 21:52:30.791263 tst esme_connect_policy_closed.py: using LAC 31741 21:52:30.943443 tst esme_connect_policy_closed.py: using RAC 121 21:52:31.076210 tst esme_connect_policy_closed.py: using CellId 31741 21:52:31.249410 tst esme_connect_policy_closed.py: using BVCI 31742 21:52:31.414975 tst smpp: Using 1 x ip_address (candidates: 6) 21:52:31.429992 tst smpp: Using 1 x ip_address (candidates: 6) 21:52:31.444502 tst smpp: Using 1 x ip_address (candidates: 6) 21:52:31.470509 tst esme_connect_policy_closed.py: using MSISDN 7989 21:52:31.619021 tst esme_connect_policy_closed.py: using MSISDN 7990 21:52:31.739302 run osmo-stp_10.42.42.4: Starting osmo-stp 21:52:32.281786 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=31964): Launched 21:52:32.611846 run osmo-stp_10.42.42.4(pid=31965): Launched 21:52:32.737411 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:52:33.248215 run create_hlr_db(pid=31966): Launched 21:52:34.427515 run create_hlr_db(pid=31966): Terminated: ok {rc=0} 21:52:34.750726 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31968): Launched 21:52:35.056864 run osmo-hlr_10.42.42.2(pid=31969): Launched 21:52:35.175486 run osmo-msc_10.42.42.5: Starting osmo-msc 21:52:35.731380 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31971): Launched 21:52:36.038700 run osmo-msc_10.42.42.5(pid=31972): Launched 21:52:36.211034 run osmo-hlr_10.42.42.2(pid=31969): ERR: Terminated: ERROR {rc=237} [trial-2382↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31969)] 21:52:36.341931 run osmo-hlr_10.42.42.2(pid=31969): stdout: | (launched: 2022-12-12_21:52:35.001369) 21:52:36.474176 run osmo-hlr_10.42.42.2(pid=31969): stderr: | 20221212215235177 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212215235177 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212215235177 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212215235178 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212215235178 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212215235178 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212215235190 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212215235198 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212215235198 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212215235198 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:52:36.604041 run osmo-hlr_10.42.42.2(pid=31969): stdout: | (launched: 2022-12-12_21:52:35.001369) 21:52:36.726484 run osmo-hlr_10.42.42.2(pid=31969): stderr: | 20221212215235177 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212215235177 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212215235177 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212215235178 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212215235178 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212215235178 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212215235190 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212215235198 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212215235198 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212215235198 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:52:36.873384 tst esme_connect_policy_closed.py:31: ERR: Error: osmo-hlr_10.42.42.2(pid=31969): Process ended prematurely: osmo-hlr_10.42.42.2(pid=31969) [trial-2382↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31969)] [trial-2382↪smpp↪esme_connect_policy_closed.py:31] 21:52:36.881752 tst esme_connect_policy_closed.py:31: Test FAILED (6.1 sec) 21:52:36.908064 run osmo-msc_10.42.42.5(pid=31972): ERR: Terminated: ERROR {rc=9} [trial-2382↪smpp↪esme_connect_policy_closed.py↪esme_connect_policy_closed.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=31972)] 21:52:36.957203 run osmo-msc_10.42.42.5(pid=31972): stdout: | (launched: 2022-12-12_21:52:35.983168) 21:52:37.007477 run osmo-msc_10.42.42.5(pid=31972): stderr: | 20221212215236298 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | 20221212215236298 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | 20221212215236298 DLSS7 DEBUG XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212215236298 DLSCCP NOTICE OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | 20221212215236298 DLSS7 NOTICE 0: Creating SCCP instance (osmo_ss7.c:458) | 20221212215236298 DLSCCP INFO Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | 20221212215236299 DLSS7 DEBUG registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | 20221212215236299 DLGLOBAL NOTICE unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221212215236299 DSGS ERROR SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 21:52:37.058025 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=31964): Terminating (SIGTERM) 21:52:37.098872 run osmo-stp_10.42.42.4(pid=31965): Terminating (SIGTERM) 21:52:37.139576 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31968): Terminating (SIGTERM) 21:52:37.181930 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31971): Terminating (SIGTERM) 21:52:37.223707 --- ParallelTerminationStrategy: PID 31964 died... 21:52:37.243165 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=31964): Terminated: ok {rc=0} 21:52:37.289319 --- ParallelTerminationStrategy: PID 31965 died... 21:52:37.308240 run osmo-stp_10.42.42.4(pid=31965): Terminated: ok {rc=0} 21:52:37.353682 --- ParallelTerminationStrategy: PID 31968 died... 21:52:37.372584 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31968): Terminated: ok {rc=0} 21:52:37.417609 --- ParallelTerminationStrategy: PID 31971 died... 21:52:37.436585 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31971): Terminated: ok {rc=0} ---------------------------------------------- trial-2382 smpp esme_ms_sms_storeforward.py ---------------------------------------------- 21:52:37.486658 tst smpp: Using 1 x ip_address (candidates: 6) 21:52:37.497559 tst smpp: Using 1 x bts (candidates: 1) 21:52:37.532159 tst esme_ms_sms_storeforward.py: using LAC 31742 21:52:37.654261 tst esme_ms_sms_storeforward.py: using RAC 122 21:52:37.777824 tst esme_ms_sms_storeforward.py: using CellId 31742 21:52:37.899370 tst esme_ms_sms_storeforward.py: using BVCI 31743 21:52:38.014391 tst smpp: Using 1 x ip_address (candidates: 6) 21:52:38.024863 tst smpp: Using 1 x ip_address (candidates: 6) 21:52:38.035261 tst smpp: Using 1 x ip_address (candidates: 6) 21:52:38.046510 tst smpp: Using 1 x ip_address (candidates: 6) 21:52:38.057880 tst smpp: Using 1 x ip_address (candidates: 6) 21:52:38.068932 tst smpp: Using 1 x modem (candidates: 1) 21:52:38.194893 tst esme_ms_sms_storeforward.py: using MSISDN 7991 21:52:38.309271 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:52:38.786910 run create_hlr_db(pid=31975): Launched 21:52:39.959837 run create_hlr_db(pid=31975): Terminated: ok {rc=0} 21:52:40.286035 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31977): Launched 21:52:40.593498 run osmo-hlr_10.42.42.2(pid=31978): Launched 21:52:40.712380 run osmo-stp_10.42.42.5: Starting osmo-stp 21:52:41.261357 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31980): Launched 21:52:41.570455 run osmo-stp_10.42.42.5(pid=31981): Launched 21:52:41.688671 run osmo-msc_10.42.42.6: Starting osmo-msc 21:52:42.242548 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31983): Launched 21:52:42.547732 run osmo-msc_10.42.42.6(pid=31984): Launched 21:52:42.719752 run osmo-stp_10.42.42.5(pid=31981): ERR: Terminated: ERROR {rc=1} [trial-2382↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31981)] 21:52:42.850393 run osmo-stp_10.42.42.5(pid=31981): stdout: | (launched: 2022-12-12_21:52:41.514799) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:52:42.981445 run osmo-stp_10.42.42.5(pid=31981): stderr: | 20221212215241683 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212215241683 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212215241683 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212215241684 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212215241686 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212215241686 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212215241686 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:52:43.110898 run osmo-stp_10.42.42.5(pid=31981): stdout: | (launched: 2022-12-12_21:52:41.514799) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:52:43.233184 run osmo-stp_10.42.42.5(pid=31981): stderr: | 20221212215241683 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212215241683 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212215241683 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212215241684 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212215241686 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212215241686 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212215241686 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:52:43.379912 tst esme_ms_sms_storeforward.py:30: ERR: Error: osmo-stp_10.42.42.5(pid=31981): Process ended prematurely: osmo-stp_10.42.42.5(pid=31981) [trial-2382↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31981)] [trial-2382↪smpp↪esme_ms_sms_storeforward.py:30] 21:52:43.388277 tst esme_ms_sms_storeforward.py:30: Test FAILED (5.9 sec) 21:52:43.414944 run osmo-hlr_10.42.42.2(pid=31978): ERR: Terminated: ERROR {rc=237} [trial-2382↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31978)] 21:52:43.463424 run osmo-hlr_10.42.42.2(pid=31978): stdout: | (launched: 2022-12-12_21:52:40.537662) 21:52:43.513696 run osmo-hlr_10.42.42.2(pid=31978): stderr: | 20221212215240715 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212215240715 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212215240715 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212215240715 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212215240716 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212215240716 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212215240727 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/smpp/esme_ms_sms_storeforward.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212215240736 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212215240736 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212215240737 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:52:43.583951 run osmo-msc_10.42.42.6(pid=31984): ERR: Terminated: ERROR {rc=2} [trial-2382↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31984)] 21:52:43.632290 run osmo-msc_10.42.42.6(pid=31984): stdout: | (launched: 2022-12-12_21:52:42.492046) 21:52:43.682416 run osmo-msc_10.42.42.6(pid=31984): stderr: | 20221212215242764 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212215242764 DLGLOBAL DEBUG validating counter group 0x7f1bfd865c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212215242764 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212215242765 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212215242765 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212215242765 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212215242767 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212215242767 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212215242767 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212215242767 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:52:43.732750 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31977): Terminating (SIGTERM) 21:52:43.773436 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31980): Terminating (SIGTERM) 21:52:43.814132 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31983): Terminating (SIGTERM) 21:52:43.855097 --- ParallelTerminationStrategy: PID 31977 died... 21:52:43.874519 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31977): Terminated: ok {rc=0} 21:52:43.919952 --- ParallelTerminationStrategy: PID 31980 died... 21:52:43.938920 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31980): Terminated: ok {rc=0} 21:52:43.984178 --- ParallelTerminationStrategy: PID 31983 died... 21:52:44.003148 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31983): Terminated: ok {rc=0} 21:52:44.090878 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2382 smpp esme_ms_sms_transaction.py ---------------------------------------------- 21:52:45.180503 tst smpp: Using 1 x ip_address (candidates: 6) 21:52:45.192079 tst smpp: Using 1 x bts (candidates: 1) 21:52:45.234879 tst esme_ms_sms_transaction.py: using LAC 31743 21:52:45.365456 tst esme_ms_sms_transaction.py: using RAC 123 21:52:45.494611 tst esme_ms_sms_transaction.py: using CellId 31743 21:52:45.622499 tst esme_ms_sms_transaction.py: using BVCI 31744 21:52:45.741953 tst smpp: Using 1 x ip_address (candidates: 6) 21:52:45.752703 tst smpp: Using 1 x ip_address (candidates: 6) 21:52:45.763526 tst smpp: Using 1 x ip_address (candidates: 6) 21:52:45.774939 tst smpp: Using 1 x ip_address (candidates: 6) 21:52:45.786252 tst smpp: Using 1 x ip_address (candidates: 6) 21:52:45.797433 tst smpp: Using 1 x modem (candidates: 1) 21:52:45.942331 tst esme_ms_sms_transaction.py: using MSISDN 7992 21:52:46.057353 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:52:46.553024 run create_hlr_db(pid=31986): Launched 21:52:46.714044 bus /sierra_2: Setting Powered False 21:52:47.775188 run create_hlr_db(pid=31986): Terminated: ok {rc=0} 21:52:48.223449 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31988): Launched 21:52:48.552624 run osmo-hlr_10.42.42.2(pid=31989): Launched 21:52:48.678365 run osmo-stp_10.42.42.5: Starting osmo-stp 21:52:49.247415 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31991): Launched 21:52:49.574909 run osmo-stp_10.42.42.5(pid=31992): Launched 21:52:49.700108 run osmo-msc_10.42.42.6: Starting osmo-msc 21:52:50.292141 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31994): Launched 21:52:50.618645 run osmo-msc_10.42.42.6(pid=31995): Launched 21:52:50.801220 run osmo-stp_10.42.42.5(pid=31992): ERR: Terminated: ERROR {rc=1} [trial-2382↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31992)] 21:52:50.939983 run osmo-stp_10.42.42.5(pid=31992): stdout: | (launched: 2022-12-12_21:52:49.515996) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:52:51.079470 run osmo-stp_10.42.42.5(pid=31992): stderr: | 20221212215249708 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212215249708 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212215249708 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212215249708 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212215249709 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212215249709 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212215249709 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:52:51.217652 run osmo-stp_10.42.42.5(pid=31992): stdout: | (launched: 2022-12-12_21:52:49.515996) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:52:51.348455 run osmo-stp_10.42.42.5(pid=31992): stderr: | 20221212215249708 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212215249708 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212215249708 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212215249708 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212215249709 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212215249709 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212215249709 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:52:51.504835 tst esme_ms_sms_transaction.py:28: ERR: Error: osmo-stp_10.42.42.5(pid=31992): Process ended prematurely: osmo-stp_10.42.42.5(pid=31992) [trial-2382↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31992)] [trial-2382↪smpp↪esme_ms_sms_transaction.py:28] 21:52:51.513626 tst esme_ms_sms_transaction.py:28: Test FAILED (6.3 sec) 21:52:51.540858 run osmo-hlr_10.42.42.2(pid=31989): ERR: Terminated: ERROR {rc=237} [trial-2382↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31989)] 21:52:51.591762 run osmo-hlr_10.42.42.2(pid=31989): stdout: | (launched: 2022-12-12_21:52:48.493721) 21:52:51.644452 run osmo-hlr_10.42.42.2(pid=31989): stderr: | 20221212215248696 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212215248696 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212215248696 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212215248696 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212215248696 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212215248696 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212215248709 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/smpp/esme_ms_sms_transaction.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212215248717 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212215248717 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212215248717 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:52:51.718086 run osmo-msc_10.42.42.6(pid=31995): ERR: Terminated: ERROR {rc=2} [trial-2382↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31995)] 21:52:51.768801 run osmo-msc_10.42.42.6(pid=31995): stdout: | (launched: 2022-12-12_21:52:50.559669) 21:52:51.821516 run osmo-msc_10.42.42.6(pid=31995): stderr: | 20221212215250882 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212215250883 DLGLOBAL DEBUG validating counter group 0x7f57f64a2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212215250883 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212215250883 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212215250883 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212215250883 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212215250887 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212215250887 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212215250887 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212215250887 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:52:51.874501 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31988): Terminating (SIGTERM) 21:52:51.917474 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31991): Terminating (SIGTERM) 21:52:51.959895 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31994): Terminating (SIGTERM) 21:52:52.002404 --- ParallelTerminationStrategy: PID 31988 died... 21:52:52.023013 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31988): Terminated: ok {rc=0} 21:52:52.069864 --- ParallelTerminationStrategy: PID 31991 died... 21:52:52.089573 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31991): Terminated: ok {rc=0} 21:52:52.136566 --- ParallelTerminationStrategy: PID 31994 died... 21:52:52.156321 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31994): Terminated: ok {rc=0} 21:52:52.244404 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 encryption --------------------------------------------------------------------- 21:52:53.440928 tst encryption: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:52:53.444502 tst encryption: Verifying 1 x bts (candidates: 11) 21:52:53.466488 tst encryption: Verifying 6 x ip_address (candidates: 9) 21:52:53.494747 tst encryption: Verifying 1 x modem (candidates: 12) 21:52:53.531913 tst encryption: Reserving 1 x bts (candidates: 11) 21:52:53.553469 tst encryption: Reserving 6 x ip_address (candidates: 9) 21:52:53.583748 tst encryption: Reserving 1 x modem (candidates: 12) 21:52:54.107585 tst encryption: RESERVED RESOURCES for encryption: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2382 encryption register_a5_0_authopt.py ---------------------------------------------- 21:52:54.163378 tst encryption: Using 1 x ip_address (candidates: 6) 21:52:54.174477 tst encryption: Using 1 x bts (candidates: 1) 21:52:54.210908 tst register_a5_0_authopt.py: using LAC 31744 21:52:54.341194 tst register_a5_0_authopt.py: using RAC 124 21:52:54.472342 tst register_a5_0_authopt.py: using CellId 31744 21:52:54.605110 tst register_a5_0_authopt.py: using BVCI 31745 21:52:54.727063 tst encryption: Using 1 x ip_address (candidates: 6) 21:52:54.737940 tst encryption: Using 1 x ip_address (candidates: 6) 21:52:54.748655 tst encryption: Using 1 x ip_address (candidates: 6) 21:52:54.759427 tst encryption: Using 1 x ip_address (candidates: 6) 21:52:54.770123 tst encryption: Using 1 x ip_address (candidates: 6) 21:52:54.780731 tst encryption: Using 1 x modem (candidates: 1) 21:52:54.900607 tst register_a5_0_authopt.py:8: start network... 21:52:55.125717 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:52:55.639347 run create_hlr_db(pid=32000): Launched 21:52:55.773482 bus /sierra_2: Setting Powered False 21:52:56.839066 run create_hlr_db(pid=32000): Terminated: ok {rc=0} 21:52:57.298612 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32002): Launched 21:52:57.630094 run osmo-hlr_10.42.42.2(pid=32003): Launched 21:52:57.757136 run osmo-stp_10.42.42.5: Starting osmo-stp 21:52:58.326775 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32005): Launched 21:52:58.657081 run osmo-stp_10.42.42.5(pid=32006): Launched 21:52:58.783771 run osmo-msc_10.42.42.6: Starting osmo-msc 21:52:59.379574 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32008): Launched 21:52:59.709642 run osmo-msc_10.42.42.6(pid=32009): Launched 21:52:59.894309 run osmo-stp_10.42.42.5(pid=32006): ERR: Terminated: ERROR {rc=1} [trial-2382↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32006)] 21:53:00.034369 run osmo-stp_10.42.42.5(pid=32006): stdout: | (launched: 2022-12-12_21:52:58.597503) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:53:00.174233 run osmo-stp_10.42.42.5(pid=32006): stderr: | 20221212215258794 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212215258794 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212215258795 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212215258795 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212215258796 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212215258796 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212215258796 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:53:00.312116 run osmo-stp_10.42.42.5(pid=32006): stdout: | (launched: 2022-12-12_21:52:58.597503) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:53:00.443947 run osmo-stp_10.42.42.5(pid=32006): stderr: | 20221212215258794 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212215258794 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212215258795 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212215258795 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212215258796 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212215258796 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212215258796 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:53:00.601756 tst register_a5_0_authopt.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32006): Process ended prematurely: osmo-stp_10.42.42.5(pid=32006) [trial-2382↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32006)] [trial-2382↪encryption↪register_a5_0_authopt.py:8] 21:53:00.611158 tst register_a5_0_authopt.py:8: Test FAILED (6.5 sec) 21:53:00.638775 run osmo-hlr_10.42.42.2(pid=32003): ERR: Terminated: ERROR {rc=237} [trial-2382↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32003)] 21:53:00.689345 run osmo-hlr_10.42.42.2(pid=32003): stdout: | (launched: 2022-12-12_21:52:57.570539) 21:53:00.741687 run osmo-hlr_10.42.42.2(pid=32003): stderr: | 20221212215257770 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212215257770 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212215257770 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212215257770 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212215257770 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212215257770 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212215257783 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/encryption/register_a5_0_authopt.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212215257791 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212215257793 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212215257793 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:53:00.814882 run osmo-msc_10.42.42.6(pid=32009): ERR: Terminated: ERROR {rc=2} [trial-2382↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32009)] 21:53:00.882840 run osmo-msc_10.42.42.6(pid=32009): stdout: | (launched: 2022-12-12_21:52:59.650220) 21:53:00.946622 run osmo-msc_10.42.42.6(pid=32009): stderr: | 20221212215259977 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212215259977 DLGLOBAL DEBUG validating counter group 0x7fa4a73a1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212215259977 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212215259977 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212215259977 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212215259977 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212215259979 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212215259979 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212215259979 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212215259980 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:53:00.999759 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32002): Terminating (SIGTERM) 21:53:01.042367 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32005): Terminating (SIGTERM) 21:53:01.085035 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32008): Terminating (SIGTERM) 21:53:01.128137 --- ParallelTerminationStrategy: PID 32002 died... 21:53:01.148407 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32002): Terminated: ok {rc=0} 21:53:01.196444 --- ParallelTerminationStrategy: PID 32005 died... 21:53:01.216887 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32005): Terminated: ok {rc=0} 21:53:01.264212 --- ParallelTerminationStrategy: PID 32008 died... 21:53:01.284511 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32008): Terminated: ok {rc=0} 21:53:01.374133 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2382 encryption register_a5_0_authreq.py ---------------------------------------------- 21:53:02.526156 tst encryption: Using 1 x ip_address (candidates: 6) 21:53:02.537587 tst encryption: Using 1 x bts (candidates: 1) 21:53:02.574243 tst register_a5_0_authreq.py: using LAC 31745 21:53:02.706284 tst register_a5_0_authreq.py: using RAC 125 21:53:02.837945 tst register_a5_0_authreq.py: using CellId 31745 21:53:02.969080 tst register_a5_0_authreq.py: using BVCI 31746 21:53:03.090204 tst encryption: Using 1 x ip_address (candidates: 6) 21:53:03.101205 tst encryption: Using 1 x ip_address (candidates: 6) 21:53:03.111886 tst encryption: Using 1 x ip_address (candidates: 6) 21:53:03.122761 tst encryption: Using 1 x ip_address (candidates: 6) 21:53:03.133655 tst encryption: Using 1 x ip_address (candidates: 6) 21:53:03.144234 tst encryption: Using 1 x modem (candidates: 1) 21:53:03.262030 tst register_a5_0_authreq.py:8: start network... 21:53:03.472274 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:53:03.950519 run create_hlr_db(pid=32011): Launched 21:53:04.069562 bus /sierra_2: Setting Powered False 21:53:05.131643 run create_hlr_db(pid=32011): Terminated: ok {rc=0} 21:53:05.583923 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32013): Launched 21:53:05.917130 run osmo-hlr_10.42.42.2(pid=32014): Launched 21:53:06.044141 run osmo-stp_10.42.42.5: Starting osmo-stp 21:53:06.613572 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32016): Launched 21:53:06.946064 run osmo-stp_10.42.42.5(pid=32017): Launched 21:53:07.072522 run osmo-msc_10.42.42.6: Starting osmo-msc 21:53:07.671313 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32019): Launched 21:53:08.002789 run osmo-msc_10.42.42.6(pid=32020): Launched 21:53:08.188166 run osmo-stp_10.42.42.5(pid=32017): ERR: Terminated: ERROR {rc=1} [trial-2382↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32017)] 21:53:08.328618 run osmo-stp_10.42.42.5(pid=32017): stdout: | (launched: 2022-12-12_21:53:06.885895) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:53:08.469194 run osmo-stp_10.42.42.5(pid=32017): stderr: | 20221212215307080 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212215307080 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212215307080 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212215307080 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212215307081 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212215307081 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212215307081 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:53:08.608157 run osmo-stp_10.42.42.5(pid=32017): stdout: | (launched: 2022-12-12_21:53:06.885895) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:53:08.740283 run osmo-stp_10.42.42.5(pid=32017): stderr: | 20221212215307080 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212215307080 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212215307080 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212215307080 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212215307081 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212215307081 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212215307081 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:53:08.898727 tst register_a5_0_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32017): Process ended prematurely: osmo-stp_10.42.42.5(pid=32017) [trial-2382↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32017)] [trial-2382↪encryption↪register_a5_0_authreq.py:8] 21:53:08.908050 tst register_a5_0_authreq.py:8: Test FAILED (6.4 sec) 21:53:08.935907 run osmo-hlr_10.42.42.2(pid=32014): ERR: Terminated: ERROR {rc=237} [trial-2382↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32014)] 21:53:08.986797 run osmo-hlr_10.42.42.2(pid=32014): stdout: | (launched: 2022-12-12_21:53:05.856681) 21:53:09.039298 run osmo-hlr_10.42.42.2(pid=32014): stderr: | 20221212215306057 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212215306057 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212215306057 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212215306057 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212215306057 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212215306057 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212215306070 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/encryption/register_a5_0_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212215306078 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212215306078 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212215306079 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:53:09.112401 run osmo-msc_10.42.42.6(pid=32020): ERR: Terminated: ERROR {rc=2} [trial-2382↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32020)] 21:53:09.163059 run osmo-msc_10.42.42.6(pid=32020): stdout: | (launched: 2022-12-12_21:53:07.942910) 21:53:09.215632 run osmo-msc_10.42.42.6(pid=32020): stderr: | 20221212215308266 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212215308266 DLGLOBAL DEBUG validating counter group 0x7fdee4bb8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212215308266 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212215308266 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212215308266 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212215308266 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212215308268 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212215308268 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212215308269 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212215308269 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:53:09.268331 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32013): Terminating (SIGTERM) 21:53:09.310768 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32016): Terminating (SIGTERM) 21:53:09.353135 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32019): Terminating (SIGTERM) 21:53:09.395792 --- ParallelTerminationStrategy: PID 32013 died... 21:53:09.416047 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32013): Terminated: ok {rc=0} 21:53:09.463508 --- ParallelTerminationStrategy: PID 32016 died... 21:53:09.483224 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32016): Terminated: ok {rc=0} 21:53:09.530725 --- ParallelTerminationStrategy: PID 32019 died... 21:53:09.550704 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32019): Terminated: ok {rc=0} 21:53:09.638918 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2382 encryption register_a5_1_authreq.py ---------------------------------------------- 21:53:10.789477 tst encryption: Using 1 x ip_address (candidates: 6) 21:53:10.800659 tst encryption: Using 1 x bts (candidates: 1) 21:53:10.841871 tst register_a5_1_authreq.py: using LAC 31746 21:53:10.972531 tst register_a5_1_authreq.py: using RAC 126 21:53:11.102957 tst register_a5_1_authreq.py: using CellId 31746 21:53:11.233024 tst register_a5_1_authreq.py: using BVCI 31747 21:53:11.354282 tst encryption: Using 1 x ip_address (candidates: 6) 21:53:11.365243 tst encryption: Using 1 x ip_address (candidates: 6) 21:53:11.375969 tst encryption: Using 1 x ip_address (candidates: 6) 21:53:11.386701 tst encryption: Using 1 x ip_address (candidates: 6) 21:53:11.397934 tst encryption: Using 1 x ip_address (candidates: 6) 21:53:11.408530 tst encryption: Using 1 x modem (candidates: 1) 21:53:11.524787 tst register_a5_1_authreq.py:8: start network... 21:53:11.735018 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:53:12.213375 run create_hlr_db(pid=32022): Launched 21:53:12.333929 bus /sierra_2: Setting Powered False 21:53:13.395865 run create_hlr_db(pid=32022): Terminated: ok {rc=0} 21:53:13.849515 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32024): Launched 21:53:14.184210 run osmo-hlr_10.42.42.2(pid=32025): Launched 21:53:14.311739 run osmo-stp_10.42.42.5: Starting osmo-stp 21:53:14.884452 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32027): Launched 21:53:15.217365 run osmo-stp_10.42.42.5(pid=32028): Launched 21:53:15.345478 run osmo-msc_10.42.42.6: Starting osmo-msc 21:53:15.985858 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32030): Launched 21:53:16.341605 run osmo-msc_10.42.42.6(pid=32031): Launched 21:53:16.660332 run osmo-stp_10.42.42.5(pid=32028): ERR: Terminated: ERROR {rc=1} [trial-2382↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32028)] 21:53:16.942137 run osmo-stp_10.42.42.5(pid=32028): stdout: | (launched: 2022-12-12_21:53:15.157109) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:53:17.288109 run osmo-stp_10.42.42.5(pid=32028): stderr: | 20221212215315351 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212215315351 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212215315352 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212215315352 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212215315352 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212215315353 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212215315353 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:53:17.463174 run osmo-stp_10.42.42.5(pid=32028): stdout: | (launched: 2022-12-12_21:53:15.157109) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:53:17.595729 run osmo-stp_10.42.42.5(pid=32028): stderr: | 20221212215315351 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212215315351 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212215315352 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212215315352 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212215315352 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212215315353 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212215315353 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:53:17.753983 tst register_a5_1_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32028): Process ended prematurely: osmo-stp_10.42.42.5(pid=32028) [trial-2382↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32028)] [trial-2382↪encryption↪register_a5_1_authreq.py:8] 21:53:17.763492 tst register_a5_1_authreq.py:8: Test FAILED (7.0 sec) 21:53:17.791470 run osmo-hlr_10.42.42.2(pid=32025): ERR: Terminated: ERROR {rc=237} [trial-2382↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32025)] 21:53:17.842343 run osmo-hlr_10.42.42.2(pid=32025): stdout: | (launched: 2022-12-12_21:53:14.124008) 21:53:17.894916 run osmo-hlr_10.42.42.2(pid=32025): stderr: | 20221212215314326 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212215314326 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212215314326 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212215314326 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212215314326 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212215314326 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212215314340 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/encryption/register_a5_1_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212215314350 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212215314350 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212215314350 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:53:17.968924 run osmo-msc_10.42.42.6(pid=32031): ERR: Terminated: ERROR {rc=2} [trial-2382↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32031)] 21:53:18.019815 run osmo-msc_10.42.42.6(pid=32031): stdout: | (launched: 2022-12-12_21:53:16.270110) 21:53:18.072598 run osmo-msc_10.42.42.6(pid=32031): stderr: | 20221212215316854 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212215316855 DLGLOBAL DEBUG validating counter group 0x7f22b71dfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212215316855 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212215316855 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212215316856 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212215316858 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212215316862 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212215316862 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212215316863 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212215316863 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:53:18.125712 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32024): Terminating (SIGTERM) 21:53:18.168225 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32027): Terminating (SIGTERM) 21:53:18.210930 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32030): Terminating (SIGTERM) 21:53:18.253731 --- ParallelTerminationStrategy: PID 32024 died... 21:53:18.274063 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32024): Terminated: ok {rc=0} 21:53:18.321324 --- ParallelTerminationStrategy: PID 32027 died... 21:53:18.341181 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32027): Terminated: ok {rc=0} 21:53:18.387897 --- ParallelTerminationStrategy: PID 32030 died... 21:53:18.407708 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32030): Terminated: ok {rc=0} 21:53:18.496625 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2382 encryption register_a5_3_authreq.py ---------------------------------------------- 21:53:19.649718 tst encryption: Using 1 x ip_address (candidates: 6) 21:53:19.661209 tst encryption: Using 1 x bts (candidates: 1) 21:53:19.697488 tst register_a5_3_authreq.py: using LAC 31747 21:53:19.828174 tst register_a5_3_authreq.py: using RAC 127 21:53:19.958252 tst register_a5_3_authreq.py: using CellId 31747 21:53:20.088505 tst register_a5_3_authreq.py: using BVCI 31748 21:53:20.210039 tst encryption: Using 1 x ip_address (candidates: 6) 21:53:20.220800 tst encryption: Using 1 x ip_address (candidates: 6) 21:53:20.231608 tst encryption: Using 1 x ip_address (candidates: 6) 21:53:20.242239 tst encryption: Using 1 x ip_address (candidates: 6) 21:53:20.252850 tst encryption: Using 1 x ip_address (candidates: 6) 21:53:20.263571 tst encryption: Using 1 x modem (candidates: 1) 21:53:20.388146 tst register_a5_3_authreq.py:8: start network... 21:53:20.598666 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:53:21.079199 run create_hlr_db(pid=32033): Launched 21:53:21.199596 bus /sierra_2: Setting Powered False 21:53:22.261326 run create_hlr_db(pid=32033): Terminated: ok {rc=0} 21:53:22.713820 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32035): Launched 21:53:23.046729 run osmo-hlr_10.42.42.2(pid=32036): Launched 21:53:23.174040 run osmo-stp_10.42.42.5: Starting osmo-stp 21:53:23.744791 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32038): Launched 21:53:24.076737 run osmo-stp_10.42.42.5(pid=32039): Launched 21:53:24.203712 run osmo-msc_10.42.42.6: Starting osmo-msc 21:53:24.801768 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32041): Launched 21:53:25.132428 run osmo-msc_10.42.42.6(pid=32042): Launched 21:53:25.317727 run osmo-stp_10.42.42.5(pid=32039): ERR: Terminated: ERROR {rc=1} [trial-2382↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32039)] 21:53:25.458039 run osmo-stp_10.42.42.5(pid=32039): stdout: | (launched: 2022-12-12_21:53:24.016778) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:53:25.599093 run osmo-stp_10.42.42.5(pid=32039): stderr: | 20221212215324209 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212215324209 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212215324209 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212215324210 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212215324212 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212215324212 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212215324212 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:53:25.738447 run osmo-stp_10.42.42.5(pid=32039): stdout: | (launched: 2022-12-12_21:53:24.016778) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:53:25.870623 run osmo-stp_10.42.42.5(pid=32039): stderr: | 20221212215324209 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212215324209 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212215324209 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212215324210 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212215324212 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212215324212 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212215324212 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:53:26.029289 tst register_a5_3_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32039): Process ended prematurely: osmo-stp_10.42.42.5(pid=32039) [trial-2382↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32039)] [trial-2382↪encryption↪register_a5_3_authreq.py:8] 21:53:26.038748 tst register_a5_3_authreq.py:8: Test FAILED (6.4 sec) 21:53:26.066393 run osmo-hlr_10.42.42.2(pid=32036): ERR: Terminated: ERROR {rc=237} [trial-2382↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32036)] 21:53:26.117243 run osmo-hlr_10.42.42.2(pid=32036): stdout: | (launched: 2022-12-12_21:53:22.987221) 21:53:26.169491 run osmo-hlr_10.42.42.2(pid=32036): stderr: | 20221212215323188 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212215323188 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212215323188 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212215323188 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212215323188 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212215323188 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212215323200 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/encryption/register_a5_3_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212215323209 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212215323209 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212215323209 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:53:26.242360 run osmo-msc_10.42.42.6(pid=32042): ERR: Terminated: ERROR {rc=2} [trial-2382↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32042)] 21:53:26.292780 run osmo-msc_10.42.42.6(pid=32042): stdout: | (launched: 2022-12-12_21:53:25.072666) 21:53:26.345158 run osmo-msc_10.42.42.6(pid=32042): stderr: | 20221212215325396 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212215325396 DLGLOBAL DEBUG validating counter group 0x7fcb14fe4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212215325396 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212215325396 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212215325396 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212215325397 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212215325398 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212215325399 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212215325399 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212215325399 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:53:26.397647 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32035): Terminating (SIGTERM) 21:53:26.439800 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32038): Terminating (SIGTERM) 21:53:26.482206 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32041): Terminating (SIGTERM) 21:53:26.524362 --- ParallelTerminationStrategy: PID 32035 died... 21:53:26.544452 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32035): Terminated: ok {rc=0} 21:53:26.591015 --- ParallelTerminationStrategy: PID 32038 died... 21:53:26.610659 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32038): Terminated: ok {rc=0} 21:53:26.657244 --- ParallelTerminationStrategy: PID 32041 died... 21:53:26.676726 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32041): Terminated: ok {rc=0} 21:53:26.764756 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 encryption FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 4g:srsenb-rftype@zmq+srsue-rftype@zmq --------------------------------------------------------------------- 21:53:27.969903 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:53:27.974771 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x enb (candidates: 2) 21:53:27.992600 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x modem (candidates: 12) 21:53:28.021758 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x run_node (candidates: 1) 21:53:28.050595 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x enb (candidates: 2) 21:53:28.068785 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x modem (candidates: 12) 21:53:28.095701 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x run_node (candidates: 1) 21:53:28.606014 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: RESERVED RESOURCES for 4g: enb srsENB-zmq modem srsUE-zmq_1 run_node e55cbce541824969b492cc4fa86bdef69cf65e7d ---------------------------------------------- trial-2382 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover.py ---------------------------------------------- 21:53:28.610676 tst handover.py:11: TEST_CONFIG: {} 21:53:28.819205 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 21:53:28.834927 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 21:53:28.858297 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 21:53:28.907346 tst handover.py: using MSISDN 7993 21:53:29.022653 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7993', subscriber_id=0} 21:53:29.131671 run srsepc_10.42.42.118: Starting srsepc 21:53:31.026945 run rm-remote-dir(pid=32047): Launched 21:53:31.185991 bus /sierra_2: Setting Powered False 21:53:32.251457 run rm-remote-dir(pid=32047): Terminated: ok {rc=0} 21:53:32.760108 run mk-remote-dir(pid=32048): Launched 21:53:33.940677 run mk-remote-dir(pid=32048): Terminated: ok {rc=0} 21:53:34.229234 run scp-inst-to-remote(pid=32049): Launched 21:53:36.411759 run scp-inst-to-remote(pid=32049): Terminated: ok {rc=0} 21:53:36.771544 run rm-remote-dir(pid=32051): Launched 21:53:37.964525 run rm-remote-dir(pid=32051): Terminated: ok {rc=0} 21:53:38.326454 run mk-remote-dir(pid=32052): Launched 21:53:39.520031 run mk-remote-dir(pid=32052): Terminated: ok {rc=0} 21:53:39.829300 run scp-cfg-to-remote(pid=32053): Launched 21:53:41.019900 run scp-cfg-to-remote(pid=32053): Terminated: ok {rc=0} 21:53:41.325621 run scp-db-to-remote(pid=32055): Launched 21:53:42.517618 run scp-db-to-remote(pid=32055): Terminated: ok {rc=0} 21:53:42.659201 run srsepc_10.42.42.118: Setting RPATH for srsepc 21:53:42.991663 run patchelf(pid=32057): Launched 21:53:44.182688 run patchelf(pid=32057): Terminated: ok {rc=0} 21:53:44.324156 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 21:53:44.656463 run setcap-netadm(pid=32058): Launched 21:53:45.859353 run setcap-netadm(pid=32058): Terminated: ok {rc=0} 21:53:46.216697 run srsepc(pid=32059): Launched 21:53:46.455731 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 21:53:47.986746 run rm-remote-dir(pid=32124): Launched 21:53:48.372459 run srsepc(pid=32059): ERR: Terminated: ERROR {rc=127} [trial-2382↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=32059)] 21:53:48.540592 run srsepc(pid=32059): stdout: | (launched: 2022-12-12_21:53:46.151028) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 21:53:48.708570 run srsepc(pid=32059): stderr: | (launched: 2022-12-12_21:53:46.199011) | Connection to 10.42.42.116 closed. 21:53:48.887199 run srsepc(pid=32059): stdout: | (launched: 2022-12-12_21:53:46.151028) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 21:53:49.048111 run srsepc(pid=32059): stderr: | (launched: 2022-12-12_21:53:46.199011) | Connection to 10.42.42.116 closed. 21:53:49.264115 run rm-remote-dir(pid=32124): Terminating (SIGINT) 21:53:49.496717 run rm-remote-dir(pid=32124): Terminated: ok {rc=0} 21:53:49.663234 tst handover.py:37: ERR: Error: srsepc(pid=32059): Process ended prematurely: srsepc(pid=32059) [trial-2382↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=32059)] [trial-2382↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37] 21:53:49.677629 tst handover.py:37: Test FAILED (21.1 sec) 21:53:49.795665 run scp-back-log(pid=32305): Launched 21:53:50.931011 run scp-back-log(pid=32305): ERR: Terminated: ERROR {rc=1} [trial-2382↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=32305)] 21:53:50.998329 run scp-back-log(pid=32305): stdout: | (launched: 2022-12-12_21:53:49.742894) 21:53:51.066697 run scp-back-log(pid=32305): stderr: | (launched: 2022-12-12_21:53:49.768565) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 21:53:51.143338 tst srsepc_10.42.42.118: Error('scp-back-log(pid=32305): launch_sync(): local process exited with status 1 [trial-2382↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=32305)]') ---------------------------------------------- trial-2382 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_bidir.py ---------------------------------------------- 21:53:51.194201 tst iperf3_bidir.py:13: Number of physical ue: 1 21:53:51.424294 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 21:53:51.467819 tst iperf3_bidir.py:20: ue index0: srsue_10.42.42.116 21:53:51.694937 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 21:53:51.712014 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 21:53:51.745396 tst iperf3_bidir.py: using MSISDN 7994 21:53:51.870212 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7994', subscriber_id=0} 21:53:51.989443 run srsepc_10.42.42.118: Starting srsepc 21:53:52.686153 run rm-remote-dir(pid=32335): Launched 21:53:53.943275 run rm-remote-dir(pid=32335): Terminated: ok {rc=0} 21:53:54.321681 run mk-remote-dir(pid=32336): Launched 21:53:55.553869 run mk-remote-dir(pid=32336): Terminated: ok {rc=0} 21:53:55.865618 run scp-inst-to-remote(pid=32337): Launched 21:53:58.091554 run scp-inst-to-remote(pid=32337): Terminated: ok {rc=0} 21:53:58.448002 run rm-remote-dir(pid=32339): Launched 21:53:59.656904 run rm-remote-dir(pid=32339): Terminated: ok {rc=0} 21:54:00.019396 run mk-remote-dir(pid=32340): Launched 21:54:01.280036 run mk-remote-dir(pid=32340): Terminated: ok {rc=0} 21:54:01.655158 run scp-cfg-to-remote(pid=32341): Launched 21:54:02.957369 run scp-cfg-to-remote(pid=32341): Terminated: ok {rc=0} 21:54:03.268029 run scp-db-to-remote(pid=32343): Launched 21:54:04.487784 run scp-db-to-remote(pid=32343): Terminated: ok {rc=0} 21:54:04.633993 run srsepc_10.42.42.118: Setting RPATH for srsepc 21:54:04.982350 run patchelf(pid=32345): Launched 21:54:06.239087 run patchelf(pid=32345): Terminated: ok {rc=0} 21:54:06.386067 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 21:54:06.732118 run setcap-netadm(pid=32346): Launched 21:54:07.985669 run setcap-netadm(pid=32346): Terminated: ok {rc=0} 21:54:08.348864 run srsepc(pid=32347): Launched 21:54:08.537393 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 21:54:09.831634 run rm-remote-dir(pid=32348): Launched 21:54:10.008754 run srsepc(pid=32347): ERR: Terminated: ERROR {rc=127} [trial-2382↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=32347)] 21:54:10.145093 run srsepc(pid=32347): stdout: | (launched: 2022-12-12_21:54:08.283456) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 21:54:10.281962 run srsepc(pid=32347): stderr: | (launched: 2022-12-12_21:54:08.334231) | Connection to 10.42.42.116 closed. 21:54:10.418545 run srsepc(pid=32347): stdout: | (launched: 2022-12-12_21:54:08.283456) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 21:54:10.549094 run srsepc(pid=32347): stderr: | (launched: 2022-12-12_21:54:08.334231) | Connection to 10.42.42.116 closed. 21:54:10.704034 run rm-remote-dir(pid=32348): Terminating (SIGINT) 21:54:10.884116 run rm-remote-dir(pid=32348): Terminated: ok {rc=0} 21:54:11.015154 tst iperf3_bidir.py:42: ERR: Error: srsepc(pid=32347): Process ended prematurely: srsepc(pid=32347) [trial-2382↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=32347)] [trial-2382↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42] 21:54:11.025047 tst iperf3_bidir.py:42: Test FAILED (19.8 sec) 21:54:11.101945 run scp-back-log(pid=32349): Launched 21:54:12.179962 run scp-back-log(pid=32349): ERR: Terminated: ERROR {rc=1} [trial-2382↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=32349)] 21:54:12.241560 run scp-back-log(pid=32349): stdout: | (launched: 2022-12-12_21:54:11.072093) 21:54:12.304791 run scp-back-log(pid=32349): stderr: | (launched: 2022-12-12_21:54:11.092101) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 21:54:12.375839 tst srsepc_10.42.42.118: Error('scp-back-log(pid=32349): launch_sync(): local process exited with status 1 [trial-2382↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=32349)]') ---------------------------------------------- trial-2382 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_dl.py ---------------------------------------------- 21:54:12.421566 tst iperf3_dl.py:13: Number of physical ue: 1 21:54:12.629558 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 21:54:12.674081 tst iperf3_dl.py:20: ue index0: srsue_10.42.42.116 21:54:12.881224 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 21:54:12.896829 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 21:54:12.929072 tst iperf3_dl.py: using MSISDN 7995 21:54:13.041252 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7995', subscriber_id=0} 21:54:13.149925 run srsepc_10.42.42.118: Starting srsepc 21:54:13.781052 run rm-remote-dir(pid=32351): Launched 21:54:14.961553 run rm-remote-dir(pid=32351): Terminated: ok {rc=0} 21:54:15.298357 run mk-remote-dir(pid=32352): Launched 21:54:16.476623 run mk-remote-dir(pid=32352): Terminated: ok {rc=0} 21:54:16.779011 run scp-inst-to-remote(pid=32353): Launched 21:54:18.969880 run scp-inst-to-remote(pid=32353): Terminated: ok {rc=0} 21:54:19.306365 run rm-remote-dir(pid=32355): Launched 21:54:20.486701 run rm-remote-dir(pid=32355): Terminated: ok {rc=0} 21:54:20.825048 run mk-remote-dir(pid=32356): Launched 21:54:22.004544 run mk-remote-dir(pid=32356): Terminated: ok {rc=0} 21:54:22.292733 run scp-cfg-to-remote(pid=32357): Launched 21:54:23.470127 run scp-cfg-to-remote(pid=32357): Terminated: ok {rc=0} 21:54:23.755261 run scp-db-to-remote(pid=32359): Launched 21:54:24.933160 run scp-db-to-remote(pid=32359): Terminated: ok {rc=0} 21:54:25.065858 run srsepc_10.42.42.118: Setting RPATH for srsepc 21:54:25.376569 run patchelf(pid=32361): Launched 21:54:26.554518 run patchelf(pid=32361): Terminated: ok {rc=0} 21:54:26.687703 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 21:54:26.998895 run setcap-netadm(pid=32362): Launched 21:54:28.176538 run setcap-netadm(pid=32362): Terminated: ok {rc=0} 21:54:28.502648 run srsepc(pid=32363): Launched 21:54:28.617328 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 21:54:29.735299 run rm-remote-dir(pid=32364): Launched 21:54:29.911542 run srsepc(pid=32363): ERR: Terminated: ERROR {rc=127} [trial-2382↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=32363)] 21:54:30.047872 run srsepc(pid=32363): stdout: | (launched: 2022-12-12_21:54:28.446305) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 21:54:30.185626 run srsepc(pid=32363): stderr: | (launched: 2022-12-12_21:54:28.492439) | Connection to 10.42.42.116 closed. 21:54:30.322600 run srsepc(pid=32363): stdout: | (launched: 2022-12-12_21:54:28.446305) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 21:54:30.453778 run srsepc(pid=32363): stderr: | (launched: 2022-12-12_21:54:28.492439) | Connection to 10.42.42.116 closed. 21:54:30.609069 run rm-remote-dir(pid=32364): Terminating (SIGINT) 21:54:30.789280 run rm-remote-dir(pid=32364): Terminated: ok {rc=0} 21:54:30.950206 tst iperf3_dl.py:42: ERR: Error: srsepc(pid=32363): Process ended prematurely: srsepc(pid=32363) [trial-2382↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=32363)] [trial-2382↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42] 21:54:30.962733 tst iperf3_dl.py:42: Test FAILED (18.5 sec) 21:54:31.059231 run scp-back-log(pid=32365): Launched 21:54:32.174820 run scp-back-log(pid=32365): ERR: Terminated: ERROR {rc=1} [trial-2382↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=32365)] 21:54:32.239804 run scp-back-log(pid=32365): stdout: | (launched: 2022-12-12_21:54:31.015294) 21:54:32.306140 run scp-back-log(pid=32365): stderr: | (launched: 2022-12-12_21:54:31.038684) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 21:54:32.378676 tst srsepc_10.42.42.118: Error('scp-back-log(pid=32365): launch_sync(): local process exited with status 1 [trial-2382↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=32365)]') ---------------------------------------------- trial-2382 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_ul.py ---------------------------------------------- 21:54:32.424695 tst iperf3_ul.py:13: Number of physical ue: 1 21:54:32.631922 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 21:54:32.673449 tst iperf3_ul.py:20: ue index0: srsue_10.42.42.116 21:54:32.880400 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 21:54:32.896150 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 21:54:32.929458 tst iperf3_ul.py: using MSISDN 7996 21:54:33.041050 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7996', subscriber_id=0} 21:54:33.149116 run srsepc_10.42.42.118: Starting srsepc 21:54:33.778962 run rm-remote-dir(pid=32367): Launched 21:54:34.959539 run rm-remote-dir(pid=32367): Terminated: ok {rc=0} 21:54:35.297448 run mk-remote-dir(pid=32369): Launched 21:54:36.476259 run mk-remote-dir(pid=32369): Terminated: ok {rc=0} 21:54:36.764882 run scp-inst-to-remote(pid=32370): Launched 21:54:38.943747 run scp-inst-to-remote(pid=32370): Terminated: ok {rc=0} 21:54:39.279237 run rm-remote-dir(pid=32372): Launched 21:54:40.459276 run rm-remote-dir(pid=32372): Terminated: ok {rc=0} 21:54:40.797468 run mk-remote-dir(pid=32373): Launched 21:54:41.976681 run mk-remote-dir(pid=32373): Terminated: ok {rc=0} 21:54:42.265108 run scp-cfg-to-remote(pid=32374): Launched 21:54:43.442974 run scp-cfg-to-remote(pid=32374): Terminated: ok {rc=0} 21:54:43.728456 run scp-db-to-remote(pid=32376): Launched 21:54:44.906565 run scp-db-to-remote(pid=32376): Terminated: ok {rc=0} 21:54:45.039054 run srsepc_10.42.42.118: Setting RPATH for srsepc 21:54:45.349555 run patchelf(pid=32378): Launched 21:54:46.526604 run patchelf(pid=32378): Terminated: ok {rc=0} 21:54:46.665148 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 21:54:46.989784 run setcap-netadm(pid=32379): Launched 21:54:48.222107 run setcap-netadm(pid=32379): Terminated: ok {rc=0} 21:54:48.549556 run srsepc(pid=32380): Launched 21:54:48.665408 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 21:54:49.774301 run rm-remote-dir(pid=32381): Launched 21:54:49.950483 run srsepc(pid=32380): ERR: Terminated: ERROR {rc=127} [trial-2382↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=32380)] 21:54:50.085359 run srsepc(pid=32380): stdout: | (launched: 2022-12-12_21:54:48.493217) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 21:54:50.221982 run srsepc(pid=32380): stderr: | (launched: 2022-12-12_21:54:48.539383) | Connection to 10.42.42.116 closed. 21:54:50.359220 run srsepc(pid=32380): stdout: | (launched: 2022-12-12_21:54:48.493217) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 21:54:50.489406 run srsepc(pid=32380): stderr: | (launched: 2022-12-12_21:54:48.539383) | Connection to 10.42.42.116 closed. 21:54:50.643818 run rm-remote-dir(pid=32381): Terminating (SIGINT) 21:54:50.823293 run rm-remote-dir(pid=32381): Terminated: ok {rc=0} 21:54:50.953403 tst iperf3_ul.py:42: ERR: Error: srsepc(pid=32380): Process ended prematurely: srsepc(pid=32380) [trial-2382↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=32380)] [trial-2382↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42] 21:54:50.963359 tst iperf3_ul.py:42: Test FAILED (18.5 sec) 21:54:51.040588 run scp-back-log(pid=32382): Launched 21:54:52.118587 run scp-back-log(pid=32382): ERR: Terminated: ERROR {rc=1} [trial-2382↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=32382)] 21:54:52.180147 run scp-back-log(pid=32382): stdout: | (launched: 2022-12-12_21:54:51.010535) 21:54:52.243409 run scp-back-log(pid=32382): stderr: | (launched: 2022-12-12_21:54:51.030407) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 21:54:52.314508 tst srsepc_10.42.42.118: Error('scp-back-log(pid=32382): launch_sync(): local process exited with status 1 [trial-2382↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=32382)]') ---------------------------------------------- trial-2382 4g:srsenb-rftype@zmq+srsue-rftype@zmq ping.py ---------------------------------------------- 21:54:52.361142 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 21:54:52.377491 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 21:54:52.400272 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 21:54:52.454617 tst ping.py: using MSISDN 7997 21:54:52.569686 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7997', subscriber_id=0} 21:54:52.678046 run srsepc_10.42.42.118: Starting srsepc 21:54:53.309407 run rm-remote-dir(pid=32384): Launched 21:54:54.488487 run rm-remote-dir(pid=32384): Terminated: ok {rc=0} 21:54:54.825818 run mk-remote-dir(pid=32385): Launched 21:54:56.004089 run mk-remote-dir(pid=32385): Terminated: ok {rc=0} 21:54:56.291740 run scp-inst-to-remote(pid=32386): Launched 21:54:58.472514 run scp-inst-to-remote(pid=32386): Terminated: ok {rc=0} 21:54:58.809036 run rm-remote-dir(pid=32388): Launched 21:54:59.988777 run rm-remote-dir(pid=32388): Terminated: ok {rc=0} 21:55:00.326104 run mk-remote-dir(pid=32389): Launched 21:55:01.510231 run mk-remote-dir(pid=32389): Terminated: ok {rc=0} 21:55:01.837632 run scp-cfg-to-remote(pid=32393): Launched 21:55:03.067476 run scp-cfg-to-remote(pid=32393): Terminated: ok {rc=0} 21:55:03.353095 run scp-db-to-remote(pid=32395): Launched 21:55:04.529948 run scp-db-to-remote(pid=32395): Terminated: ok {rc=0} 21:55:04.662831 run srsepc_10.42.42.118: Setting RPATH for srsepc 21:55:04.972448 run patchelf(pid=32397): Launched 21:55:06.149355 run patchelf(pid=32397): Terminated: ok {rc=0} 21:55:06.281313 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 21:55:06.590855 run setcap-netadm(pid=32398): Launched 21:55:07.767998 run setcap-netadm(pid=32398): Terminated: ok {rc=0} 21:55:08.093142 run srsepc(pid=32399): Launched 21:55:08.207727 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 21:55:09.318927 run rm-remote-dir(pid=32400): Launched 21:55:09.496810 run srsepc(pid=32399): ERR: Terminated: ERROR {rc=127} [trial-2382↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=32399)] 21:55:09.632639 run srsepc(pid=32399): stdout: | (launched: 2022-12-12_21:55:08.036886) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 21:55:09.769745 run srsepc(pid=32399): stderr: | (launched: 2022-12-12_21:55:08.083044) | Connection to 10.42.42.116 closed. 21:55:09.905897 run srsepc(pid=32399): stdout: | (launched: 2022-12-12_21:55:08.036886) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 21:55:10.036859 run srsepc(pid=32399): stderr: | (launched: 2022-12-12_21:55:08.083044) | Connection to 10.42.42.116 closed. 21:55:10.191706 run rm-remote-dir(pid=32400): Terminating (SIGINT) 21:55:10.371859 run rm-remote-dir(pid=32400): Terminated: ok {rc=0} 21:55:10.502635 tst ping.py:16: ERR: Error: srsepc(pid=32399): Process ended prematurely: srsepc(pid=32399) [trial-2382↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=32399)] [trial-2382↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16] 21:55:10.512417 tst ping.py:16: Test FAILED (18.1 sec) 21:55:10.589906 run scp-back-log(pid=32401): Launched 21:55:11.666949 run scp-back-log(pid=32401): ERR: Terminated: ERROR {rc=1} [trial-2382↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=32401)] 21:55:11.728558 run scp-back-log(pid=32401): stdout: | (launched: 2022-12-12_21:55:10.559701) 21:55:11.791564 run scp-back-log(pid=32401): stderr: | (launched: 2022-12-12_21:55:10.579741) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 21:55:11.862425 tst srsepc_10.42.42.118: Error('scp-back-log(pid=32401): launch_sync(): local process exited with status 1 [trial-2382↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=32401)]') ---------------------------------------------- trial-2382 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mo_ping.py ---------------------------------------------- 21:55:11.908243 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 21:55:11.924482 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 21:55:11.947351 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 21:55:11.997371 tst rrc_idle_mo_ping.py: using MSISDN 7998 21:55:12.111616 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7998', subscriber_id=0} 21:55:12.220294 run srsepc_10.42.42.118: Starting srsepc 21:55:12.853055 run rm-remote-dir(pid=32403): Launched 21:55:14.033091 run rm-remote-dir(pid=32403): Terminated: ok {rc=0} 21:55:14.369949 run mk-remote-dir(pid=32404): Launched 21:55:15.548560 run mk-remote-dir(pid=32404): Terminated: ok {rc=0} 21:55:15.843866 run scp-inst-to-remote(pid=32405): Launched 21:55:18.155797 run scp-inst-to-remote(pid=32405): Terminated: ok {rc=0} 21:55:18.491971 run rm-remote-dir(pid=32407): Launched 21:55:19.671382 run rm-remote-dir(pid=32407): Terminated: ok {rc=0} 21:55:20.008537 run mk-remote-dir(pid=32408): Launched 21:55:21.187973 run mk-remote-dir(pid=32408): Terminated: ok {rc=0} 21:55:21.475342 run scp-cfg-to-remote(pid=32410): Launched 21:55:22.650919 run scp-cfg-to-remote(pid=32410): Terminated: ok {rc=0} 21:55:22.936814 run scp-db-to-remote(pid=32412): Launched 21:55:24.114413 run scp-db-to-remote(pid=32412): Terminated: ok {rc=0} 21:55:24.246972 run srsepc_10.42.42.118: Setting RPATH for srsepc 21:55:24.555895 run patchelf(pid=32414): Launched 21:55:25.733946 run patchelf(pid=32414): Terminated: ok {rc=0} 21:55:25.866302 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 21:55:26.175751 run setcap-netadm(pid=32415): Launched 21:55:27.351862 run setcap-netadm(pid=32415): Terminated: ok {rc=0} 21:55:27.676368 run srsepc(pid=32416): Launched 21:55:27.790915 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 21:55:28.903158 run rm-remote-dir(pid=32417): Launched 21:55:29.079812 run srsepc(pid=32416): ERR: Terminated: ERROR {rc=127} [trial-2382↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=32416)] 21:55:29.217180 run srsepc(pid=32416): stdout: | (launched: 2022-12-12_21:55:27.620272) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 21:55:29.354138 run srsepc(pid=32416): stderr: | (launched: 2022-12-12_21:55:27.666221) | Connection to 10.42.42.116 closed. 21:55:29.490666 run srsepc(pid=32416): stdout: | (launched: 2022-12-12_21:55:27.620272) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 21:55:29.620762 run srsepc(pid=32416): stderr: | (launched: 2022-12-12_21:55:27.666221) | Connection to 10.42.42.116 closed. 21:55:29.774810 run rm-remote-dir(pid=32417): Terminating (SIGINT) 21:55:29.954513 run rm-remote-dir(pid=32417): Terminated: ok {rc=0} 21:55:30.084712 tst rrc_idle_mo_ping.py:16: ERR: Error: srsepc(pid=32416): Process ended prematurely: srsepc(pid=32416) [trial-2382↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=32416)] [trial-2382↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16] 21:55:30.094752 tst rrc_idle_mo_ping.py:16: Test FAILED (18.2 sec) 21:55:30.172226 run scp-back-log(pid=32421): Launched 21:55:31.264057 run scp-back-log(pid=32421): ERR: Terminated: ERROR {rc=1} [trial-2382↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=32421)] 21:55:31.344344 run scp-back-log(pid=32421): stdout: | (launched: 2022-12-12_21:55:30.142200) 21:55:31.424856 run scp-back-log(pid=32421): stderr: | (launched: 2022-12-12_21:55:30.162291) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 21:55:31.513090 tst srsepc_10.42.42.118: Error('scp-back-log(pid=32421): launch_sync(): local process exited with status 1 [trial-2382↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=32421)]') ---------------------------------------------- trial-2382 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mt_ping.py ---------------------------------------------- 21:55:31.573051 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 21:55:31.594284 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 21:55:31.629973 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 21:55:31.683213 tst rrc_idle_mt_ping.py: using MSISDN 7999 21:55:31.848203 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7999', subscriber_id=0} 21:55:31.971574 run srsepc_10.42.42.118: Starting srsepc 21:55:32.609732 run rm-remote-dir(pid=32423): Launched 21:55:33.791454 run rm-remote-dir(pid=32423): Terminated: ok {rc=0} 21:55:34.129647 run mk-remote-dir(pid=32424): Launched 21:55:35.308730 run mk-remote-dir(pid=32424): Terminated: ok {rc=0} 21:55:35.596468 run scp-inst-to-remote(pid=32425): Launched 21:55:37.778710 run scp-inst-to-remote(pid=32425): Terminated: ok {rc=0} 21:55:38.138358 run rm-remote-dir(pid=32427): Launched 21:55:39.331387 run rm-remote-dir(pid=32427): Terminated: ok {rc=0} 21:55:39.692890 run mk-remote-dir(pid=32428): Launched 21:55:40.885860 run mk-remote-dir(pid=32428): Terminated: ok {rc=0} 21:55:41.193800 run scp-cfg-to-remote(pid=32429): Launched 21:55:42.380198 run scp-cfg-to-remote(pid=32429): Terminated: ok {rc=0} 21:55:42.665719 run scp-db-to-remote(pid=32431): Launched 21:55:43.843604 run scp-db-to-remote(pid=32431): Terminated: ok {rc=0} 21:55:43.976227 run srsepc_10.42.42.118: Setting RPATH for srsepc 21:55:44.285642 run patchelf(pid=32433): Launched 21:55:45.463003 run patchelf(pid=32433): Terminated: ok {rc=0} 21:55:45.595627 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 21:55:45.917901 run setcap-netadm(pid=32434): Launched 21:55:47.178151 run setcap-netadm(pid=32434): Terminated: ok {rc=0} 21:55:47.530338 run srsepc(pid=32435): Launched 21:55:47.654791 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 21:55:48.854773 run rm-remote-dir(pid=32436): Launched 21:55:49.046609 run srsepc(pid=32435): ERR: Terminated: ERROR {rc=127} [trial-2382↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=32435)] 21:55:49.192682 run srsepc(pid=32435): stdout: | (launched: 2022-12-12_21:55:47.470649) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 21:55:49.338432 run srsepc(pid=32435): stderr: | (launched: 2022-12-12_21:55:47.520183) | Connection to 10.42.42.116 closed. 21:55:49.483973 run srsepc(pid=32435): stdout: | (launched: 2022-12-12_21:55:47.470649) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 21:55:49.623884 run srsepc(pid=32435): stderr: | (launched: 2022-12-12_21:55:47.520183) | Connection to 10.42.42.116 closed. 21:55:49.790099 run rm-remote-dir(pid=32436): Terminating (SIGINT) 21:55:49.982375 run rm-remote-dir(pid=32436): Terminated: ok {rc=0} 21:55:50.121257 tst rrc_idle_mt_ping.py:16: ERR: Error: srsepc(pid=32435): Process ended prematurely: srsepc(pid=32435) [trial-2382↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=32435)] [trial-2382↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16] 21:55:50.131737 tst rrc_idle_mt_ping.py:16: Test FAILED (18.6 sec) 21:55:50.212256 run scp-back-log(pid=32437): Launched 21:55:51.293490 run scp-back-log(pid=32437): ERR: Terminated: ERROR {rc=1} [trial-2382↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=32437)] 21:55:51.358450 run scp-back-log(pid=32437): stdout: | (launched: 2022-12-12_21:55:50.180714) 21:55:51.425125 run scp-back-log(pid=32437): stderr: | (launched: 2022-12-12_21:55:50.201849) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 21:55:51.499663 tst srsepc_10.42.42.118: Error('scp-back-log(pid=32437): launch_sync(): local process exited with status 1 [trial-2382↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=32437)]') --------------------------------------------------------------------- trial-2382 4g:srsenb-rftype@zmq+srsue-rftype@zmq FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 handover_2G:nanobts+bts1-oc2g --------------------------------------------------------------------- 21:55:51.634415 tst handover_2G:nanobts+bts1-oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:55:51.639779 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x bts (candidates: 11) 21:55:51.681590 tst handover_2G:nanobts+bts1-oc2g: Verifying 6 x ip_address (candidates: 9) 21:55:51.708743 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x modem (candidates: 12) 21:55:51.761249 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x bts (candidates: 11) 21:55:51.804868 tst handover_2G:nanobts+bts1-oc2g: Reserving 6 x ip_address (candidates: 9) 21:55:51.831823 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x modem (candidates: 12) 21:55:52.381162 tst handover_2G:nanobts+bts1-oc2g: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 handover_2G:nanobts+bts1-oc2g handover.py ---------------------------------------------- 21:55:52.386535 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 21:55:52.397786 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 21:55:52.435086 tst handover.py: using LAC 31748 21:55:52.564308 tst handover.py: using RAC 128 21:55:52.691388 tst handover.py: using CellId 31748 21:55:52.817761 tst handover.py: using BVCI 31749 21:55:52.936191 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 21:55:52.971342 tst handover.py: using LAC 31749 21:55:53.101207 tst handover.py: using RAC 129 21:55:53.229609 tst handover.py: using CellId 31749 21:55:53.350335 tst handover.py: using BVCI 31750 21:55:53.463487 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 21:55:53.474485 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 21:55:53.485294 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 21:55:53.496418 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 21:55:53.507556 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 21:55:53.518500 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 21:55:53.634036 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 21:55:53.753232 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:55:54.259865 run create_hlr_db(pid=32442): Launched 21:55:55.442887 run create_hlr_db(pid=32442): Terminated: ok {rc=0} 21:55:55.786139 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32444): Launched 21:55:56.111623 run osmo-hlr_10.42.42.2(pid=32445): Launched 21:55:56.235855 run osmo-stp_10.42.42.5: Starting osmo-stp 21:55:56.797226 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32447): Launched 21:55:57.121628 run osmo-stp_10.42.42.5(pid=32448): Launched 21:55:57.246419 run osmo-msc_10.42.42.6: Starting osmo-msc 21:55:57.838075 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32450): Launched 21:55:58.163641 run osmo-msc_10.42.42.6(pid=32451): Launched 21:55:58.345337 run osmo-stp_10.42.42.5(pid=32448): ERR: Terminated: ERROR {rc=1} [trial-2382↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32448)] 21:55:58.482999 run osmo-stp_10.42.42.5(pid=32448): stdout: | (launched: 2022-12-12_21:55:57.063276) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:55:58.621775 run osmo-stp_10.42.42.5(pid=32448): stderr: | 20221212215557257 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212215557257 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212215557257 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212215557257 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212215557258 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212215557258 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212215557258 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:55:58.759603 run osmo-stp_10.42.42.5(pid=32448): stdout: | (launched: 2022-12-12_21:55:57.063276) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:55:58.889753 run osmo-stp_10.42.42.5(pid=32448): stderr: | 20221212215557257 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212215557257 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212215557257 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212215557257 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212215557258 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212215557258 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212215557258 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:55:59.045562 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=32448): Process ended prematurely: osmo-stp_10.42.42.5(pid=32448) [trial-2382↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32448)] [trial-2382↪handover_2G:nanobts+bts1-oc2g↪handover.py:18] 21:55:59.054369 tst handover.py:18: Test FAILED (6.7 sec) 21:55:59.082333 run osmo-hlr_10.42.42.2(pid=32445): ERR: Terminated: ERROR {rc=237} [trial-2382↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32445)] 21:55:59.133240 run osmo-hlr_10.42.42.2(pid=32445): stdout: | (launched: 2022-12-12_21:55:56.052940) 21:55:59.185993 run osmo-hlr_10.42.42.2(pid=32445): stderr: | 20221212215556251 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212215556251 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212215556251 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212215556251 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212215556251 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212215556251 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212215556263 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/handover_2G:nanobts+bts1-oc2g/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212215556272 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212215556272 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212215556272 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:55:59.259443 run osmo-msc_10.42.42.6(pid=32451): ERR: Terminated: ERROR {rc=2} [trial-2382↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32451)] 21:55:59.310336 run osmo-msc_10.42.42.6(pid=32451): stdout: | (launched: 2022-12-12_21:55:58.105222) 21:55:59.363028 run osmo-msc_10.42.42.6(pid=32451): stderr: | 20221212215558429 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212215558429 DLGLOBAL DEBUG validating counter group 0x7f7a9ef65c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212215558429 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212215558430 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212215558430 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212215558430 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212215558431 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212215558432 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212215558432 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212215558432 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:55:59.416221 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32444): Terminating (SIGTERM) 21:55:59.458805 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32447): Terminating (SIGTERM) 21:55:59.501143 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32450): Terminating (SIGTERM) 21:55:59.543901 --- ParallelTerminationStrategy: PID 32444 died... 21:55:59.563955 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32444): Terminated: ok {rc=0} 21:55:59.611239 --- ParallelTerminationStrategy: PID 32447 died... 21:55:59.630790 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32447): Terminated: ok {rc=0} 21:55:59.677807 --- ParallelTerminationStrategy: PID 32450 died... 21:55:59.697535 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32450): Terminated: ok {rc=0} 21:55:59.786248 bus /sierra_3: Setting Powered False 21:56:00.900927 bus /sierra_3: Setting Powered False 21:56:02.027356 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 handover_2G:nanobts+bts1-oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 handover_2G:nanobts+bts1-octphy --------------------------------------------------------------------- 21:56:03.287112 tst handover_2G:nanobts+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:56:03.292517 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x bts (candidates: 11) 21:56:03.333656 tst handover_2G:nanobts+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 21:56:03.361291 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x modem (candidates: 12) 21:56:03.415630 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x bts (candidates: 11) 21:56:03.456260 tst handover_2G:nanobts+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 21:56:03.483359 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x modem (candidates: 12) 21:56:04.035580 tst handover_2G:nanobts+bts1-octphy: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 handover_2G:nanobts+bts1-octphy handover.py ---------------------------------------------- 21:56:04.040889 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 21:56:04.052427 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 21:56:04.090546 tst handover.py: using LAC 31750 21:56:04.219944 tst handover.py: using RAC 130 21:56:04.347399 tst handover.py: using CellId 31750 21:56:04.474766 tst handover.py: using BVCI 31751 21:56:04.595206 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 21:56:04.629244 tst handover.py: using LAC 31751 21:56:04.757731 tst handover.py: using RAC 131 21:56:04.887804 tst handover.py: using CellId 31751 21:56:05.010387 tst handover.py: using BVCI 31752 21:56:05.123088 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 21:56:05.134078 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 21:56:05.144813 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 21:56:05.155572 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 21:56:05.166251 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 21:56:05.176784 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 21:56:05.295082 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 21:56:05.410515 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:56:05.854651 run create_hlr_db(pid=32456): Launched 21:56:05.978805 bus /sierra_2: Setting Powered False 21:56:07.039223 run create_hlr_db(pid=32456): Terminated: ok {rc=0} 21:56:07.454948 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32458): Launched 21:56:07.781662 run osmo-hlr_10.42.42.2(pid=32459): Launched 21:56:07.906842 run osmo-stp_10.42.42.5: Starting osmo-stp 21:56:08.440562 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32461): Launched 21:56:08.765961 run osmo-stp_10.42.42.5(pid=32462): Launched 21:56:08.890405 run osmo-msc_10.42.42.6: Starting osmo-msc 21:56:09.452214 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32464): Launched 21:56:09.778764 run osmo-msc_10.42.42.6(pid=32465): Launched 21:56:09.961244 run osmo-stp_10.42.42.5(pid=32462): ERR: Terminated: ERROR {rc=1} [trial-2382↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32462)] 21:56:10.100057 run osmo-stp_10.42.42.5(pid=32462): stdout: | (launched: 2022-12-12_21:56:08.707016) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:56:10.239218 run osmo-stp_10.42.42.5(pid=32462): stderr: | 20221212215608899 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212215608899 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212215608899 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212215608899 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212215608900 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212215608900 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212215608900 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:56:10.377440 run osmo-stp_10.42.42.5(pid=32462): stdout: | (launched: 2022-12-12_21:56:08.707016) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:56:10.507940 run osmo-stp_10.42.42.5(pid=32462): stderr: | 20221212215608899 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212215608899 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212215608899 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212215608899 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212215608900 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212215608900 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212215608900 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:56:10.663996 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=32462): Process ended prematurely: osmo-stp_10.42.42.5(pid=32462) [trial-2382↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32462)] [trial-2382↪handover_2G:nanobts+bts1-octphy↪handover.py:18] 21:56:10.673060 tst handover.py:18: Test FAILED (6.6 sec) 21:56:10.700918 run osmo-hlr_10.42.42.2(pid=32459): ERR: Terminated: ERROR {rc=237} [trial-2382↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32459)] 21:56:10.752028 run osmo-hlr_10.42.42.2(pid=32459): stdout: | (launched: 2022-12-12_21:56:07.722898) 21:56:10.804478 run osmo-hlr_10.42.42.2(pid=32459): stderr: | 20221212215607920 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212215607920 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212215607920 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212215607920 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212215607920 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212215607920 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212215607932 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/handover_2G:nanobts+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212215607940 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212215607940 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212215607940 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:56:10.877621 run osmo-msc_10.42.42.6(pid=32465): ERR: Terminated: ERROR {rc=2} [trial-2382↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32465)] 21:56:10.928176 run osmo-msc_10.42.42.6(pid=32465): stdout: | (launched: 2022-12-12_21:56:09.720018) 21:56:10.980520 run osmo-msc_10.42.42.6(pid=32465): stderr: | 20221212215610042 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212215610042 DLGLOBAL DEBUG validating counter group 0x7feded042c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212215610042 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212215610042 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212215610042 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212215610042 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212215610044 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212215610044 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212215610045 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212215610045 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:56:11.033590 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32458): Terminating (SIGTERM) 21:56:11.075664 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32461): Terminating (SIGTERM) 21:56:11.118023 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32464): Terminating (SIGTERM) 21:56:11.160845 --- ParallelTerminationStrategy: PID 32458 died... 21:56:11.181179 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32458): Terminated: ok {rc=0} 21:56:11.228492 --- ParallelTerminationStrategy: PID 32461 died... 21:56:11.248336 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32461): Terminated: ok {rc=0} 21:56:11.295497 --- ParallelTerminationStrategy: PID 32464 died... 21:56:11.315307 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32464): Terminated: ok {rc=0} 21:56:11.405116 bus /sierra_3: Setting Powered False 21:56:12.505437 bus /sierra_3: Setting Powered False 21:56:13.622995 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 handover_2G:nanobts+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 handover_2G:nanobts+bts1-trx-lms --------------------------------------------------------------------- 21:56:14.867536 tst handover_2G:nanobts+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:56:14.873094 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 21:56:14.927825 tst handover_2G:nanobts+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 21:56:14.955200 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 21:56:15.008604 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 21:56:15.061603 tst handover_2G:nanobts+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 21:56:15.087704 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 21:56:15.641315 tst handover_2G:nanobts+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 handover_2G:nanobts+bts1-trx-lms handover.py ---------------------------------------------- 21:56:15.646620 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 21:56:15.658028 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 21:56:15.697760 tst handover.py: using LAC 31752 21:56:15.827387 tst handover.py: using RAC 132 21:56:15.986938 tst handover.py: using CellId 31752 21:56:16.111205 tst handover.py: using BVCI 31753 21:56:16.233091 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 21:56:16.283273 tst handover.py: using LAC 31753 21:56:16.407609 tst handover.py: using RAC 133 21:56:16.540143 tst handover.py: using CellId 31753 21:56:16.707645 tst handover.py: using BVCI 31754 21:56:16.833775 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 21:56:16.846154 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 21:56:16.858311 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 21:56:16.871270 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 21:56:16.885028 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 21:56:16.896858 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 21:56:17.021772 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 21:56:17.160085 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:56:17.652611 run create_hlr_db(pid=32471): Launched 21:56:17.778229 bus /sierra_2: Setting Powered False 21:56:18.843276 run create_hlr_db(pid=32471): Terminated: ok {rc=0} 21:56:19.253357 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32473): Launched 21:56:19.559347 run osmo-hlr_10.42.42.2(pid=32474): Launched 21:56:19.676055 run osmo-stp_10.42.42.5: Starting osmo-stp 21:56:20.171874 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32476): Launched 21:56:20.474839 run osmo-stp_10.42.42.5(pid=32477): Launched 21:56:20.590769 run osmo-msc_10.42.42.6: Starting osmo-msc 21:56:21.112390 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32479): Launched 21:56:21.415736 run osmo-msc_10.42.42.6(pid=32480): Launched 21:56:21.587182 run osmo-stp_10.42.42.5(pid=32477): ERR: Terminated: ERROR {rc=1} [trial-2382↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32477)] 21:56:21.715977 run osmo-stp_10.42.42.5(pid=32477): stdout: | (launched: 2022-12-12_21:56:20.419842) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:56:21.845293 run osmo-stp_10.42.42.5(pid=32477): stderr: | 20221212215620591 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212215620591 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212215620591 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212215620592 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212215620592 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212215620592 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212215620592 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:56:21.973145 run osmo-stp_10.42.42.5(pid=32477): stdout: | (launched: 2022-12-12_21:56:20.419842) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:56:22.094102 run osmo-stp_10.42.42.5(pid=32477): stderr: | 20221212215620591 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212215620591 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212215620591 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212215620592 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212215620592 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212215620592 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212215620592 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:56:22.239293 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=32477): Process ended prematurely: osmo-stp_10.42.42.5(pid=32477) [trial-2382↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32477)] [trial-2382↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18] 21:56:22.247525 tst handover.py:18: Test FAILED (6.6 sec) 21:56:22.273482 run osmo-hlr_10.42.42.2(pid=32474): ERR: Terminated: ERROR {rc=237} [trial-2382↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32474)] 21:56:22.321583 run osmo-hlr_10.42.42.2(pid=32474): stdout: | (launched: 2022-12-12_21:56:19.504043) 21:56:22.371775 run osmo-hlr_10.42.42.2(pid=32474): stderr: | 20221212215619681 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212215619681 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212215619681 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212215619681 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212215619681 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212215619681 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212215619694 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/handover_2G:nanobts+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212215619702 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212215619703 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212215619703 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:56:22.441364 run osmo-msc_10.42.42.6(pid=32480): ERR: Terminated: ERROR {rc=2} [trial-2382↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32480)] 21:56:22.489310 run osmo-msc_10.42.42.6(pid=32480): stdout: | (launched: 2022-12-12_21:56:21.360682) 21:56:22.538360 run osmo-msc_10.42.42.6(pid=32480): stderr: | 20221212215621632 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212215621632 DLGLOBAL DEBUG validating counter group 0x7fdef54cfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212215621632 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212215621633 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212215621633 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212215621633 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212215621635 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212215621635 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212215621635 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212215621635 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:56:22.588138 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32473): Terminating (SIGTERM) 21:56:22.627741 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32476): Terminating (SIGTERM) 21:56:22.667612 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32479): Terminating (SIGTERM) 21:56:22.707964 --- ParallelTerminationStrategy: PID 32473 died... 21:56:22.727103 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32473): Terminated: ok {rc=0} 21:56:22.771873 --- ParallelTerminationStrategy: PID 32476 died... 21:56:22.790690 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32476): Terminated: ok {rc=0} 21:56:22.835097 --- ParallelTerminationStrategy: PID 32479 died... 21:56:22.853935 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32479): Terminated: ok {rc=0} 21:56:22.940554 bus /sierra_3: Setting Powered False 21:56:24.041344 bus /sierra_3: Setting Powered False 21:56:25.158662 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 handover_2G:nanobts+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 handover_2G:nanobts+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 21:56:26.425609 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:56:26.431418 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 21:56:26.482472 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 21:56:26.509907 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 21:56:26.559745 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 21:56:26.610435 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 21:56:26.637522 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 21:56:27.193026 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 handover_2G:nanobts+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 21:56:27.198354 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:56:27.209770 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 21:56:27.249175 tst handover.py: using LAC 31754 21:56:27.377182 tst handover.py: using RAC 134 21:56:27.504643 tst handover.py: using CellId 31754 21:56:27.630638 tst handover.py: using BVCI 31755 21:56:27.749601 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 21:56:27.793709 tst handover.py: using LAC 31755 21:56:27.922295 tst handover.py: using RAC 135 21:56:28.049388 tst handover.py: using CellId 31755 21:56:28.175541 tst handover.py: using BVCI 31756 21:56:28.295989 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:56:28.307495 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:56:28.318786 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:56:28.330484 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:56:28.342107 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:56:28.353738 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 21:56:28.468321 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 21:56:28.584364 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:56:29.029121 run create_hlr_db(pid=32485): Launched 21:56:29.154727 bus /sierra_2: Setting Powered False 21:56:30.215461 run create_hlr_db(pid=32485): Terminated: ok {rc=0} 21:56:30.613175 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32487): Launched 21:56:30.944696 run osmo-hlr_10.42.42.2(pid=32488): Launched 21:56:31.217314 run osmo-stp_10.42.42.5: Starting osmo-stp 21:56:31.846380 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32490): Launched 21:56:32.198023 run osmo-stp_10.42.42.5(pid=32491): Launched 21:56:32.386892 run osmo-msc_10.42.42.6: Starting osmo-msc 21:56:32.965550 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32493): Launched 21:56:33.294501 run osmo-msc_10.42.42.6(pid=32494): Launched 21:56:33.477221 run osmo-stp_10.42.42.5(pid=32491): ERR: Terminated: ERROR {rc=1} [trial-2382↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32491)] 21:56:33.615713 run osmo-stp_10.42.42.5(pid=32491): stdout: | (launched: 2022-12-12_21:56:32.128107) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:56:33.754902 run osmo-stp_10.42.42.5(pid=32491): stderr: | 20221212215632336 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212215632336 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212215632336 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212215632339 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212215632339 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212215632339 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212215632339 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:56:33.893571 run osmo-stp_10.42.42.5(pid=32491): stdout: | (launched: 2022-12-12_21:56:32.128107) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:56:34.024851 run osmo-stp_10.42.42.5(pid=32491): stderr: | 20221212215632336 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212215632336 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212215632336 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212215632339 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212215632339 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212215632339 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212215632339 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:56:34.181410 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=32491): Process ended prematurely: osmo-stp_10.42.42.5(pid=32491) [trial-2382↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32491)] [trial-2382↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18] 21:56:34.190210 tst handover.py:18: Test FAILED (7.0 sec) 21:56:34.218120 run osmo-hlr_10.42.42.2(pid=32488): ERR: Terminated: ERROR {rc=237} [trial-2382↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32488)] 21:56:34.268929 run osmo-hlr_10.42.42.2(pid=32488): stdout: | (launched: 2022-12-12_21:56:30.871523) 21:56:34.321617 run osmo-hlr_10.42.42.2(pid=32488): stderr: | 20221212215631239 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212215631239 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212215631239 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212215631239 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212215631239 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212215631239 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212215631260 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/handover_2G:nanobts+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212215631287 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212215631287 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212215631287 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:56:34.394525 run osmo-msc_10.42.42.6(pid=32494): ERR: Terminated: ERROR {rc=2} [trial-2382↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32494)] 21:56:34.445092 run osmo-msc_10.42.42.6(pid=32494): stdout: | (launched: 2022-12-12_21:56:33.235449) 21:56:34.497255 run osmo-msc_10.42.42.6(pid=32494): stderr: | 20221212215633559 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212215633559 DLGLOBAL DEBUG validating counter group 0x7f410c559c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212215633559 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212215633559 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212215633559 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212215633559 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212215633561 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212215633562 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212215633562 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212215633562 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:56:34.549853 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32487): Terminating (SIGTERM) 21:56:34.592113 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32490): Terminating (SIGTERM) 21:56:34.634542 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32493): Terminating (SIGTERM) 21:56:34.677124 --- ParallelTerminationStrategy: PID 32487 died... 21:56:34.697282 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32487): Terminated: ok {rc=0} 21:56:34.744649 --- ParallelTerminationStrategy: PID 32490 died... 21:56:34.764361 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32490): Terminated: ok {rc=0} 21:56:34.811256 --- ParallelTerminationStrategy: PID 32493 died... 21:56:34.830979 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32493): Terminated: ok {rc=0} 21:56:34.919660 bus /sierra_3: Setting Powered False 21:56:36.016752 bus /sierra_3: Setting Powered False 21:56:37.132297 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 handover_2G:nanobts+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 handover_2G:nanobts+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 21:56:38.387948 tst handover_2G:nanobts+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:56:38.392857 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 21:56:38.446477 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 21:56:38.472717 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 21:56:38.523532 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 21:56:38.576627 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 21:56:38.602753 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 21:56:39.158702 tst handover_2G:nanobts+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 handover_2G:nanobts+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 21:56:39.164417 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:56:39.176202 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 21:56:39.217344 tst handover.py: using LAC 31756 21:56:39.336594 tst handover.py: using RAC 136 21:56:39.470554 tst handover.py: using CellId 31756 21:56:39.601436 tst handover.py: using BVCI 31757 21:56:39.712851 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 21:56:39.761184 tst handover.py: using LAC 31757 21:56:39.884204 tst handover.py: using RAC 137 21:56:40.004080 tst handover.py: using CellId 31757 21:56:40.132237 tst handover.py: using BVCI 31758 21:56:40.253059 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:56:40.264569 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:56:40.275921 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:56:40.287594 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:56:40.299235 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:56:40.310657 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 21:56:40.431733 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 21:56:40.552668 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:56:41.028856 run create_hlr_db(pid=32499): Launched 21:56:41.152712 bus /sierra_2: Setting Powered False 21:56:42.217098 run create_hlr_db(pid=32499): Terminated: ok {rc=0} 21:56:42.640250 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32501): Launched 21:56:42.965167 run osmo-hlr_10.42.42.2(pid=32502): Launched 21:56:43.083184 run osmo-stp_10.42.42.5: Starting osmo-stp 21:56:43.581591 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32504): Launched 21:56:43.885154 run osmo-stp_10.42.42.5(pid=32505): Launched 21:56:44.000545 run osmo-msc_10.42.42.6: Starting osmo-msc 21:56:44.521542 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32507): Launched 21:56:44.825676 run osmo-msc_10.42.42.6(pid=32508): Launched 21:56:44.995002 run osmo-stp_10.42.42.5(pid=32505): ERR: Terminated: ERROR {rc=1} [trial-2382↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32505)] 21:56:45.123493 run osmo-stp_10.42.42.5(pid=32505): stdout: | (launched: 2022-12-12_21:56:43.830155) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:56:45.252260 run osmo-stp_10.42.42.5(pid=32505): stderr: | 20221212215644001 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212215644001 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212215644002 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212215644002 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212215644004 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212215644005 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212215644005 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:56:45.378997 run osmo-stp_10.42.42.5(pid=32505): stdout: | (launched: 2022-12-12_21:56:43.830155) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:56:45.499310 run osmo-stp_10.42.42.5(pid=32505): stderr: | 20221212215644001 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212215644001 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212215644002 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212215644002 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212215644004 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212215644005 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212215644005 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:56:45.643528 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=32505): Process ended prematurely: osmo-stp_10.42.42.5(pid=32505) [trial-2382↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32505)] [trial-2382↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18] 21:56:45.651800 tst handover.py:18: Test FAILED (6.5 sec) 21:56:45.677716 run osmo-hlr_10.42.42.2(pid=32502): ERR: Terminated: ERROR {rc=237} [trial-2382↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32502)] 21:56:45.725763 run osmo-hlr_10.42.42.2(pid=32502): stdout: | (launched: 2022-12-12_21:56:42.906507) 21:56:45.775448 run osmo-hlr_10.42.42.2(pid=32502): stderr: | 20221212215643086 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212215643086 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212215643086 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212215643086 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212215643086 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212215643086 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212215643102 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/handover_2G:nanobts+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212215643112 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212215643112 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212215643112 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:56:45.855008 run osmo-msc_10.42.42.6(pid=32508): ERR: Terminated: ERROR {rc=2} [trial-2382↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32508)] 21:56:45.910646 run osmo-msc_10.42.42.6(pid=32508): stdout: | (launched: 2022-12-12_21:56:44.770544) 21:56:45.960935 run osmo-msc_10.42.42.6(pid=32508): stderr: | 20221212215645044 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212215645045 DLGLOBAL DEBUG validating counter group 0x7f2c71accc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212215645045 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212215645045 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212215645045 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212215645045 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212215645048 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212215645049 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212215645049 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212215645049 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:56:46.011837 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32501): Terminating (SIGTERM) 21:56:46.053179 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32504): Terminating (SIGTERM) 21:56:46.097424 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32507): Terminating (SIGTERM) 21:56:46.140426 --- ParallelTerminationStrategy: PID 32501 died... 21:56:46.160504 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32501): Terminated: ok {rc=0} 21:56:46.207854 --- ParallelTerminationStrategy: PID 32504 died... 21:56:46.227782 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32504): Terminated: ok {rc=0} 21:56:46.273193 --- ParallelTerminationStrategy: PID 32507 died... 21:56:46.292342 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32507): Terminated: ok {rc=0} 21:56:46.378188 bus /sierra_3: Setting Powered False 21:56:47.473261 bus /sierra_3: Setting Powered False 21:56:48.589144 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 handover_2G:nanobts+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 handover_2G:nanobts+bts1-sysmo --------------------------------------------------------------------- 21:56:49.849050 tst handover_2G:nanobts+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:56:49.853984 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x bts (candidates: 11) 21:56:49.894535 tst handover_2G:nanobts+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 21:56:49.920772 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x modem (candidates: 12) 21:56:49.971457 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x bts (candidates: 11) 21:56:50.011548 tst handover_2G:nanobts+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 21:56:50.037574 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x modem (candidates: 12) 21:56:50.587997 tst handover_2G:nanobts+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 handover_2G:nanobts+bts1-sysmo handover.py ---------------------------------------------- 21:56:50.593103 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 21:56:50.603820 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 21:56:50.640772 tst handover.py: using LAC 31758 21:56:50.759843 tst handover.py: using RAC 138 21:56:50.879568 tst handover.py: using CellId 31758 21:56:50.998314 tst handover.py: using BVCI 31759 21:56:51.118944 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 21:56:51.154769 tst handover.py: using LAC 31759 21:56:51.276315 tst handover.py: using RAC 139 21:56:51.396089 tst handover.py: using CellId 31759 21:56:51.516221 tst handover.py: using BVCI 31760 21:56:51.629187 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 21:56:51.639862 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 21:56:51.650384 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 21:56:51.661496 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 21:56:51.672552 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 21:56:51.683517 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 21:56:51.802821 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 21:56:51.919092 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:56:52.363521 run create_hlr_db(pid=32513): Launched 21:56:52.488678 bus /sierra_2: Setting Powered False 21:56:53.549294 run create_hlr_db(pid=32513): Terminated: ok {rc=0} 21:56:53.964284 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32515): Launched 21:56:54.290291 run osmo-hlr_10.42.42.2(pid=32516): Launched 21:56:54.414324 run osmo-stp_10.42.42.5: Starting osmo-stp 21:56:54.946034 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32518): Launched 21:56:55.270243 run osmo-stp_10.42.42.5(pid=32519): Launched 21:56:55.395001 run osmo-msc_10.42.42.6: Starting osmo-msc 21:56:55.953596 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32521): Launched 21:56:56.280525 run osmo-msc_10.42.42.6(pid=32522): Launched 21:56:56.463181 run osmo-stp_10.42.42.5(pid=32519): ERR: Terminated: ERROR {rc=1} [trial-2382↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32519)] 21:56:56.601476 run osmo-stp_10.42.42.5(pid=32519): stdout: | (launched: 2022-12-12_21:56:55.211785) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:56:56.740570 run osmo-stp_10.42.42.5(pid=32519): stderr: | 20221212215655407 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212215655407 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212215655407 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212215655407 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212215655408 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212215655408 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212215655408 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:56:56.878609 run osmo-stp_10.42.42.5(pid=32519): stdout: | (launched: 2022-12-12_21:56:55.211785) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:56:57.008725 run osmo-stp_10.42.42.5(pid=32519): stderr: | 20221212215655407 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212215655407 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212215655407 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212215655407 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212215655408 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212215655408 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212215655408 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:56:57.164624 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=32519): Process ended prematurely: osmo-stp_10.42.42.5(pid=32519) [trial-2382↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32519)] [trial-2382↪handover_2G:nanobts+bts1-sysmo↪handover.py:18] 21:56:57.173469 tst handover.py:18: Test FAILED (6.6 sec) 21:56:57.201099 run osmo-hlr_10.42.42.2(pid=32516): ERR: Terminated: ERROR {rc=237} [trial-2382↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32516)] 21:56:57.252421 run osmo-hlr_10.42.42.2(pid=32516): stdout: | (launched: 2022-12-12_21:56:54.232076) 21:56:57.305107 run osmo-hlr_10.42.42.2(pid=32516): stderr: | 20221212215654431 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212215654431 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212215654432 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212215654432 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212215654432 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212215654432 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212215654443 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/handover_2G:nanobts+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212215654452 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212215654452 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212215654452 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:56:57.378617 run osmo-msc_10.42.42.6(pid=32522): ERR: Terminated: ERROR {rc=2} [trial-2382↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32522)] 21:56:57.429643 run osmo-msc_10.42.42.6(pid=32522): stdout: | (launched: 2022-12-12_21:56:56.221667) 21:56:57.482092 run osmo-msc_10.42.42.6(pid=32522): stderr: | 20221212215656543 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212215656543 DLGLOBAL DEBUG validating counter group 0x7f9894e30c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212215656543 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212215656543 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212215656543 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212215656543 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212215656545 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212215656545 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212215656546 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212215656546 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:56:57.535032 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32515): Terminating (SIGTERM) 21:56:57.577168 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32518): Terminating (SIGTERM) 21:56:57.619192 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32521): Terminating (SIGTERM) 21:56:57.661979 --- ParallelTerminationStrategy: PID 32515 died... 21:56:57.682054 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32515): Terminated: ok {rc=0} 21:56:57.729038 --- ParallelTerminationStrategy: PID 32518 died... 21:56:57.748512 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32518): Terminated: ok {rc=0} 21:56:57.795252 --- ParallelTerminationStrategy: PID 32521 died... 21:56:57.814766 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32521): Terminated: ok {rc=0} 21:56:57.903485 bus /sierra_3: Setting Powered False 21:56:59.000007 bus /sierra_3: Setting Powered False 21:57:00.115862 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 handover_2G:nanobts+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 handover_2G:nanobts+bts1-trx-b200 --------------------------------------------------------------------- 21:57:01.407992 tst handover_2G:nanobts+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:57:01.414209 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 21:57:01.472068 tst handover_2G:nanobts+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 21:57:01.501274 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 21:57:01.555437 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 21:57:01.636481 tst handover_2G:nanobts+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 21:57:01.671701 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 21:57:02.189744 tst handover_2G:nanobts+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 handover_2G:nanobts+bts1-trx-b200 handover.py ---------------------------------------------- 21:57:02.195800 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:57:02.207817 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 21:57:02.250421 tst handover.py: using LAC 31760 21:57:02.378263 tst handover.py: using RAC 140 21:57:02.507256 tst handover.py: using CellId 31760 21:57:02.636395 tst handover.py: using BVCI 31761 21:57:02.754889 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 21:57:02.804595 tst handover.py: using LAC 31761 21:57:02.936372 tst handover.py: using RAC 141 21:57:03.063831 tst handover.py: using CellId 31761 21:57:03.189351 tst handover.py: using BVCI 31762 21:57:03.308020 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:57:03.319362 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:57:03.330673 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:57:03.342057 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:57:03.353523 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:57:03.364759 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 21:57:03.480568 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 21:57:03.596702 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:57:04.041682 run create_hlr_db(pid=32527): Launched 21:57:04.166480 bus /sierra_2: Setting Powered False 21:57:05.227351 run create_hlr_db(pid=32527): Terminated: ok {rc=0} 21:57:05.624897 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32529): Launched 21:57:05.927804 run osmo-hlr_10.42.42.2(pid=32530): Launched 21:57:06.043656 run osmo-stp_10.42.42.5: Starting osmo-stp 21:57:06.556176 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32532): Launched 21:57:06.858165 run osmo-stp_10.42.42.5(pid=32533): Launched 21:57:06.973362 run osmo-msc_10.42.42.6: Starting osmo-msc 21:57:07.495754 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32535): Launched 21:57:07.798127 run osmo-msc_10.42.42.6(pid=32536): Launched 21:57:07.967552 run osmo-stp_10.42.42.5(pid=32533): ERR: Terminated: ERROR {rc=1} [trial-2382↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32533)] 21:57:08.098341 run osmo-stp_10.42.42.5(pid=32533): stdout: | (launched: 2022-12-12_21:57:06.803159) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:57:08.226949 run osmo-stp_10.42.42.5(pid=32533): stderr: | 20221212215706973 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212215706973 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212215706973 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212215706974 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212215706974 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212215706974 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212215706974 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:57:08.353767 run osmo-stp_10.42.42.5(pid=32533): stdout: | (launched: 2022-12-12_21:57:06.803159) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:57:08.474720 run osmo-stp_10.42.42.5(pid=32533): stderr: | 20221212215706973 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212215706973 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212215706973 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212215706974 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212215706974 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212215706974 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212215706974 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:57:08.619073 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=32533): Process ended prematurely: osmo-stp_10.42.42.5(pid=32533) [trial-2382↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32533)] [trial-2382↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18] 21:57:08.627375 tst handover.py:18: Test FAILED (6.4 sec) 21:57:08.653387 run osmo-hlr_10.42.42.2(pid=32530): ERR: Terminated: ERROR {rc=237} [trial-2382↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32530)] 21:57:08.701655 run osmo-hlr_10.42.42.2(pid=32530): stdout: | (launched: 2022-12-12_21:57:05.872868) 21:57:08.751396 run osmo-hlr_10.42.42.2(pid=32530): stderr: | 20221212215706052 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212215706052 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212215706052 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212215706052 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212215706052 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212215706052 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212215706068 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/handover_2G:nanobts+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212215706078 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212215706078 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212215706078 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:57:08.820988 run osmo-msc_10.42.42.6(pid=32536): ERR: Terminated: ERROR {rc=2} [trial-2382↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32536)] 21:57:08.869114 run osmo-msc_10.42.42.6(pid=32536): stdout: | (launched: 2022-12-12_21:57:07.743317) 21:57:08.918794 run osmo-msc_10.42.42.6(pid=32536): stderr: | 20221212215708016 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212215708016 DLGLOBAL DEBUG validating counter group 0x7f43f3f92c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212215708017 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212215708017 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212215708017 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212215708017 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212215708019 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212215708019 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212215708019 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212215708019 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:57:08.968800 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32529): Terminating (SIGTERM) 21:57:09.008521 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32532): Terminating (SIGTERM) 21:57:09.048370 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32535): Terminating (SIGTERM) 21:57:09.088420 --- ParallelTerminationStrategy: PID 32529 died... 21:57:09.107762 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32529): Terminated: ok {rc=0} 21:57:09.152552 --- ParallelTerminationStrategy: PID 32532 died... 21:57:09.171458 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32532): Terminated: ok {rc=0} 21:57:09.215774 --- ParallelTerminationStrategy: PID 32535 died... 21:57:09.234653 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32535): Terminated: ok {rc=0} 21:57:09.320940 bus /sierra_3: Setting Powered False 21:57:10.422233 bus /sierra_3: Setting Powered False 21:57:11.536302 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 handover_2G:nanobts+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 handover_2G:nanobts+bts1-trx-umtrx --------------------------------------------------------------------- 21:57:12.800292 tst handover_2G:nanobts+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:57:12.805950 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 21:57:12.860207 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 21:57:12.887460 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 21:57:12.942623 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 21:57:12.994641 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 21:57:13.020747 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 21:57:13.572734 tst handover_2G:nanobts+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 handover_2G:nanobts+bts1-trx-umtrx handover.py ---------------------------------------------- 21:57:13.578246 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:57:13.589809 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 21:57:13.628690 tst handover.py: using LAC 31762 21:57:13.756432 tst handover.py: using RAC 142 21:57:13.885262 tst handover.py: using CellId 31762 21:57:14.012724 tst handover.py: using BVCI 31763 21:57:14.132487 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 21:57:14.184927 tst handover.py: using LAC 31763 21:57:14.305475 tst handover.py: using RAC 143 21:57:14.426144 tst handover.py: using CellId 31763 21:57:14.546909 tst handover.py: using BVCI 31764 21:57:14.659609 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:57:14.670664 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:57:14.681482 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:57:14.692291 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:57:14.703359 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:57:14.714278 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 21:57:14.833480 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 21:57:14.949230 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:57:15.428136 run create_hlr_db(pid=32541): Launched 21:57:15.553815 bus /sierra_2: Setting Powered False 21:57:16.617720 run create_hlr_db(pid=32541): Terminated: ok {rc=0} 21:57:17.050731 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32543): Launched 21:57:17.389354 run osmo-hlr_10.42.42.2(pid=32544): Launched 21:57:17.515520 run osmo-stp_10.42.42.5: Starting osmo-stp 21:57:18.050662 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32546): Launched 21:57:18.375445 run osmo-stp_10.42.42.5(pid=32547): Launched 21:57:18.500073 run osmo-msc_10.42.42.6: Starting osmo-msc 21:57:19.061909 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32549): Launched 21:57:19.388282 run osmo-msc_10.42.42.6(pid=32550): Launched 21:57:19.571654 run osmo-stp_10.42.42.5(pid=32547): ERR: Terminated: ERROR {rc=1} [trial-2382↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32547)] 21:57:19.710478 run osmo-stp_10.42.42.5(pid=32547): stdout: | (launched: 2022-12-12_21:57:18.317331) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:57:19.850625 run osmo-stp_10.42.42.5(pid=32547): stderr: | 20221212215718507 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212215718508 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212215718508 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212215718508 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212215718509 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212215718509 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212215718509 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:57:19.989586 run osmo-stp_10.42.42.5(pid=32547): stdout: | (launched: 2022-12-12_21:57:18.317331) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:57:20.121294 run osmo-stp_10.42.42.5(pid=32547): stderr: | 20221212215718507 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212215718508 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212215718508 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212215718508 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212215718509 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212215718509 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212215718509 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:57:20.278240 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=32547): Process ended prematurely: osmo-stp_10.42.42.5(pid=32547) [trial-2382↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32547)] [trial-2382↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18] 21:57:20.287422 tst handover.py:18: Test FAILED (6.7 sec) 21:57:20.315567 run osmo-hlr_10.42.42.2(pid=32544): ERR: Terminated: ERROR {rc=237} [trial-2382↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32544)] 21:57:20.367360 run osmo-hlr_10.42.42.2(pid=32544): stdout: | (launched: 2022-12-12_21:57:17.330843) 21:57:20.420674 run osmo-hlr_10.42.42.2(pid=32544): stderr: | 20221212215717528 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212215717528 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212215717528 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212215717528 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212215717528 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212215717528 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212215717541 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/handover_2G:nanobts+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212215717549 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212215717549 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212215717549 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:57:20.494602 run osmo-msc_10.42.42.6(pid=32550): ERR: Terminated: ERROR {rc=2} [trial-2382↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32550)] 21:57:20.545918 run osmo-msc_10.42.42.6(pid=32550): stdout: | (launched: 2022-12-12_21:57:19.329340) 21:57:20.598696 run osmo-msc_10.42.42.6(pid=32550): stderr: | 20221212215719654 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212215719654 DLGLOBAL DEBUG validating counter group 0x7fb112bf0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212215719654 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212215719654 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212215719655 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212215719655 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212215719656 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212215719657 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212215719657 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212215719657 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:57:20.651790 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32543): Terminating (SIGTERM) 21:57:20.694499 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32546): Terminating (SIGTERM) 21:57:20.737282 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32549): Terminating (SIGTERM) 21:57:20.780142 --- ParallelTerminationStrategy: PID 32543 died... 21:57:20.800624 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32543): Terminated: ok {rc=0} 21:57:20.848575 --- ParallelTerminationStrategy: PID 32546 died... 21:57:20.868575 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32546): Terminated: ok {rc=0} 21:57:20.916133 --- ParallelTerminationStrategy: PID 32549 died... 21:57:20.936234 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32549): Terminated: ok {rc=0} 21:57:21.025407 bus /sierra_3: Setting Powered False 21:57:22.126597 bus /sierra_3: Setting Powered False 21:57:23.245616 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 handover_2G:nanobts+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 handover_2G:oc2g+bts1-octphy --------------------------------------------------------------------- 21:57:24.508916 tst handover_2G:oc2g+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:57:24.514638 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x bts (candidates: 11) 21:57:24.552901 tst handover_2G:oc2g+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 21:57:24.580495 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x modem (candidates: 12) 21:57:24.635114 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x bts (candidates: 11) 21:57:24.673053 tst handover_2G:oc2g+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 21:57:24.700056 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x modem (candidates: 12) 21:57:25.247632 tst handover_2G:oc2g+bts1-octphy: RESERVED RESOURCES for handover_2G: bts OC-2G OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 handover_2G:oc2g+bts1-octphy handover.py ---------------------------------------------- 21:57:25.252851 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 21:57:25.264446 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 21:57:25.302950 tst handover.py: using LAC 31764 21:57:25.422944 tst handover.py: using RAC 144 21:57:25.542183 tst handover.py: using CellId 31764 21:57:25.660423 tst handover.py: using BVCI 31765 21:57:25.770945 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 21:57:25.804194 tst handover.py: using LAC 31765 21:57:25.931345 tst handover.py: using RAC 145 21:57:26.057907 tst handover.py: using CellId 31765 21:57:26.186094 tst handover.py: using BVCI 31766 21:57:26.306924 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 21:57:26.318416 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 21:57:26.329650 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 21:57:26.341418 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 21:57:26.353091 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 21:57:26.364838 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 21:57:26.480222 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 21:57:26.600105 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:57:27.078894 run create_hlr_db(pid=32555): Launched 21:57:27.203357 bus /sierra_2: Setting Powered False 21:57:28.267928 run create_hlr_db(pid=32555): Terminated: ok {rc=0} 21:57:28.694005 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32557): Launched 21:57:29.020537 run osmo-hlr_10.42.42.2(pid=32558): Launched 21:57:29.146879 run osmo-stp_10.42.42.5: Starting osmo-stp 21:57:29.682233 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32560): Launched 21:57:30.009781 run osmo-stp_10.42.42.5(pid=32561): Launched 21:57:30.134217 run osmo-msc_10.42.42.6: Starting osmo-msc 21:57:30.694036 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32563): Launched 21:57:31.033665 run osmo-msc_10.42.42.6(pid=32564): Launched 21:57:31.399519 run osmo-stp_10.42.42.5(pid=32561): ERR: Terminated: ERROR {rc=1} [trial-2382↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32561)] 21:57:31.749231 run osmo-stp_10.42.42.5(pid=32561): stdout: | (launched: 2022-12-12_21:57:29.947498) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:57:31.912621 run osmo-stp_10.42.42.5(pid=32561): stderr: | 20221212215730141 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212215730142 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212215730142 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212215730142 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212215730143 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212215730143 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212215730143 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:57:32.047290 run osmo-stp_10.42.42.5(pid=32561): stdout: | (launched: 2022-12-12_21:57:29.947498) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:57:32.176381 run osmo-stp_10.42.42.5(pid=32561): stderr: | 20221212215730141 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212215730142 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212215730142 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212215730142 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212215730143 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212215730143 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212215730143 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:57:32.326432 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=32561): Process ended prematurely: osmo-stp_10.42.42.5(pid=32561) [trial-2382↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32561)] [trial-2382↪handover_2G:oc2g+bts1-octphy↪handover.py:18] 21:57:32.335216 tst handover.py:18: Test FAILED (7.1 sec) 21:57:32.362838 run osmo-hlr_10.42.42.2(pid=32558): ERR: Terminated: ERROR {rc=237} [trial-2382↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32558)] 21:57:32.412458 run osmo-hlr_10.42.42.2(pid=32558): stdout: | (launched: 2022-12-12_21:57:28.961894) 21:57:32.463138 run osmo-hlr_10.42.42.2(pid=32558): stderr: | 20221212215729160 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212215729160 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212215729160 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212215729160 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212215729160 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212215729160 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212215729173 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/handover_2G:oc2g+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212215729181 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212215729181 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212215729181 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:57:32.533518 run osmo-msc_10.42.42.6(pid=32564): ERR: Terminated: ERROR {rc=2} [trial-2382↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32564)] 21:57:32.582411 run osmo-msc_10.42.42.6(pid=32564): stdout: | (launched: 2022-12-12_21:57:30.964626) 21:57:32.633189 run osmo-msc_10.42.42.6(pid=32564): stderr: | 20221212215731443 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212215731443 DLGLOBAL DEBUG validating counter group 0x7f1bda3f5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212215731443 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212215731443 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212215731443 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212215731443 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212215731449 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212215731450 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212215731450 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212215731450 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:57:32.684086 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32557): Terminating (SIGTERM) 21:57:32.723951 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32560): Terminating (SIGTERM) 21:57:32.765135 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32563): Terminating (SIGTERM) 21:57:32.805864 --- ParallelTerminationStrategy: PID 32557 died... 21:57:32.825338 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32557): Terminated: ok {rc=0} 21:57:32.870841 --- ParallelTerminationStrategy: PID 32560 died... 21:57:32.889739 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32560): Terminated: ok {rc=0} 21:57:32.935173 --- ParallelTerminationStrategy: PID 32563 died... 21:57:32.954033 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32563): Terminated: ok {rc=0} 21:57:33.040838 bus /sierra_3: Setting Powered False 21:57:34.140190 bus /sierra_3: Setting Powered False 21:57:35.256192 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 handover_2G:oc2g+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 handover_2G:oc2g+bts1-trx-lms --------------------------------------------------------------------- 21:57:36.495990 tst handover_2G:oc2g+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:57:36.501354 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 21:57:36.550605 tst handover_2G:oc2g+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 21:57:36.576679 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 21:57:36.629714 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 21:57:36.679171 tst handover_2G:oc2g+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 21:57:36.705155 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 21:57:37.253628 tst handover_2G:oc2g+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OC-2G LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 handover_2G:oc2g+bts1-trx-lms handover.py ---------------------------------------------- 21:57:37.258607 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 21:57:37.269387 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 21:57:37.302407 tst handover.py: using LAC 31766 21:57:37.422233 tst handover.py: using RAC 146 21:57:37.541061 tst handover.py: using CellId 31766 21:57:37.659860 tst handover.py: using BVCI 31767 21:57:37.771746 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 21:57:37.819525 tst handover.py: using LAC 31767 21:57:37.940918 tst handover.py: using RAC 147 21:57:38.060087 tst handover.py: using CellId 31767 21:57:38.180419 tst handover.py: using BVCI 31768 21:57:38.291419 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 21:57:38.302176 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 21:57:38.312570 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 21:57:38.323067 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 21:57:38.333605 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 21:57:38.344059 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 21:57:38.462469 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 21:57:38.579440 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:57:39.058422 run create_hlr_db(pid=32569): Launched 21:57:39.183281 bus /sierra_2: Setting Powered False 21:57:40.248279 run create_hlr_db(pid=32569): Terminated: ok {rc=0} 21:57:40.658711 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32571): Launched 21:57:40.962958 run osmo-hlr_10.42.42.2(pid=32572): Launched 21:57:41.080668 run osmo-stp_10.42.42.5: Starting osmo-stp 21:57:41.578599 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32574): Launched 21:57:41.882321 run osmo-stp_10.42.42.5(pid=32575): Launched 21:57:41.997821 run osmo-msc_10.42.42.6: Starting osmo-msc 21:57:42.520273 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32577): Launched 21:57:42.823624 run osmo-msc_10.42.42.6(pid=32578): Launched 21:57:42.994250 run osmo-stp_10.42.42.5(pid=32575): ERR: Terminated: ERROR {rc=1} [trial-2382↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32575)] 21:57:43.122884 run osmo-stp_10.42.42.5(pid=32575): stdout: | (launched: 2022-12-12_21:57:41.827071) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:57:43.252003 run osmo-stp_10.42.42.5(pid=32575): stderr: | 20221212215741998 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212215741998 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212215741999 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212215741999 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212215741999 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212215741999 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212215742000 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:57:43.378803 run osmo-stp_10.42.42.5(pid=32575): stdout: | (launched: 2022-12-12_21:57:41.827071) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:57:43.499353 run osmo-stp_10.42.42.5(pid=32575): stderr: | 20221212215741998 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212215741998 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212215741999 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212215741999 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212215741999 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212215741999 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212215742000 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:57:43.643452 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=32575): Process ended prematurely: osmo-stp_10.42.42.5(pid=32575) [trial-2382↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32575)] [trial-2382↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18] 21:57:43.651554 tst handover.py:18: Test FAILED (6.4 sec) 21:57:43.677507 run osmo-hlr_10.42.42.2(pid=32572): ERR: Terminated: ERROR {rc=237} [trial-2382↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32572)] 21:57:43.726139 run osmo-hlr_10.42.42.2(pid=32572): stdout: | (launched: 2022-12-12_21:57:40.907850) 21:57:43.775914 run osmo-hlr_10.42.42.2(pid=32572): stderr: | 20221212215741086 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212215741086 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212215741086 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212215741086 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212215741086 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212215741086 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212215741098 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/handover_2G:oc2g+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212215741107 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212215741107 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212215741107 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:57:43.845428 run osmo-msc_10.42.42.6(pid=32578): ERR: Terminated: ERROR {rc=2} [trial-2382↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32578)] 21:57:43.894520 run osmo-msc_10.42.42.6(pid=32578): stdout: | (launched: 2022-12-12_21:57:42.768486) 21:57:43.944001 run osmo-msc_10.42.42.6(pid=32578): stderr: | 20221212215743042 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212215743042 DLGLOBAL DEBUG validating counter group 0x7fd3ba030c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212215743043 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212215743043 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212215743043 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212215743043 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212215743045 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212215743045 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212215743045 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212215743045 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:57:43.993971 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32571): Terminating (SIGTERM) 21:57:44.033629 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32574): Terminating (SIGTERM) 21:57:44.073459 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32577): Terminating (SIGTERM) 21:57:44.113616 --- ParallelTerminationStrategy: PID 32571 died... 21:57:44.132716 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32571): Terminated: ok {rc=0} 21:57:44.177059 --- ParallelTerminationStrategy: PID 32574 died... 21:57:44.195488 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32574): Terminated: ok {rc=0} 21:57:44.239388 --- ParallelTerminationStrategy: PID 32577 died... 21:57:44.257964 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32577): Terminated: ok {rc=0} 21:57:44.341558 bus /sierra_3: Setting Powered False 21:57:45.437586 bus /sierra_3: Setting Powered False 21:57:46.575430 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 handover_2G:oc2g+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 handover_2G:oc2g+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 21:57:47.845328 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:57:47.850994 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 21:57:47.898753 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 21:57:47.925977 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 21:57:47.978543 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 21:57:48.026426 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 21:57:48.054090 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 21:57:48.605252 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OC-2G LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 handover_2G:oc2g+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 21:57:48.610808 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:57:48.622597 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 21:57:48.658073 tst handover.py: using LAC 31768 21:57:48.787835 tst handover.py: using RAC 148 21:57:48.918465 tst handover.py: using CellId 31768 21:57:49.045357 tst handover.py: using BVCI 31769 21:57:49.165333 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 21:57:49.209052 tst handover.py: using LAC 31769 21:57:49.335911 tst handover.py: using RAC 149 21:57:49.464428 tst handover.py: using CellId 31769 21:57:49.590690 tst handover.py: using BVCI 31770 21:57:49.710057 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:57:49.721630 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:57:49.732921 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:57:49.744750 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:57:49.756547 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:57:49.768181 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 21:57:49.883983 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 21:57:50.004162 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:57:50.483014 run create_hlr_db(pid=32583): Launched 21:57:50.606745 bus /sierra_2: Setting Powered False 21:57:51.671233 run create_hlr_db(pid=32583): Terminated: ok {rc=0} 21:57:52.098346 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32585): Launched 21:57:52.425088 run osmo-hlr_10.42.42.2(pid=32586): Launched 21:57:52.550669 run osmo-stp_10.42.42.5: Starting osmo-stp 21:57:53.083910 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32588): Launched 21:57:53.409384 run osmo-stp_10.42.42.5(pid=32589): Launched 21:57:53.534990 run osmo-msc_10.42.42.6: Starting osmo-msc 21:57:54.100330 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32591): Launched 21:57:54.427236 run osmo-msc_10.42.42.6(pid=32592): Launched 21:57:54.610071 run osmo-stp_10.42.42.5(pid=32589): ERR: Terminated: ERROR {rc=1} [trial-2382↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32589)] 21:57:54.748372 run osmo-stp_10.42.42.5(pid=32589): stdout: | (launched: 2022-12-12_21:57:53.350620) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:57:54.887845 run osmo-stp_10.42.42.5(pid=32589): stderr: | 20221212215753542 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212215753543 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212215753543 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212215753543 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212215753544 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212215753544 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212215753544 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:57:55.025698 run osmo-stp_10.42.42.5(pid=32589): stdout: | (launched: 2022-12-12_21:57:53.350620) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:57:55.157068 run osmo-stp_10.42.42.5(pid=32589): stderr: | 20221212215753542 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212215753543 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212215753543 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212215753543 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212215753544 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212215753544 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212215753544 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:57:55.313247 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=32589): Process ended prematurely: osmo-stp_10.42.42.5(pid=32589) [trial-2382↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32589)] [trial-2382↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18] 21:57:55.322109 tst handover.py:18: Test FAILED (6.7 sec) 21:57:55.350316 run osmo-hlr_10.42.42.2(pid=32586): ERR: Terminated: ERROR {rc=237} [trial-2382↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32586)] 21:57:55.401622 run osmo-hlr_10.42.42.2(pid=32586): stdout: | (launched: 2022-12-12_21:57:52.366214) 21:57:55.454738 run osmo-hlr_10.42.42.2(pid=32586): stderr: | 20221212215752568 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212215752568 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212215752568 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212215752568 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212215752568 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212215752568 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212215752614 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/handover_2G:oc2g+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212215752623 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212215752623 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212215752623 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:57:55.528219 run osmo-msc_10.42.42.6(pid=32592): ERR: Terminated: ERROR {rc=2} [trial-2382↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32592)] 21:57:55.579300 run osmo-msc_10.42.42.6(pid=32592): stdout: | (launched: 2022-12-12_21:57:54.368204) 21:57:55.632231 run osmo-msc_10.42.42.6(pid=32592): stderr: | 20221212215754689 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212215754690 DLGLOBAL DEBUG validating counter group 0x7faf9ed9dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212215754690 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212215754690 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212215754690 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212215754690 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212215754692 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212215754692 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212215754692 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212215754692 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:57:55.685617 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32585): Terminating (SIGTERM) 21:57:55.727858 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32588): Terminating (SIGTERM) 21:57:55.770221 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32591): Terminating (SIGTERM) 21:57:55.813128 --- ParallelTerminationStrategy: PID 32585 died... 21:57:55.833273 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32585): Terminated: ok {rc=0} 21:57:55.880323 --- ParallelTerminationStrategy: PID 32588 died... 21:57:55.899839 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32588): Terminated: ok {rc=0} 21:57:55.947004 --- ParallelTerminationStrategy: PID 32591 died... 21:57:55.966699 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32591): Terminated: ok {rc=0} 21:57:56.055437 bus /sierra_3: Setting Powered False 21:57:57.154417 bus /sierra_3: Setting Powered False 21:57:58.271539 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 handover_2G:oc2g+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 handover_2G:oc2g+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 21:57:59.528601 tst handover_2G:oc2g+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:57:59.534256 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 21:57:59.586165 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 21:57:59.613405 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 21:57:59.668546 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 21:57:59.720352 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 21:57:59.747417 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 21:58:00.296608 tst handover_2G:oc2g+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 handover_2G:oc2g+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 21:58:00.301980 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:58:00.313476 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 21:58:00.351580 tst handover.py: using LAC 31770 21:58:00.472255 tst handover.py: using RAC 150 21:58:00.592585 tst handover.py: using CellId 31770 21:58:00.711415 tst handover.py: using BVCI 31771 21:58:00.822984 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 21:58:00.877681 tst handover.py: using LAC 31771 21:58:01.010807 tst handover.py: using RAC 151 21:58:01.142136 tst handover.py: using CellId 31771 21:58:01.301822 tst handover.py: using BVCI 31772 21:58:01.455332 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:58:01.469752 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:58:01.483749 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:58:01.496234 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:58:01.510588 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:58:01.525809 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 21:58:01.652173 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 21:58:01.806411 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:58:02.290782 run create_hlr_db(pid=32597): Launched 21:58:02.448436 bus /sierra_2: Setting Powered False 21:58:03.509700 run create_hlr_db(pid=32597): Terminated: ok {rc=0} 21:58:03.907618 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32599): Launched 21:58:04.210802 run osmo-hlr_10.42.42.2(pid=32600): Launched 21:58:04.326400 run osmo-stp_10.42.42.5: Starting osmo-stp 21:58:04.821326 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32602): Launched 21:58:05.124342 run osmo-stp_10.42.42.5(pid=32603): Launched 21:58:05.240064 run osmo-msc_10.42.42.6: Starting osmo-msc 21:58:05.762019 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32605): Launched 21:58:06.065477 run osmo-msc_10.42.42.6(pid=32606): Launched 21:58:06.236079 run osmo-stp_10.42.42.5(pid=32603): ERR: Terminated: ERROR {rc=1} [trial-2382↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32603)] 21:58:06.364763 run osmo-stp_10.42.42.5(pid=32603): stdout: | (launched: 2022-12-12_21:58:05.069501) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:58:06.493812 run osmo-stp_10.42.42.5(pid=32603): stderr: | 20221212215805241 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212215805241 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212215805241 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212215805242 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212215805242 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212215805242 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212215805242 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:58:06.621738 run osmo-stp_10.42.42.5(pid=32603): stdout: | (launched: 2022-12-12_21:58:05.069501) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:58:06.743090 run osmo-stp_10.42.42.5(pid=32603): stderr: | 20221212215805241 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212215805241 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212215805241 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212215805242 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212215805242 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212215805242 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212215805242 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:58:06.887893 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=32603): Process ended prematurely: osmo-stp_10.42.42.5(pid=32603) [trial-2382↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32603)] [trial-2382↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18] 21:58:06.896055 tst handover.py:18: Test FAILED (6.6 sec) 21:58:06.922304 run osmo-hlr_10.42.42.2(pid=32600): ERR: Terminated: ERROR {rc=237} [trial-2382↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32600)] 21:58:06.970260 run osmo-hlr_10.42.42.2(pid=32600): stdout: | (launched: 2022-12-12_21:58:04.155911) 21:58:07.019972 run osmo-hlr_10.42.42.2(pid=32600): stderr: | 20221212215804333 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212215804333 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212215804333 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212215804333 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212215804333 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212215804333 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212215804366 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/handover_2G:oc2g+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212215804377 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212215804377 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212215804377 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:58:07.089462 run osmo-msc_10.42.42.6(pid=32606): ERR: Terminated: ERROR {rc=2} [trial-2382↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32606)] 21:58:07.137589 run osmo-msc_10.42.42.6(pid=32606): stdout: | (launched: 2022-12-12_21:58:06.010259) 21:58:07.187128 run osmo-msc_10.42.42.6(pid=32606): stderr: | 20221212215806281 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212215806282 DLGLOBAL DEBUG validating counter group 0x7eff12606c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212215806282 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212215806282 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212215806282 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212215806282 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212215806284 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212215806284 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212215806284 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212215806284 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:58:07.237089 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32599): Terminating (SIGTERM) 21:58:07.277007 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32602): Terminating (SIGTERM) 21:58:07.316908 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32605): Terminating (SIGTERM) 21:58:07.357429 --- ParallelTerminationStrategy: PID 32599 died... 21:58:07.376712 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32599): Terminated: ok {rc=0} 21:58:07.421174 --- ParallelTerminationStrategy: PID 32602 died... 21:58:07.439962 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32602): Terminated: ok {rc=0} 21:58:07.484144 --- ParallelTerminationStrategy: PID 32605 died... 21:58:07.502954 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32605): Terminated: ok {rc=0} 21:58:07.589302 bus /sierra_3: Setting Powered False 21:58:08.688450 bus /sierra_3: Setting Powered False 21:58:09.803835 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 handover_2G:oc2g+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 handover_2G:oc2g+bts1-sysmo --------------------------------------------------------------------- 21:58:11.063686 tst handover_2G:oc2g+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:58:11.069152 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x bts (candidates: 11) 21:58:11.109254 tst handover_2G:oc2g+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 21:58:11.136451 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x modem (candidates: 12) 21:58:11.190028 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x bts (candidates: 11) 21:58:11.229350 tst handover_2G:oc2g+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 21:58:11.256343 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x modem (candidates: 12) 21:58:11.805991 tst handover_2G:oc2g+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 handover_2G:oc2g+bts1-sysmo handover.py ---------------------------------------------- 21:58:11.811356 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 21:58:11.822533 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 21:58:11.857582 tst handover.py: using LAC 31772 21:58:11.990396 tst handover.py: using RAC 152 21:58:12.126202 tst handover.py: using CellId 31772 21:58:12.255065 tst handover.py: using BVCI 31773 21:58:12.373977 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 21:58:12.408152 tst handover.py: using LAC 31773 21:58:12.534350 tst handover.py: using RAC 153 21:58:12.661291 tst handover.py: using CellId 31773 21:58:12.787779 tst handover.py: using BVCI 31774 21:58:12.900776 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 21:58:12.911666 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 21:58:12.922456 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 21:58:12.933715 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 21:58:12.944859 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 21:58:12.956206 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 21:58:13.078199 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 21:58:13.194165 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:58:13.638434 run create_hlr_db(pid=32611): Launched 21:58:13.766769 bus /sierra_2: Setting Powered False 21:58:14.830155 run create_hlr_db(pid=32611): Terminated: ok {rc=0} 21:58:15.254702 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32613): Launched 21:58:15.580548 run osmo-hlr_10.42.42.2(pid=32614): Launched 21:58:15.706056 run osmo-stp_10.42.42.5: Starting osmo-stp 21:58:16.257823 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32616): Launched 21:58:16.602800 run osmo-stp_10.42.42.5(pid=32617): Launched 21:58:16.895169 run osmo-msc_10.42.42.6: Starting osmo-msc 21:58:17.576435 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32619): Launched 21:58:17.880619 run osmo-msc_10.42.42.6(pid=32620): Launched 21:58:18.050653 run osmo-stp_10.42.42.5(pid=32617): ERR: Terminated: ERROR {rc=1} [trial-2382↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32617)] 21:58:18.180045 run osmo-stp_10.42.42.5(pid=32617): stdout: | (launched: 2022-12-12_21:58:16.531586) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:58:18.309289 run osmo-stp_10.42.42.5(pid=32617): stderr: | 20221212215816831 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212215816831 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212215816832 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212215816832 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212215816837 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212215816838 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212215816838 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:58:18.436273 run osmo-stp_10.42.42.5(pid=32617): stdout: | (launched: 2022-12-12_21:58:16.531586) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:58:18.556711 run osmo-stp_10.42.42.5(pid=32617): stderr: | 20221212215816831 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212215816831 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212215816832 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212215816832 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212215816837 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212215816838 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212215816838 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:58:18.701464 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=32617): Process ended prematurely: osmo-stp_10.42.42.5(pid=32617) [trial-2382↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32617)] [trial-2382↪handover_2G:oc2g+bts1-sysmo↪handover.py:18] 21:58:18.709634 tst handover.py:18: Test FAILED (6.9 sec) 21:58:18.735640 run osmo-hlr_10.42.42.2(pid=32614): ERR: Terminated: ERROR {rc=237} [trial-2382↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32614)] 21:58:18.783416 run osmo-hlr_10.42.42.2(pid=32614): stdout: | (launched: 2022-12-12_21:58:15.521718) 21:58:18.833908 run osmo-hlr_10.42.42.2(pid=32614): stderr: | 20221212215815719 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212215815719 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212215815719 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212215815719 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212215815719 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212215815719 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212215815732 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/handover_2G:oc2g+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212215815740 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212215815740 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212215815740 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:58:18.903357 run osmo-msc_10.42.42.6(pid=32620): ERR: Terminated: ERROR {rc=2} [trial-2382↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32620)] 21:58:18.951381 run osmo-msc_10.42.42.6(pid=32620): stdout: | (launched: 2022-12-12_21:58:17.825444) 21:58:19.001212 run osmo-msc_10.42.42.6(pid=32620): stderr: | 20221212215818101 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212215818101 DLGLOBAL DEBUG validating counter group 0x7faf8b0e2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212215818101 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212215818101 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212215818102 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212215818102 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212215818105 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212215818106 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212215818106 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212215818106 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:58:19.050913 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32613): Terminating (SIGTERM) 21:58:19.090883 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32616): Terminating (SIGTERM) 21:58:19.130988 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32619): Terminating (SIGTERM) 21:58:19.171276 --- ParallelTerminationStrategy: PID 32613 died... 21:58:19.190396 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32613): Terminated: ok {rc=0} 21:58:19.234700 --- ParallelTerminationStrategy: PID 32616 died... 21:58:19.253326 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32616): Terminated: ok {rc=0} 21:58:19.297880 --- ParallelTerminationStrategy: PID 32619 died... 21:58:19.316551 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32619): Terminated: ok {rc=0} 21:58:19.403595 bus /sierra_3: Setting Powered False 21:58:20.504090 bus /sierra_3: Setting Powered False 21:58:21.620513 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 handover_2G:oc2g+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 handover_2G:oc2g+bts1-trx-b200 --------------------------------------------------------------------- 21:58:22.860110 tst handover_2G:oc2g+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:58:22.865364 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 21:58:22.914721 tst handover_2G:oc2g+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 21:58:22.941038 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 21:58:22.993510 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 21:58:23.046994 tst handover_2G:oc2g+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 21:58:23.074777 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 21:58:23.624621 tst handover_2G:oc2g+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OC-2G Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 handover_2G:oc2g+bts1-trx-b200 handover.py ---------------------------------------------- 21:58:23.630619 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:58:23.642103 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 21:58:23.678265 tst handover.py: using LAC 31774 21:58:23.806791 tst handover.py: using RAC 154 21:58:23.934481 tst handover.py: using CellId 31774 21:58:24.062429 tst handover.py: using BVCI 31775 21:58:24.183662 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 21:58:24.233168 tst handover.py: using LAC 31775 21:58:24.362504 tst handover.py: using RAC 155 21:58:24.493516 tst handover.py: using CellId 31775 21:58:24.616888 tst handover.py: using BVCI 31776 21:58:24.728590 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:58:24.739382 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:58:24.750024 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:58:24.760481 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:58:24.771049 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:58:24.781528 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 21:58:24.899476 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 21:58:25.017307 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:58:25.496159 run create_hlr_db(pid=32625): Launched 21:58:25.621869 bus /sierra_2: Setting Powered False 21:58:26.685892 run create_hlr_db(pid=32625): Terminated: ok {rc=0} 21:58:27.111431 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32627): Launched 21:58:27.437084 run osmo-hlr_10.42.42.2(pid=32628): Launched 21:58:27.563766 run osmo-stp_10.42.42.5: Starting osmo-stp 21:58:28.098855 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32630): Launched 21:58:28.423693 run osmo-stp_10.42.42.5(pid=32631): Launched 21:58:28.548660 run osmo-msc_10.42.42.6: Starting osmo-msc 21:58:29.110464 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32633): Launched 21:58:29.435733 run osmo-msc_10.42.42.6(pid=32634): Launched 21:58:29.619186 run osmo-stp_10.42.42.5(pid=32631): ERR: Terminated: ERROR {rc=1} [trial-2382↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32631)] 21:58:29.757165 run osmo-stp_10.42.42.5(pid=32631): stdout: | (launched: 2022-12-12_21:58:28.365195) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:58:29.895933 run osmo-stp_10.42.42.5(pid=32631): stderr: | 20221212215828558 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212215828558 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212215828559 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212215828559 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212215828560 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212215828560 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212215828560 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:58:30.034316 run osmo-stp_10.42.42.5(pid=32631): stdout: | (launched: 2022-12-12_21:58:28.365195) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:58:30.165430 run osmo-stp_10.42.42.5(pid=32631): stderr: | 20221212215828558 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212215828558 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212215828559 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212215828559 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212215828560 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212215828560 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212215828560 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:58:30.321253 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=32631): Process ended prematurely: osmo-stp_10.42.42.5(pid=32631) [trial-2382↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32631)] [trial-2382↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18] 21:58:30.330283 tst handover.py:18: Test FAILED (6.7 sec) 21:58:30.358010 run osmo-hlr_10.42.42.2(pid=32628): ERR: Terminated: ERROR {rc=237} [trial-2382↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32628)] 21:58:30.409296 run osmo-hlr_10.42.42.2(pid=32628): stdout: | (launched: 2022-12-12_21:58:27.378331) 21:58:30.462047 run osmo-hlr_10.42.42.2(pid=32628): stderr: | 20221212215827577 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212215827577 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212215827577 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212215827577 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212215827577 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212215827577 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212215827589 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/handover_2G:oc2g+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212215827597 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212215827598 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212215827598 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:58:30.534985 run osmo-msc_10.42.42.6(pid=32634): ERR: Terminated: ERROR {rc=2} [trial-2382↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32634)] 21:58:30.585474 run osmo-msc_10.42.42.6(pid=32634): stdout: | (launched: 2022-12-12_21:58:29.377324) 21:58:30.637656 run osmo-msc_10.42.42.6(pid=32634): stderr: | 20221212215829701 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212215829701 DLGLOBAL DEBUG validating counter group 0x7f7704bc1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212215829701 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212215829701 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212215829701 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212215829701 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212215829703 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212215829703 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212215829703 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212215829704 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:58:30.690363 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32627): Terminating (SIGTERM) 21:58:30.732684 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32630): Terminating (SIGTERM) 21:58:30.774818 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32633): Terminating (SIGTERM) 21:58:30.817420 --- ParallelTerminationStrategy: PID 32627 died... 21:58:30.846954 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32627): Terminated: ok {rc=0} 21:58:30.895150 --- ParallelTerminationStrategy: PID 32630 died... 21:58:30.931883 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32630): Terminated: ok {rc=0} 21:58:30.979811 --- ParallelTerminationStrategy: PID 32633 died... 21:58:31.000518 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32633): Terminated: ok {rc=0} 21:58:31.094398 bus /sierra_3: Setting Powered False 21:58:32.206809 bus /sierra_3: Setting Powered False 21:58:33.324111 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 handover_2G:oc2g+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 handover_2G:oc2g+bts1-trx-umtrx --------------------------------------------------------------------- 21:58:34.583446 tst handover_2G:oc2g+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:58:34.589189 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 21:58:34.641625 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 21:58:34.669243 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 21:58:34.722437 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 21:58:34.773743 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 21:58:34.801197 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 21:58:35.351277 tst handover_2G:oc2g+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OC-2G UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 handover_2G:oc2g+bts1-trx-umtrx handover.py ---------------------------------------------- 21:58:35.356917 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:58:35.368279 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 21:58:35.407090 tst handover.py: using LAC 31776 21:58:35.534098 tst handover.py: using RAC 156 21:58:35.660325 tst handover.py: using CellId 31776 21:58:35.786438 tst handover.py: using BVCI 31777 21:58:35.905252 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 21:58:35.952638 tst handover.py: using LAC 31777 21:58:36.081176 tst handover.py: using RAC 157 21:58:36.206553 tst handover.py: using CellId 31777 21:58:36.332111 tst handover.py: using BVCI 31778 21:58:36.452041 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:58:36.463452 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:58:36.474647 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:58:36.486214 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:58:36.497775 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:58:36.509243 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 21:58:36.624159 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 21:58:36.739067 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:58:37.183965 run create_hlr_db(pid=32639): Launched 21:58:37.309260 bus /sierra_2: Setting Powered False 21:58:38.369617 run create_hlr_db(pid=32639): Terminated: ok {rc=0} 21:58:38.787973 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32641): Launched 21:58:39.115351 run osmo-hlr_10.42.42.2(pid=32642): Launched 21:58:39.240665 run osmo-stp_10.42.42.5: Starting osmo-stp 21:58:39.777743 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32644): Launched 21:58:40.106161 run osmo-stp_10.42.42.5(pid=32645): Launched 21:58:40.232391 run osmo-msc_10.42.42.6: Starting osmo-msc 21:58:40.795992 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32647): Launched 21:58:41.123753 run osmo-msc_10.42.42.6(pid=32648): Launched 21:58:41.306677 run osmo-stp_10.42.42.5(pid=32645): ERR: Terminated: ERROR {rc=1} [trial-2382↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32645)] 21:58:41.445642 run osmo-stp_10.42.42.5(pid=32645): stdout: | (launched: 2022-12-12_21:58:40.046650) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:58:41.585245 run osmo-stp_10.42.42.5(pid=32645): stderr: | 20221212215840241 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212215840241 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212215840242 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212215840242 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212215840243 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212215840243 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212215840243 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:58:41.723597 run osmo-stp_10.42.42.5(pid=32645): stdout: | (launched: 2022-12-12_21:58:40.046650) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:58:41.854891 run osmo-stp_10.42.42.5(pid=32645): stderr: | 20221212215840241 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212215840241 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212215840242 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212215840242 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212215840243 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212215840243 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212215840243 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:58:42.011154 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=32645): Process ended prematurely: osmo-stp_10.42.42.5(pid=32645) [trial-2382↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32645)] [trial-2382↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18] 21:58:42.020086 tst handover.py:18: Test FAILED (6.7 sec) 21:58:42.048597 run osmo-hlr_10.42.42.2(pid=32642): ERR: Terminated: ERROR {rc=237} [trial-2382↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32642)] 21:58:42.100207 run osmo-hlr_10.42.42.2(pid=32642): stdout: | (launched: 2022-12-12_21:58:39.056087) 21:58:42.153406 run osmo-hlr_10.42.42.2(pid=32642): stderr: | 20221212215839254 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212215839254 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212215839254 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212215839254 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212215839254 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212215839254 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212215839267 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/handover_2G:oc2g+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212215839277 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212215839277 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212215839277 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:58:42.227066 run osmo-msc_10.42.42.6(pid=32648): ERR: Terminated: ERROR {rc=2} [trial-2382↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32648)] 21:58:42.277983 run osmo-msc_10.42.42.6(pid=32648): stdout: | (launched: 2022-12-12_21:58:41.064382) 21:58:42.330625 run osmo-msc_10.42.42.6(pid=32648): stderr: | 20221212215841389 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212215841389 DLGLOBAL DEBUG validating counter group 0x7f640e5efc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212215841389 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212215841389 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212215841389 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212215841389 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212215841391 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212215841391 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212215841391 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212215841392 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:58:42.383749 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32641): Terminating (SIGTERM) 21:58:42.426171 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32644): Terminating (SIGTERM) 21:58:42.468773 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32647): Terminating (SIGTERM) 21:58:42.511510 --- ParallelTerminationStrategy: PID 32641 died... 21:58:42.531731 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32641): Terminated: ok {rc=0} 21:58:42.579459 --- ParallelTerminationStrategy: PID 32644 died... 21:58:42.599229 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32644): Terminated: ok {rc=0} 21:58:42.646133 --- ParallelTerminationStrategy: PID 32647 died... 21:58:42.666002 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32647): Terminated: ok {rc=0} 21:58:42.754124 bus /sierra_3: Setting Powered False 21:58:43.855335 bus /sierra_3: Setting Powered False 21:58:44.971428 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 handover_2G:oc2g+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 handover_2G:octphy+bts1-trx-lms --------------------------------------------------------------------- 21:58:46.278343 tst handover_2G:octphy+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:58:46.284322 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 21:58:46.342490 tst handover_2G:octphy+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 21:58:46.374504 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 21:58:46.434489 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 21:58:46.501149 tst handover_2G:octphy+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 21:58:46.538469 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 21:58:47.095217 tst handover_2G:octphy+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 handover_2G:octphy+bts1-trx-lms handover.py ---------------------------------------------- 21:58:47.107731 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 21:58:47.120139 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 21:58:47.159540 tst handover.py: using LAC 31778 21:58:47.291436 tst handover.py: using RAC 158 21:58:47.420212 tst handover.py: using CellId 31778 21:58:47.549709 tst handover.py: using BVCI 31779 21:58:47.660440 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 21:58:47.709069 tst handover.py: using LAC 31779 21:58:47.830714 tst handover.py: using RAC 159 21:58:47.950902 tst handover.py: using CellId 31779 21:58:48.075742 tst handover.py: using BVCI 31780 21:58:48.197156 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 21:58:48.208328 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 21:58:48.219368 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 21:58:48.230761 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 21:58:48.242221 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 21:58:48.253507 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 21:58:48.368179 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 21:58:48.484887 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:58:48.929769 run create_hlr_db(pid=32653): Launched 21:58:49.055680 bus /sierra_2: Setting Powered False 21:58:50.117380 run create_hlr_db(pid=32653): Terminated: ok {rc=0} 21:58:50.536427 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32655): Launched 21:58:50.863362 run osmo-hlr_10.42.42.2(pid=32656): Launched 21:58:50.989287 run osmo-stp_10.42.42.5: Starting osmo-stp 21:58:51.499824 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32658): Launched 21:58:51.802978 run osmo-stp_10.42.42.5(pid=32659): Launched 21:58:51.918979 run osmo-msc_10.42.42.6: Starting osmo-msc 21:58:52.446181 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32661): Launched 21:58:52.750291 run osmo-msc_10.42.42.6(pid=32662): Launched 21:58:52.920047 run osmo-stp_10.42.42.5(pid=32659): ERR: Terminated: ERROR {rc=1} [trial-2382↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32659)] 21:58:53.048500 run osmo-stp_10.42.42.5(pid=32659): stdout: | (launched: 2022-12-12_21:58:51.747972) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:58:53.177529 run osmo-stp_10.42.42.5(pid=32659): stderr: | 20221212215851918 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212215851918 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212215851918 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212215851918 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212215851919 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212215851919 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212215851919 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:58:53.304933 run osmo-stp_10.42.42.5(pid=32659): stdout: | (launched: 2022-12-12_21:58:51.747972) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:58:53.426286 run osmo-stp_10.42.42.5(pid=32659): stderr: | 20221212215851918 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212215851918 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212215851918 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212215851918 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212215851919 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212215851919 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212215851919 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:58:53.571171 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=32659): Process ended prematurely: osmo-stp_10.42.42.5(pid=32659) [trial-2382↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32659)] [trial-2382↪handover_2G:octphy+bts1-trx-lms↪handover.py:18] 21:58:53.579336 tst handover.py:18: Test FAILED (6.5 sec) 21:58:53.605239 run osmo-hlr_10.42.42.2(pid=32656): ERR: Terminated: ERROR {rc=237} [trial-2382↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32656)] 21:58:53.652924 run osmo-hlr_10.42.42.2(pid=32656): stdout: | (launched: 2022-12-12_21:58:50.804340) 21:58:53.703056 run osmo-hlr_10.42.42.2(pid=32656): stderr: | 20221212215851004 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212215851004 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212215851004 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212215851004 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212215851004 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212215851004 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212215851020 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/handover_2G:octphy+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212215851030 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212215851030 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212215851030 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:58:53.772279 run osmo-msc_10.42.42.6(pid=32662): ERR: Terminated: ERROR {rc=2} [trial-2382↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32662)] 21:58:53.820361 run osmo-msc_10.42.42.6(pid=32662): stdout: | (launched: 2022-12-12_21:58:52.695263) 21:58:53.869749 run osmo-msc_10.42.42.6(pid=32662): stderr: | 20221212215852967 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212215852967 DLGLOBAL DEBUG validating counter group 0x7fe8b893dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212215852967 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212215852967 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212215852967 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212215852967 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212215852969 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212215852969 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212215852970 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212215852970 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:58:53.919640 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32655): Terminating (SIGTERM) 21:58:53.959402 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32658): Terminating (SIGTERM) 21:58:53.999317 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32661): Terminating (SIGTERM) 21:58:54.039398 --- ParallelTerminationStrategy: PID 32655 died... 21:58:54.058612 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32655): Terminated: ok {rc=0} 21:58:54.102924 --- ParallelTerminationStrategy: PID 32658 died... 21:58:54.121561 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32658): Terminated: ok {rc=0} 21:58:54.165430 --- ParallelTerminationStrategy: PID 32661 died... 21:58:54.184152 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32661): Terminated: ok {rc=0} 21:58:54.270322 bus /sierra_3: Setting Powered False 21:58:55.371348 bus /sierra_3: Setting Powered False 21:58:56.487629 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 handover_2G:octphy+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 handover_2G:octphy+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 21:58:57.742556 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:58:57.748177 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 21:58:57.794642 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 21:58:57.821779 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 21:58:57.875418 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 21:58:57.921365 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 21:58:57.948757 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 21:58:58.500728 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 handover_2G:octphy+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 21:58:58.506328 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:58:58.517897 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 21:58:58.553098 tst handover.py: using LAC 31780 21:58:58.680872 tst handover.py: using RAC 160 21:58:58.810375 tst handover.py: using CellId 31780 21:58:58.930922 tst handover.py: using BVCI 31781 21:58:59.044250 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 21:58:59.088463 tst handover.py: using LAC 31781 21:58:59.212035 tst handover.py: using RAC 161 21:58:59.332935 tst handover.py: using CellId 31781 21:58:59.463581 tst handover.py: using BVCI 31782 21:58:59.583587 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:58:59.595491 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:58:59.606752 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:58:59.618403 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:58:59.629882 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:58:59.641527 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 21:58:59.756356 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 21:58:59.875844 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:59:00.356106 run create_hlr_db(pid=32667): Launched 21:59:00.481321 bus /sierra_2: Setting Powered False 21:59:01.575786 run create_hlr_db(pid=32667): Terminated: ok {rc=0} 21:59:02.049883 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32669): Launched 21:59:02.386216 run osmo-hlr_10.42.42.2(pid=32670): Launched 21:59:02.502877 run osmo-stp_10.42.42.5: Starting osmo-stp 21:59:03.014186 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32672): Launched 21:59:03.317658 run osmo-stp_10.42.42.5(pid=32673): Launched 21:59:03.433441 run osmo-msc_10.42.42.6: Starting osmo-msc 21:59:03.957577 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32675): Launched 21:59:04.264777 run osmo-msc_10.42.42.6(pid=32676): Launched 21:59:04.437208 run osmo-stp_10.42.42.5(pid=32673): ERR: Terminated: ERROR {rc=1} [trial-2382↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32673)] 21:59:04.566022 run osmo-stp_10.42.42.5(pid=32673): stdout: | (launched: 2022-12-12_21:59:03.262505) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:59:04.695010 run osmo-stp_10.42.42.5(pid=32673): stderr: | 20221212215903435 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212215903435 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212215903435 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212215903436 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212215903436 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212215903436 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212215903436 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:59:04.822207 run osmo-stp_10.42.42.5(pid=32673): stdout: | (launched: 2022-12-12_21:59:03.262505) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:59:04.943215 run osmo-stp_10.42.42.5(pid=32673): stderr: | 20221212215903435 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212215903435 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212215903435 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212215903436 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212215903436 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212215903436 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212215903436 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:59:05.087690 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=32673): Process ended prematurely: osmo-stp_10.42.42.5(pid=32673) [trial-2382↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32673)] [trial-2382↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18] 21:59:05.096038 tst handover.py:18: Test FAILED (6.6 sec) 21:59:05.122425 run osmo-hlr_10.42.42.2(pid=32670): ERR: Terminated: ERROR {rc=237} [trial-2382↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32670)] 21:59:05.170628 run osmo-hlr_10.42.42.2(pid=32670): stdout: | (launched: 2022-12-12_21:59:02.330713) 21:59:05.220286 run osmo-hlr_10.42.42.2(pid=32670): stderr: | 20221212215902509 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212215902509 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212215902509 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212215902509 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212215902509 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212215902509 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212215902521 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/handover_2G:octphy+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212215902530 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212215902530 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212215902530 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:59:05.289999 run osmo-msc_10.42.42.6(pid=32676): ERR: Terminated: ERROR {rc=2} [trial-2382↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32676)] 21:59:05.338172 run osmo-msc_10.42.42.6(pid=32676): stdout: | (launched: 2022-12-12_21:59:04.208387) 21:59:05.388058 run osmo-msc_10.42.42.6(pid=32676): stderr: | 20221212215904480 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212215904480 DLGLOBAL DEBUG validating counter group 0x7efd6d3c7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212215904480 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212215904480 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212215904480 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212215904481 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212215904482 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212215904483 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212215904483 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212215904483 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:59:05.438119 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32669): Terminating (SIGTERM) 21:59:05.478270 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32672): Terminating (SIGTERM) 21:59:05.518585 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32675): Terminating (SIGTERM) 21:59:05.559103 --- ParallelTerminationStrategy: PID 32669 died... 21:59:05.578271 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32669): Terminated: ok {rc=0} 21:59:05.622949 --- ParallelTerminationStrategy: PID 32672 died... 21:59:05.641834 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32672): Terminated: ok {rc=0} 21:59:05.685942 --- ParallelTerminationStrategy: PID 32675 died... 21:59:05.704593 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32675): Terminated: ok {rc=0} 21:59:05.788877 bus /sierra_3: Setting Powered False 21:59:06.887567 bus /sierra_3: Setting Powered False 21:59:08.007258 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 handover_2G:octphy+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 handover_2G:octphy+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 21:59:09.255209 tst handover_2G:octphy+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:59:09.260318 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 21:59:09.309149 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 21:59:09.335260 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 21:59:09.387544 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 21:59:09.440429 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 21:59:09.467673 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 21:59:10.012156 tst handover_2G:octphy+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 handover_2G:octphy+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 21:59:10.018064 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:59:10.029257 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 21:59:10.062094 tst handover.py: using LAC 31782 21:59:10.183269 tst handover.py: using RAC 162 21:59:10.304809 tst handover.py: using CellId 31782 21:59:10.427920 tst handover.py: using BVCI 31783 21:59:10.540863 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 21:59:10.589635 tst handover.py: using LAC 31783 21:59:10.709663 tst handover.py: using RAC 163 21:59:10.829744 tst handover.py: using CellId 31783 21:59:10.952532 tst handover.py: using BVCI 31784 21:59:11.065100 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:59:11.075941 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:59:11.086624 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:59:11.097389 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:59:11.109074 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:59:11.120332 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 21:59:11.239919 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 21:59:11.360113 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:59:11.837807 run create_hlr_db(pid=32681): Launched 21:59:11.963484 bus /sierra_2: Setting Powered False 21:59:13.028491 run create_hlr_db(pid=32681): Terminated: ok {rc=0} 21:59:13.454352 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32683): Launched 21:59:13.780921 run osmo-hlr_10.42.42.2(pid=32684): Launched 21:59:13.906177 run osmo-stp_10.42.42.5: Starting osmo-stp 21:59:14.441717 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32686): Launched 21:59:14.770509 run osmo-stp_10.42.42.5(pid=32687): Launched 21:59:14.895944 run osmo-msc_10.42.42.6: Starting osmo-msc 21:59:15.459557 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32689): Launched 21:59:15.786923 run osmo-msc_10.42.42.6(pid=32690): Launched 21:59:16.141922 run osmo-stp_10.42.42.5(pid=32687): ERR: Terminated: ERROR {rc=1} [trial-2382↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32687)] 21:59:16.409057 run osmo-stp_10.42.42.5(pid=32687): stdout: | (launched: 2022-12-12_21:59:14.710414) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:59:16.550902 run osmo-stp_10.42.42.5(pid=32687): stderr: | 20221212215914904 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212215914904 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212215914904 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212215914905 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212215914905 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212215914905 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212215914905 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:59:16.692140 run osmo-stp_10.42.42.5(pid=32687): stdout: | (launched: 2022-12-12_21:59:14.710414) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:59:16.827378 run osmo-stp_10.42.42.5(pid=32687): stderr: | 20221212215914904 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212215914904 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212215914904 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212215914905 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212215914905 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212215914905 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212215914905 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:59:16.988506 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=32687): Process ended prematurely: osmo-stp_10.42.42.5(pid=32687) [trial-2382↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32687)] [trial-2382↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18] 21:59:16.998615 tst handover.py:18: Test FAILED (7.0 sec) 21:59:17.030198 run osmo-hlr_10.42.42.2(pid=32684): ERR: Terminated: ERROR {rc=237} [trial-2382↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32684)] 21:59:17.084463 run osmo-hlr_10.42.42.2(pid=32684): stdout: | (launched: 2022-12-12_21:59:13.722313) 21:59:17.139910 run osmo-hlr_10.42.42.2(pid=32684): stderr: | 20221212215913921 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212215913921 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212215913921 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212215913921 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212215913921 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212215913921 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212215913934 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/handover_2G:octphy+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212215913944 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212215913944 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212215913945 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:59:17.216100 run osmo-msc_10.42.42.6(pid=32690): ERR: Terminated: ERROR {rc=2} [trial-2382↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32690)] 21:59:17.269390 run osmo-msc_10.42.42.6(pid=32690): stdout: | (launched: 2022-12-12_21:59:15.727897) 21:59:17.322876 run osmo-msc_10.42.42.6(pid=32690): stderr: | 20221212215916131 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212215916131 DLGLOBAL DEBUG validating counter group 0x7f0e1085cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212215916131 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212215916131 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212215916132 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212215916132 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212215916134 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212215916134 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212215916134 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212215916134 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:59:17.376617 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32683): Terminating (SIGTERM) 21:59:17.419719 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32686): Terminating (SIGTERM) 21:59:17.462782 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32689): Terminating (SIGTERM) 21:59:17.506265 --- ParallelTerminationStrategy: PID 32683 died... 21:59:17.526376 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32683): Terminated: ok {rc=0} 21:59:17.575064 --- ParallelTerminationStrategy: PID 32686 died... 21:59:17.594819 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32686): Terminated: ok {rc=0} 21:59:17.643235 --- ParallelTerminationStrategy: PID 32689 died... 21:59:17.663056 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32689): Terminated: ok {rc=0} 21:59:17.752769 bus /sierra_3: Setting Powered False 21:59:18.852063 bus /sierra_3: Setting Powered False 21:59:19.968789 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 handover_2G:octphy+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 handover_2G:octphy+bts1-sysmo --------------------------------------------------------------------- 21:59:21.236561 tst handover_2G:octphy+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:59:21.243634 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x bts (candidates: 11) 21:59:21.282371 tst handover_2G:octphy+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 21:59:21.309699 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x modem (candidates: 12) 21:59:21.360158 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x bts (candidates: 11) 21:59:21.397992 tst handover_2G:octphy+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 21:59:21.425539 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x modem (candidates: 12) 21:59:21.977664 tst handover_2G:octphy+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 handover_2G:octphy+bts1-sysmo handover.py ---------------------------------------------- 21:59:21.983029 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 21:59:21.994239 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 21:59:22.028663 tst handover.py: using LAC 31784 21:59:22.155864 tst handover.py: using RAC 164 21:59:22.282242 tst handover.py: using CellId 31784 21:59:22.410028 tst handover.py: using BVCI 31785 21:59:22.531567 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 21:59:22.564611 tst handover.py: using LAC 31785 21:59:22.694567 tst handover.py: using RAC 165 21:59:22.821377 tst handover.py: using CellId 31785 21:59:22.953664 tst handover.py: using BVCI 31786 21:59:23.073331 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 21:59:23.084867 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 21:59:23.096310 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 21:59:23.107660 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 21:59:23.119066 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 21:59:23.130242 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 21:59:23.250702 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 21:59:23.367384 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:59:23.813076 run create_hlr_db(pid=32695): Launched 21:59:23.938457 bus /sierra_2: Setting Powered False 21:59:24.999591 run create_hlr_db(pid=32695): Terminated: ok {rc=0} 21:59:25.416399 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32697): Launched 21:59:25.742907 run osmo-hlr_10.42.42.2(pid=32698): Launched 21:59:25.868068 run osmo-stp_10.42.42.5: Starting osmo-stp 21:59:26.402358 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32700): Launched 21:59:26.728837 run osmo-stp_10.42.42.5(pid=32701): Launched 21:59:26.854169 run osmo-msc_10.42.42.6: Starting osmo-msc 21:59:27.415776 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32703): Launched 21:59:27.741821 run osmo-msc_10.42.42.6(pid=32704): Launched 21:59:27.924017 run osmo-stp_10.42.42.5(pid=32701): ERR: Terminated: ERROR {rc=1} [trial-2382↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32701)] 21:59:28.062987 run osmo-stp_10.42.42.5(pid=32701): stdout: | (launched: 2022-12-12_21:59:26.670252) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:59:28.202919 run osmo-stp_10.42.42.5(pid=32701): stderr: | 20221212215926863 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212215926864 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212215926864 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212215926865 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212215926865 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212215926865 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212215926865 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:59:28.341614 run osmo-stp_10.42.42.5(pid=32701): stdout: | (launched: 2022-12-12_21:59:26.670252) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:59:28.472082 run osmo-stp_10.42.42.5(pid=32701): stderr: | 20221212215926863 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212215926864 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212215926864 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212215926865 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212215926865 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212215926865 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212215926865 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:59:28.628422 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=32701): Process ended prematurely: osmo-stp_10.42.42.5(pid=32701) [trial-2382↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32701)] [trial-2382↪handover_2G:octphy+bts1-sysmo↪handover.py:18] 21:59:28.637269 tst handover.py:18: Test FAILED (6.6 sec) 21:59:28.665241 run osmo-hlr_10.42.42.2(pid=32698): ERR: Terminated: ERROR {rc=237} [trial-2382↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32698)] 21:59:28.716819 run osmo-hlr_10.42.42.2(pid=32698): stdout: | (launched: 2022-12-12_21:59:25.683943) 21:59:28.769777 run osmo-hlr_10.42.42.2(pid=32698): stderr: | 20221212215925881 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212215925881 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212215925881 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212215925881 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212215925881 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212215925881 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212215925893 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/handover_2G:octphy+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212215925901 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212215925902 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212215925902 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:59:28.844095 run osmo-msc_10.42.42.6(pid=32704): ERR: Terminated: ERROR {rc=2} [trial-2382↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32704)] 21:59:28.895278 run osmo-msc_10.42.42.6(pid=32704): stdout: | (launched: 2022-12-12_21:59:27.683126) 21:59:28.947916 run osmo-msc_10.42.42.6(pid=32704): stderr: | 20221212215928004 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212215928004 DLGLOBAL DEBUG validating counter group 0x7fc29e65bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212215928004 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212215928004 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212215928005 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212215928005 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212215928007 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212215928007 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212215928007 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212215928007 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:59:29.000875 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32697): Terminating (SIGTERM) 21:59:29.043545 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32700): Terminating (SIGTERM) 21:59:29.086371 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32703): Terminating (SIGTERM) 21:59:29.129225 --- ParallelTerminationStrategy: PID 32697 died... 21:59:29.149576 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32697): Terminated: ok {rc=0} 21:59:29.196814 --- ParallelTerminationStrategy: PID 32700 died... 21:59:29.217056 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32700): Terminated: ok {rc=0} 21:59:29.264170 --- ParallelTerminationStrategy: PID 32703 died... 21:59:29.283842 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32703): Terminated: ok {rc=0} 21:59:29.373139 bus /sierra_3: Setting Powered False 21:59:30.471836 bus /sierra_3: Setting Powered False 21:59:31.586833 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 handover_2G:octphy+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 handover_2G:octphy+bts1-trx-b200 --------------------------------------------------------------------- 21:59:32.831957 tst handover_2G:octphy+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:59:32.837569 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 21:59:32.887957 tst handover_2G:octphy+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 21:59:32.915193 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 21:59:32.967555 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 21:59:33.017986 tst handover_2G:octphy+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 21:59:33.045421 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 21:59:33.595945 tst handover_2G:octphy+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 handover_2G:octphy+bts1-trx-b200 handover.py ---------------------------------------------- 21:59:33.601414 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:59:33.612464 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 21:59:33.647175 tst handover.py: using LAC 31786 21:59:33.778080 tst handover.py: using RAC 166 21:59:33.907674 tst handover.py: using CellId 31786 21:59:34.038218 tst handover.py: using BVCI 31787 21:59:34.159418 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 21:59:34.212097 tst handover.py: using LAC 31787 21:59:34.340601 tst handover.py: using RAC 167 21:59:34.469391 tst handover.py: using CellId 31787 21:59:34.601163 tst handover.py: using BVCI 31788 21:59:34.721962 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:59:34.733272 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:59:34.744242 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:59:34.755698 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:59:34.767247 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:59:34.778715 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 21:59:34.894672 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 21:59:35.012689 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:59:35.457786 run create_hlr_db(pid=32709): Launched 21:59:35.582518 bus /sierra_2: Setting Powered False 21:59:36.644214 run create_hlr_db(pid=32709): Terminated: ok {rc=0} 21:59:37.060940 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32711): Launched 21:59:37.388625 run osmo-hlr_10.42.42.2(pid=32712): Launched 21:59:37.514610 run osmo-stp_10.42.42.5: Starting osmo-stp 21:59:38.051746 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32714): Launched 21:59:38.377908 run osmo-stp_10.42.42.5(pid=32715): Launched 21:59:38.503202 run osmo-msc_10.42.42.6: Starting osmo-msc 21:59:39.065228 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32717): Launched 21:59:39.392279 run osmo-msc_10.42.42.6(pid=32718): Launched 21:59:39.576882 run osmo-stp_10.42.42.5(pid=32715): ERR: Terminated: ERROR {rc=1} [trial-2382↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32715)] 21:59:39.716187 run osmo-stp_10.42.42.5(pid=32715): stdout: | (launched: 2022-12-12_21:59:38.319025) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:59:39.855490 run osmo-stp_10.42.42.5(pid=32715): stderr: | 20221212215938508 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212215938509 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212215938509 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212215938509 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212215938511 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212215938512 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212215938512 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:59:39.994271 run osmo-stp_10.42.42.5(pid=32715): stdout: | (launched: 2022-12-12_21:59:38.319025) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:59:40.125361 run osmo-stp_10.42.42.5(pid=32715): stderr: | 20221212215938508 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212215938509 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212215938509 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212215938509 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212215938511 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212215938512 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212215938512 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:59:40.281654 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=32715): Process ended prematurely: osmo-stp_10.42.42.5(pid=32715) [trial-2382↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32715)] [trial-2382↪handover_2G:octphy+bts1-trx-b200↪handover.py:18] 21:59:40.290422 tst handover.py:18: Test FAILED (6.7 sec) 21:59:40.318727 run osmo-hlr_10.42.42.2(pid=32712): ERR: Terminated: ERROR {rc=237} [trial-2382↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32712)] 21:59:40.369629 run osmo-hlr_10.42.42.2(pid=32712): stdout: | (launched: 2022-12-12_21:59:37.329725) 21:59:40.422402 run osmo-hlr_10.42.42.2(pid=32712): stderr: | 20221212215937527 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212215937527 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212215937527 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212215937527 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212215937528 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212215937528 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212215937540 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/handover_2G:octphy+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212215937549 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212215937549 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212215937549 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:59:40.495685 run osmo-msc_10.42.42.6(pid=32718): ERR: Terminated: ERROR {rc=2} [trial-2382↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32718)] 21:59:40.546315 run osmo-msc_10.42.42.6(pid=32718): stdout: | (launched: 2022-12-12_21:59:39.333421) 21:59:40.598705 run osmo-msc_10.42.42.6(pid=32718): stderr: | 20221212215939656 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212215939656 DLGLOBAL DEBUG validating counter group 0x7fe128893c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212215939656 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212215939656 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212215939656 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212215939657 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212215939660 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212215939661 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212215939661 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212215939661 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:59:40.651550 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32711): Terminating (SIGTERM) 21:59:40.694827 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32714): Terminating (SIGTERM) 21:59:40.737242 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32717): Terminating (SIGTERM) 21:59:40.779846 --- ParallelTerminationStrategy: PID 32711 died... 21:59:40.800094 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32711): Terminated: ok {rc=0} 21:59:40.847354 --- ParallelTerminationStrategy: PID 32714 died... 21:59:40.867157 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32714): Terminated: ok {rc=0} 21:59:40.914191 --- ParallelTerminationStrategy: PID 32717 died... 21:59:40.933707 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32717): Terminated: ok {rc=0} 21:59:41.023464 bus /sierra_3: Setting Powered False 21:59:42.123860 bus /sierra_3: Setting Powered False 21:59:43.241195 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 handover_2G:octphy+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 handover_2G:octphy+bts1-trx-umtrx --------------------------------------------------------------------- 21:59:44.495611 tst handover_2G:octphy+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:59:44.501198 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 21:59:44.550660 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 21:59:44.578061 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 21:59:44.633229 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 21:59:44.683183 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 21:59:44.710506 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 21:59:45.253603 tst handover_2G:octphy+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 handover_2G:octphy+bts1-trx-umtrx handover.py ---------------------------------------------- 21:59:45.258786 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:59:45.269609 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 21:59:45.304408 tst handover.py: using LAC 31788 21:59:45.425659 tst handover.py: using RAC 168 21:59:45.548793 tst handover.py: using CellId 31788 21:59:45.671275 tst handover.py: using BVCI 31789 21:59:45.784191 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 21:59:45.831268 tst handover.py: using LAC 31789 21:59:45.971087 tst handover.py: using RAC 169 21:59:46.106359 tst handover.py: using CellId 31789 21:59:46.247836 tst handover.py: using BVCI 31790 21:59:46.405442 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:59:46.420509 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:59:46.435884 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:59:46.449835 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:59:46.462194 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:59:46.474412 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 21:59:46.599976 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 21:59:46.722567 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:59:47.225669 run create_hlr_db(pid=32723): Launched 21:59:47.356228 bus /sierra_2: Setting Powered False 21:59:48.421635 run create_hlr_db(pid=32723): Terminated: ok {rc=0} 21:59:48.834343 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32725): Launched 21:59:49.138841 run osmo-hlr_10.42.42.2(pid=32726): Launched 21:59:49.256354 run osmo-stp_10.42.42.5: Starting osmo-stp 21:59:49.754516 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32728): Launched 21:59:50.059274 run osmo-stp_10.42.42.5(pid=32729): Launched 21:59:50.175824 run osmo-msc_10.42.42.6: Starting osmo-msc 21:59:50.700792 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32731): Launched 21:59:51.005693 run osmo-msc_10.42.42.6(pid=32732): Launched 21:59:51.176033 run osmo-stp_10.42.42.5(pid=32729): ERR: Terminated: ERROR {rc=1} [trial-2382↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32729)] 21:59:51.305649 run osmo-stp_10.42.42.5(pid=32729): stdout: | (launched: 2022-12-12_21:59:50.003943) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:59:51.435220 run osmo-stp_10.42.42.5(pid=32729): stderr: | 20221212215950175 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212215950175 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212215950175 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212215950176 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212215950178 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212215950178 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212215950178 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:59:51.563098 run osmo-stp_10.42.42.5(pid=32729): stdout: | (launched: 2022-12-12_21:59:50.003943) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:59:51.684221 run osmo-stp_10.42.42.5(pid=32729): stderr: | 20221212215950175 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212215950175 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212215950175 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212215950176 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212215950178 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212215950178 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212215950178 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:59:51.829975 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=32729): Process ended prematurely: osmo-stp_10.42.42.5(pid=32729) [trial-2382↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32729)] [trial-2382↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18] 21:59:51.838271 tst handover.py:18: Test FAILED (6.6 sec) 21:59:51.864848 run osmo-hlr_10.42.42.2(pid=32726): ERR: Terminated: ERROR {rc=237} [trial-2382↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32726)] 21:59:51.913243 run osmo-hlr_10.42.42.2(pid=32726): stdout: | (launched: 2022-12-12_21:59:49.083714) 21:59:51.962956 run osmo-hlr_10.42.42.2(pid=32726): stderr: | 20221212215949262 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212215949262 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212215949262 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212215949262 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212215949262 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212215949262 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212215949274 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/handover_2G:octphy+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212215949285 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212215949285 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212215949285 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:59:52.032537 run osmo-msc_10.42.42.6(pid=32732): ERR: Terminated: ERROR {rc=2} [trial-2382↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32732)] 21:59:52.080390 run osmo-msc_10.42.42.6(pid=32732): stdout: | (launched: 2022-12-12_21:59:50.950378) 21:59:52.130081 run osmo-msc_10.42.42.6(pid=32732): stderr: | 20221212215951224 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212215951224 DLGLOBAL DEBUG validating counter group 0x7fd4683b3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212215951225 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212215951225 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212215951225 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212215951225 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212215951227 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212215951227 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212215951227 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212215951227 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:59:52.179848 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32725): Terminating (SIGTERM) 21:59:52.219767 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32728): Terminating (SIGTERM) 21:59:52.259716 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32731): Terminating (SIGTERM) 21:59:52.300886 --- ParallelTerminationStrategy: PID 32725 died... 21:59:52.320183 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32725): Terminated: ok {rc=0} 21:59:52.365330 --- ParallelTerminationStrategy: PID 32728 died... 21:59:52.384119 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32728): Terminated: ok {rc=0} 21:59:52.428532 --- ParallelTerminationStrategy: PID 32731 died... 21:59:52.447483 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32731): Terminated: ok {rc=0} 21:59:52.531954 bus /sierra_3: Setting Powered False 21:59:53.626981 bus /sierra_3: Setting Powered False 21:59:54.743056 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 handover_2G:octphy+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 handover_2G:trx-lms+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 21:59:55.996457 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:59:56.001513 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 21:59:56.059129 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 21:59:56.085246 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 21:59:56.138564 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 21:59:56.199035 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 21:59:56.226060 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 21:59:56.773324 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 21:59:56.778392 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:59:56.789428 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 21:59:56.841353 tst handover.py: using LAC 31790 21:59:56.961901 tst handover.py: using RAC 170 21:59:57.080641 tst handover.py: using CellId 31790 21:59:57.199347 tst handover.py: using BVCI 31791 21:59:57.309537 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 21:59:57.353006 tst handover.py: using LAC 31791 21:59:57.470638 tst handover.py: using RAC 171 21:59:57.588660 tst handover.py: using CellId 31791 21:59:57.707560 tst handover.py: using BVCI 31792 21:59:57.819625 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:59:57.830663 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:59:57.841454 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:59:57.852200 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:59:57.862978 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:59:57.873725 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 21:59:57.993866 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 21:59:58.115969 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:59:58.595458 run create_hlr_db(pid=32737): Launched 21:59:58.720381 bus /sierra_2: Setting Powered False 21:59:59.785258 run create_hlr_db(pid=32737): Terminated: ok {rc=0} 22:00:00.211700 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32739): Launched 22:00:00.538171 run osmo-hlr_10.42.42.2(pid=32740): Launched 22:00:00.663521 run osmo-stp_10.42.42.5: Starting osmo-stp 22:00:01.214723 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32742): Launched 22:00:01.556432 run osmo-stp_10.42.42.5(pid=32746): Launched 22:00:01.781875 run osmo-msc_10.42.42.6: Starting osmo-msc 22:00:02.463586 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32748): Launched 22:00:02.790898 run osmo-msc_10.42.42.6(pid=32749): Launched 22:00:02.973995 run osmo-stp_10.42.42.5(pid=32746): ERR: Terminated: ERROR {rc=1} [trial-2382↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32746)] 22:00:03.113429 run osmo-stp_10.42.42.5(pid=32746): stdout: | (launched: 2022-12-12_22:00:01.497409) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:00:03.253790 run osmo-stp_10.42.42.5(pid=32746): stderr: | 20221212220001838 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212220001838 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212220001838 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212220001838 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212220001839 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212220001839 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212220001839 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:00:03.393048 run osmo-stp_10.42.42.5(pid=32746): stdout: | (launched: 2022-12-12_22:00:01.497409) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:00:03.524611 run osmo-stp_10.42.42.5(pid=32746): stderr: | 20221212220001838 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212220001838 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212220001838 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212220001838 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212220001839 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212220001839 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212220001839 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:00:03.681656 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=32746): Process ended prematurely: osmo-stp_10.42.42.5(pid=32746) [trial-2382↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32746)] [trial-2382↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18] 22:00:03.690797 tst handover.py:18: Test FAILED (6.9 sec) 22:00:03.719258 run osmo-hlr_10.42.42.2(pid=32740): ERR: Terminated: ERROR {rc=237} [trial-2382↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32740)] 22:00:03.770552 run osmo-hlr_10.42.42.2(pid=32740): stdout: | (launched: 2022-12-12_22:00:00.479171) 22:00:03.823542 run osmo-hlr_10.42.42.2(pid=32740): stderr: | 20221212220000679 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212220000679 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212220000679 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212220000679 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212220000679 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212220000679 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212220000691 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/handover_2G:trx-lms+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212220000700 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212220000700 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212220000700 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:00:03.897452 run osmo-msc_10.42.42.6(pid=32749): ERR: Terminated: ERROR {rc=2} [trial-2382↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32749)] 22:00:03.948569 run osmo-msc_10.42.42.6(pid=32749): stdout: | (launched: 2022-12-12_22:00:02.731821) 22:00:04.001302 run osmo-msc_10.42.42.6(pid=32749): stderr: | 20221212220003056 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212220003056 DLGLOBAL DEBUG validating counter group 0x7fa6fe7c2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212220003056 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212220003056 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212220003056 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212220003056 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212220003058 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212220003059 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212220003059 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212220003059 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:00:04.054396 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32739): Terminating (SIGTERM) 22:00:04.096815 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32742): Terminating (SIGTERM) 22:00:04.139691 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32748): Terminating (SIGTERM) 22:00:04.182508 --- ParallelTerminationStrategy: PID 32739 died... 22:00:04.202810 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32739): Terminated: ok {rc=0} 22:00:04.250558 --- ParallelTerminationStrategy: PID 32742 died... 22:00:04.270435 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32742): Terminated: ok {rc=0} 22:00:04.317750 --- ParallelTerminationStrategy: PID 32748 died... 22:00:04.337630 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32748): Terminated: ok {rc=0} 22:00:04.427334 bus /sierra_3: Setting Powered False 22:00:05.526372 bus /sierra_3: Setting Powered False 22:00:06.645305 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 handover_2G:trx-lms+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 handover_2G:trx-lms+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 22:00:07.913784 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:00:07.918740 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 22:00:07.981147 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 22:00:08.007316 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 22:00:08.058928 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 22:00:08.122075 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 22:00:08.148422 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 22:00:08.697893 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 handover_2G:trx-lms+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 22:00:08.704646 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:00:08.717114 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 22:00:08.769031 tst handover.py: using LAC 31792 22:00:08.900867 tst handover.py: using RAC 172 22:00:09.031075 tst handover.py: using CellId 31792 22:00:09.162794 tst handover.py: using BVCI 31793 22:00:09.283751 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 22:00:09.334052 tst handover.py: using LAC 31793 22:00:09.463580 tst handover.py: using RAC 173 22:00:09.593914 tst handover.py: using CellId 31793 22:00:09.722195 tst handover.py: using BVCI 31794 22:00:09.843653 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:00:09.855356 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:00:09.866859 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:00:09.878824 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:00:09.890723 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:00:09.902747 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 22:00:10.018601 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 22:00:10.141843 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:00:10.622506 run create_hlr_db(pid=32754): Launched 22:00:10.747869 bus /sierra_2: Setting Powered False 22:00:11.812259 run create_hlr_db(pid=32754): Terminated: ok {rc=0} 22:00:12.238971 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32756): Launched 22:00:12.566165 run osmo-hlr_10.42.42.2(pid=32757): Launched 22:00:12.691792 run osmo-stp_10.42.42.5: Starting osmo-stp 22:00:13.228378 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32759): Launched 22:00:13.554212 run osmo-stp_10.42.42.5(pid=32760): Launched 22:00:13.679108 run osmo-msc_10.42.42.6: Starting osmo-msc 22:00:14.242109 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32762): Launched 22:00:14.569065 run osmo-msc_10.42.42.6(pid=32763): Launched 22:00:14.752301 run osmo-stp_10.42.42.5(pid=32760): ERR: Terminated: ERROR {rc=1} [trial-2382↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32760)] 22:00:14.892924 run osmo-stp_10.42.42.5(pid=32760): stdout: | (launched: 2022-12-12_22:00:13.495562) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:00:15.034562 run osmo-stp_10.42.42.5(pid=32760): stderr: | 20221212220013688 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212220013688 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212220013688 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212220013688 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212220013689 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212220013689 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212220013689 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:00:15.173480 run osmo-stp_10.42.42.5(pid=32760): stdout: | (launched: 2022-12-12_22:00:13.495562) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:00:15.304169 run osmo-stp_10.42.42.5(pid=32760): stderr: | 20221212220013688 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212220013688 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212220013688 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212220013688 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212220013689 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212220013689 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212220013689 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:00:15.461014 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=32760): Process ended prematurely: osmo-stp_10.42.42.5(pid=32760) [trial-2382↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32760)] [trial-2382↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18] 22:00:15.470110 tst handover.py:18: Test FAILED (6.8 sec) 22:00:15.497922 run osmo-hlr_10.42.42.2(pid=32757): ERR: Terminated: ERROR {rc=237} [trial-2382↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32757)] 22:00:15.549845 run osmo-hlr_10.42.42.2(pid=32757): stdout: | (launched: 2022-12-12_22:00:12.507247) 22:00:15.602905 run osmo-hlr_10.42.42.2(pid=32757): stderr: | 20221212220012705 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212220012705 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212220012705 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212220012705 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212220012705 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212220012705 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212220012717 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/handover_2G:trx-lms+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212220012725 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212220012725 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212220012725 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:00:15.676443 run osmo-msc_10.42.42.6(pid=32763): ERR: Terminated: ERROR {rc=2} [trial-2382↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32763)] 22:00:15.727568 run osmo-msc_10.42.42.6(pid=32763): stdout: | (launched: 2022-12-12_22:00:14.510139) 22:00:15.780474 run osmo-msc_10.42.42.6(pid=32763): stderr: | 20221212220014832 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212220014832 DLGLOBAL DEBUG validating counter group 0x7efd940d6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212220014832 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212220014832 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212220014832 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212220014833 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212220014834 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212220014835 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212220014835 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212220014835 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:00:15.837533 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32756): Terminating (SIGTERM) 22:00:15.896354 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32759): Terminating (SIGTERM) 22:00:15.953318 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32762): Terminating (SIGTERM) 22:00:15.998747 --- ParallelTerminationStrategy: PID 32756 died... 22:00:16.019506 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32756): Terminated: ok {rc=0} 22:00:16.068331 --- ParallelTerminationStrategy: PID 32759 died... 22:00:16.088942 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32759): Terminated: ok {rc=0} 22:00:16.138182 --- ParallelTerminationStrategy: PID 32762 died... 22:00:16.158874 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32762): Terminated: ok {rc=0} 22:00:16.256723 bus /sierra_3: Setting Powered False 22:00:17.370822 bus /sierra_3: Setting Powered False 22:00:18.488108 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 handover_2G:trx-lms+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 handover_2G:trx-lms+bts1-sysmo --------------------------------------------------------------------- 22:00:19.762932 tst handover_2G:trx-lms+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:00:19.768420 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x bts (candidates: 11) 22:00:19.820641 tst handover_2G:trx-lms+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 22:00:19.848239 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x modem (candidates: 12) 22:00:19.901070 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x bts (candidates: 11) 22:00:19.952551 tst handover_2G:trx-lms+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 22:00:19.979909 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x modem (candidates: 12) 22:00:20.530708 tst handover_2G:trx-lms+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 handover_2G:trx-lms+bts1-sysmo handover.py ---------------------------------------------- 22:00:20.535984 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 22:00:20.547144 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 22:00:20.598318 tst handover.py: using LAC 31794 22:00:20.726094 tst handover.py: using RAC 174 22:00:20.852529 tst handover.py: using CellId 31794 22:00:20.979732 tst handover.py: using BVCI 31795 22:00:21.098822 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 22:00:21.133395 tst handover.py: using LAC 31795 22:00:21.261154 tst handover.py: using RAC 175 22:00:21.388237 tst handover.py: using CellId 31795 22:00:21.515599 tst handover.py: using BVCI 31796 22:00:21.637261 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 22:00:21.648425 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 22:00:21.659513 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 22:00:21.670905 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 22:00:21.682319 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 22:00:21.693631 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 22:00:21.809264 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 22:00:21.929237 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:00:22.410560 run create_hlr_db(pid=300): Launched 22:00:22.535305 bus /sierra_2: Setting Powered False 22:00:23.600389 run create_hlr_db(pid=300): Terminated: ok {rc=0} 22:00:24.027870 run pcap-recorder_any(filters='host 10.42.42.2')(pid=302): Launched 22:00:24.356306 run osmo-hlr_10.42.42.2(pid=303): Launched 22:00:24.482714 run osmo-stp_10.42.42.5: Starting osmo-stp 22:00:25.023043 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=305): Launched 22:00:25.350562 run osmo-stp_10.42.42.5(pid=306): Launched 22:00:25.475704 run osmo-msc_10.42.42.6: Starting osmo-msc 22:00:26.038663 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=308): Launched 22:00:26.365675 run osmo-msc_10.42.42.6(pid=309): Launched 22:00:26.548369 run osmo-stp_10.42.42.5(pid=306): ERR: Terminated: ERROR {rc=1} [trial-2382↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=306)] 22:00:26.686545 run osmo-stp_10.42.42.5(pid=306): stdout: | (launched: 2022-12-12_22:00:25.291705) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:00:26.826271 run osmo-stp_10.42.42.5(pid=306): stderr: | 20221212220025486 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212220025486 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212220025486 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212220025487 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212220025487 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212220025487 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212220025487 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:00:26.964840 run osmo-stp_10.42.42.5(pid=306): stdout: | (launched: 2022-12-12_22:00:25.291705) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:00:27.095847 run osmo-stp_10.42.42.5(pid=306): stderr: | 20221212220025486 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212220025486 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212220025486 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212220025487 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212220025487 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212220025487 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212220025487 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:00:27.252487 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=306): Process ended prematurely: osmo-stp_10.42.42.5(pid=306) [trial-2382↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=306)] [trial-2382↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18] 22:00:27.261507 tst handover.py:18: Test FAILED (6.7 sec) 22:00:27.289838 run osmo-hlr_10.42.42.2(pid=303): ERR: Terminated: ERROR {rc=237} [trial-2382↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=303)] 22:00:27.340796 run osmo-hlr_10.42.42.2(pid=303): stdout: | (launched: 2022-12-12_22:00:24.297050) 22:00:27.393550 run osmo-hlr_10.42.42.2(pid=303): stderr: | 20221212220024498 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212220024498 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212220024498 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212220024499 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212220024499 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212220024499 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212220024510 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/handover_2G:trx-lms+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212220024519 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212220024519 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212220024519 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:00:27.467119 run osmo-msc_10.42.42.6(pid=309): ERR: Terminated: ERROR {rc=2} [trial-2382↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=309)] 22:00:27.518180 run osmo-msc_10.42.42.6(pid=309): stdout: | (launched: 2022-12-12_22:00:26.306814) 22:00:27.570744 run osmo-msc_10.42.42.6(pid=309): stderr: | 20221212220026629 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212220026629 DLGLOBAL DEBUG validating counter group 0x7f30598fcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212220026629 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212220026629 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212220026629 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212220026630 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212220026631 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212220026632 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212220026632 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212220026632 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:00:27.623656 run pcap-recorder_any(filters='host 10.42.42.2')(pid=302): Terminating (SIGTERM) 22:00:27.665644 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=305): Terminating (SIGTERM) 22:00:27.707849 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=308): Terminating (SIGTERM) 22:00:27.750277 --- ParallelTerminationStrategy: PID 302 died... 22:00:27.770331 run pcap-recorder_any(filters='host 10.42.42.2')(pid=302): Terminated: ok {rc=0} 22:00:27.817466 --- ParallelTerminationStrategy: PID 305 died... 22:00:27.837087 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=305): Terminated: ok {rc=0} 22:00:27.884047 --- ParallelTerminationStrategy: PID 308 died... 22:00:27.903743 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=308): Terminated: ok {rc=0} 22:00:27.992647 bus /sierra_3: Setting Powered False 22:00:29.093340 bus /sierra_3: Setting Powered False 22:00:30.213662 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 handover_2G:trx-lms+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 handover_2G:trx-lms+bts1-trx-b200 --------------------------------------------------------------------- 22:00:31.476220 tst handover_2G:trx-lms+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:00:31.482612 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 22:00:31.550438 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 22:00:31.581201 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 22:00:31.639980 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 22:00:31.713528 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 22:00:31.747159 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 22:00:32.278868 tst handover_2G:trx-lms+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 handover_2G:trx-lms+bts1-trx-b200 handover.py ---------------------------------------------- 22:00:32.284278 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 22:00:32.295262 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 22:00:32.342610 tst handover.py: using LAC 31796 22:00:32.464576 tst handover.py: using RAC 176 22:00:32.587154 tst handover.py: using CellId 31796 22:00:32.709419 tst handover.py: using BVCI 31797 22:00:32.820575 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 22:00:32.867718 tst handover.py: using LAC 31797 22:00:32.989274 tst handover.py: using RAC 177 22:00:33.109033 tst handover.py: using CellId 31797 22:00:33.228151 tst handover.py: using BVCI 31798 22:00:33.339469 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 22:00:33.350499 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 22:00:33.361282 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 22:00:33.372393 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 22:00:33.383345 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 22:00:33.394280 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 22:00:33.511164 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 22:00:33.630417 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:00:34.076716 run create_hlr_db(pid=315): Launched 22:00:34.201683 bus /sierra_2: Setting Powered False 22:00:35.262550 run create_hlr_db(pid=315): Terminated: ok {rc=0} 22:00:35.662416 run pcap-recorder_any(filters='host 10.42.42.2')(pid=317): Launched 22:00:35.968262 run osmo-hlr_10.42.42.2(pid=318): Launched 22:00:36.085170 run osmo-stp_10.42.42.5: Starting osmo-stp 22:00:36.585089 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=320): Launched 22:00:36.890930 run osmo-stp_10.42.42.5(pid=321): Launched 22:00:37.007574 run osmo-msc_10.42.42.6: Starting osmo-msc 22:00:37.538268 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=323): Launched 22:00:37.844607 run osmo-msc_10.42.42.6(pid=324): Launched 22:00:38.017910 run osmo-stp_10.42.42.5(pid=321): ERR: Terminated: ERROR {rc=1} [trial-2382↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=321)] 22:00:38.148002 run osmo-stp_10.42.42.5(pid=321): stdout: | (launched: 2022-12-12_22:00:36.835465) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:00:38.277833 run osmo-stp_10.42.42.5(pid=321): stderr: | 20221212220037008 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212220037008 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212220037009 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212220037009 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212220037010 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212220037010 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212220037010 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:00:38.406274 run osmo-stp_10.42.42.5(pid=321): stdout: | (launched: 2022-12-12_22:00:36.835465) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:00:38.529237 run osmo-stp_10.42.42.5(pid=321): stderr: | 20221212220037008 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212220037008 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212220037009 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212220037009 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212220037010 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212220037010 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212220037010 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:00:38.675348 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=321): Process ended prematurely: osmo-stp_10.42.42.5(pid=321) [trial-2382↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=321)] [trial-2382↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18] 22:00:38.683648 tst handover.py:18: Test FAILED (6.4 sec) 22:00:38.710128 run osmo-hlr_10.42.42.2(pid=318): ERR: Terminated: ERROR {rc=237} [trial-2382↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=318)] 22:00:38.759021 run osmo-hlr_10.42.42.2(pid=318): stdout: | (launched: 2022-12-12_22:00:35.912594) 22:00:38.809407 run osmo-hlr_10.42.42.2(pid=318): stderr: | 20221212220036090 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212220036090 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212220036090 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212220036090 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212220036091 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212220036091 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212220036102 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/handover_2G:trx-lms+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212220036111 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212220036112 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212220036112 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:00:38.879551 run osmo-msc_10.42.42.6(pid=324): ERR: Terminated: ERROR {rc=2} [trial-2382↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=324)] 22:00:38.928037 run osmo-msc_10.42.42.6(pid=324): stdout: | (launched: 2022-12-12_22:00:37.788558) 22:00:38.977655 run osmo-msc_10.42.42.6(pid=324): stderr: | 20221212220038064 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212220038064 DLGLOBAL DEBUG validating counter group 0x7ff049f62c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212220038064 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212220038064 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212220038065 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212220038065 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212220038067 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212220038067 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212220038067 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212220038067 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:00:39.027932 run pcap-recorder_any(filters='host 10.42.42.2')(pid=317): Terminating (SIGTERM) 22:00:39.067908 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=320): Terminating (SIGTERM) 22:00:39.108279 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=323): Terminating (SIGTERM) 22:00:39.148510 --- ParallelTerminationStrategy: PID 317 died... 22:00:39.167743 run pcap-recorder_any(filters='host 10.42.42.2')(pid=317): Terminated: ok {rc=0} 22:00:39.212776 --- ParallelTerminationStrategy: PID 320 died... 22:00:39.231839 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=320): Terminated: ok {rc=0} 22:00:39.276555 --- ParallelTerminationStrategy: PID 323 died... 22:00:39.295504 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=323): Terminated: ok {rc=0} 22:00:39.381855 bus /sierra_3: Setting Powered False 22:00:40.482250 bus /sierra_3: Setting Powered False 22:00:41.597537 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 handover_2G:trx-lms+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 handover_2G:trx-lms+bts1-trx-umtrx --------------------------------------------------------------------- 22:00:42.862028 tst handover_2G:trx-lms+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:00:42.867470 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 22:00:42.928309 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 22:00:42.954554 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 22:00:43.006411 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 22:00:43.068424 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 22:00:43.094473 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 22:00:43.646076 tst handover_2G:trx-lms+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 handover_2G:trx-lms+bts1-trx-umtrx handover.py ---------------------------------------------- 22:00:43.652058 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 22:00:43.663792 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 22:00:43.710479 tst handover.py: using LAC 31798 22:00:43.833835 tst handover.py: using RAC 178 22:00:43.952930 tst handover.py: using CellId 31798 22:00:44.070248 tst handover.py: using BVCI 31799 22:00:44.181899 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 22:00:44.227059 tst handover.py: using LAC 31799 22:00:44.347339 tst handover.py: using RAC 179 22:00:44.468897 tst handover.py: using CellId 31799 22:00:44.589187 tst handover.py: using BVCI 31800 22:00:44.701372 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 22:00:44.711997 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 22:00:44.722528 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 22:00:44.733081 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 22:00:44.743621 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 22:00:44.754219 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 22:00:44.873645 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 22:00:44.993103 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:00:45.473560 run create_hlr_db(pid=329): Launched 22:00:45.600880 bus /sierra_2: Setting Powered False 22:00:46.679444 run create_hlr_db(pid=329): Terminated: ok {rc=0} 22:00:47.197685 run pcap-recorder_any(filters='host 10.42.42.2')(pid=331): Launched 22:00:47.537715 run osmo-hlr_10.42.42.2(pid=332): Launched 22:00:47.665462 run osmo-stp_10.42.42.5: Starting osmo-stp 22:00:48.207500 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=334): Launched 22:00:48.534836 run osmo-stp_10.42.42.5(pid=335): Launched 22:00:48.659919 run osmo-msc_10.42.42.6: Starting osmo-msc 22:00:49.222909 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=337): Launched 22:00:49.549126 run osmo-msc_10.42.42.6(pid=338): Launched 22:00:49.731833 run osmo-stp_10.42.42.5(pid=335): ERR: Terminated: ERROR {rc=1} [trial-2382↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=335)] 22:00:49.870873 run osmo-stp_10.42.42.5(pid=335): stdout: | (launched: 2022-12-12_22:00:48.475701) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:00:50.011114 run osmo-stp_10.42.42.5(pid=335): stderr: | 20221212220048670 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212220048670 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212220048670 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212220048671 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212220048671 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212220048671 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212220048671 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:00:50.150688 run osmo-stp_10.42.42.5(pid=335): stdout: | (launched: 2022-12-12_22:00:48.475701) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:00:50.281855 run osmo-stp_10.42.42.5(pid=335): stderr: | 20221212220048670 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212220048670 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212220048670 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212220048671 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212220048671 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212220048671 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212220048671 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:00:50.438411 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=335): Process ended prematurely: osmo-stp_10.42.42.5(pid=335) [trial-2382↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=335)] [trial-2382↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18] 22:00:50.447474 tst handover.py:18: Test FAILED (6.8 sec) 22:00:50.475837 run osmo-hlr_10.42.42.2(pid=332): ERR: Terminated: ERROR {rc=237} [trial-2382↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=332)] 22:00:50.527458 run osmo-hlr_10.42.42.2(pid=332): stdout: | (launched: 2022-12-12_22:00:47.478750) 22:00:50.580560 run osmo-hlr_10.42.42.2(pid=332): stderr: | 20221212220047679 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212220047679 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212220047679 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212220047679 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212220047679 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212220047680 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212220047692 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/handover_2G:trx-lms+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212220047701 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212220047701 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212220047701 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:00:50.654374 run osmo-msc_10.42.42.6(pid=338): ERR: Terminated: ERROR {rc=2} [trial-2382↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=338)] 22:00:50.705273 run osmo-msc_10.42.42.6(pid=338): stdout: | (launched: 2022-12-12_22:00:49.490146) 22:00:50.758094 run osmo-msc_10.42.42.6(pid=338): stderr: | 20221212220049812 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212220049812 DLGLOBAL DEBUG validating counter group 0x7f15e3c39c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212220049813 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212220049813 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212220049813 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212220049813 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212220049815 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212220049815 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212220049815 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212220049815 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:00:50.811390 run pcap-recorder_any(filters='host 10.42.42.2')(pid=331): Terminating (SIGTERM) 22:00:50.853879 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=334): Terminating (SIGTERM) 22:00:50.896659 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=337): Terminating (SIGTERM) 22:00:50.939936 --- ParallelTerminationStrategy: PID 331 died... 22:00:50.960329 run pcap-recorder_any(filters='host 10.42.42.2')(pid=331): Terminated: ok {rc=0} 22:00:51.008470 --- ParallelTerminationStrategy: PID 334 died... 22:00:51.028461 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=334): Terminated: ok {rc=0} 22:00:51.076259 --- ParallelTerminationStrategy: PID 337 died... 22:00:51.096263 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=337): Terminated: ok {rc=0} 22:00:51.187400 bus /sierra_3: Setting Powered False 22:00:52.288480 bus /sierra_3: Setting Powered False 22:00:53.405888 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 handover_2G:trx-lms+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 22:00:54.673297 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:00:54.678407 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 22:00:54.737063 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 22:00:54.763358 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 22:00:54.815436 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 22:00:54.875280 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 22:00:54.901831 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 22:00:55.452623 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 22:00:55.458039 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:00:55.472341 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 22:00:55.523049 tst handover.py: using LAC 31800 22:00:55.654833 tst handover.py: using RAC 180 22:00:55.784355 tst handover.py: using CellId 31800 22:00:55.913147 tst handover.py: using BVCI 31801 22:00:56.032466 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 22:00:56.083449 tst handover.py: using LAC 31801 22:00:56.214350 tst handover.py: using RAC 181 22:00:56.342872 tst handover.py: using CellId 31801 22:00:56.468474 tst handover.py: using BVCI 31802 22:00:56.580759 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:00:56.592300 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:00:56.603820 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:00:56.615052 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:00:56.626242 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:00:56.637297 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 22:00:56.756528 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 22:00:56.874098 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:00:57.321202 run create_hlr_db(pid=343): Launched 22:00:57.445566 bus /sierra_2: Setting Powered False 22:00:58.507704 run create_hlr_db(pid=343): Terminated: ok {rc=0} 22:00:58.906275 run pcap-recorder_any(filters='host 10.42.42.2')(pid=345): Launched 22:00:59.211515 run osmo-hlr_10.42.42.2(pid=347): Launched 22:00:59.328906 run osmo-stp_10.42.42.5: Starting osmo-stp 22:00:59.827204 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=355): Launched 22:01:00.132162 run osmo-stp_10.42.42.5(pid=356): Launched 22:01:00.249112 run osmo-msc_10.42.42.6: Starting osmo-msc 22:01:00.776742 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=359): Launched 22:01:01.138164 run osmo-msc_10.42.42.6(pid=360): Launched 22:01:01.332463 run osmo-stp_10.42.42.5(pid=356): ERR: Terminated: ERROR {rc=1} [trial-2382↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=356)] 22:01:01.520581 run osmo-stp_10.42.42.5(pid=356): stdout: | (launched: 2022-12-12_22:01:00.075984) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:01:01.809751 run osmo-stp_10.42.42.5(pid=356): stderr: | 20221212220100248 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212220100248 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212220100249 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212220100249 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212220100250 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212220100250 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212220100250 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:01:02.007435 run osmo-stp_10.42.42.5(pid=356): stdout: | (launched: 2022-12-12_22:01:00.075984) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:01:02.202876 run osmo-stp_10.42.42.5(pid=356): stderr: | 20221212220100248 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212220100248 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212220100249 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212220100249 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212220100250 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212220100250 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212220100250 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:01:02.350304 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=356): Process ended prematurely: osmo-stp_10.42.42.5(pid=356) [trial-2382↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=356)] [trial-2382↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18] 22:01:02.358761 tst handover.py:18: Test FAILED (6.9 sec) 22:01:02.385709 run osmo-hlr_10.42.42.2(pid=347): ERR: Terminated: ERROR {rc=237} [trial-2382↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=347)] 22:01:02.434802 run osmo-hlr_10.42.42.2(pid=347): stdout: | (launched: 2022-12-12_22:00:59.156104) 22:01:02.485695 run osmo-hlr_10.42.42.2(pid=347): stderr: | 20221212220059334 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212220059334 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212220059334 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212220059334 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212220059334 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212220059334 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212220059346 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212220059354 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212220059355 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212220059355 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:01:02.556163 run osmo-msc_10.42.42.6(pid=360): ERR: Terminated: ERROR {rc=2} [trial-2382↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=360)] 22:01:02.605007 run osmo-msc_10.42.42.6(pid=360): stdout: | (launched: 2022-12-12_22:01:01.067283) 22:01:02.655079 run osmo-msc_10.42.42.6(pid=360): stderr: | 20221212220101812 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212220101812 DLGLOBAL DEBUG validating counter group 0x7f9d5423cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212220101812 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212220101812 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212220101812 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212220101821 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212220101823 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212220101823 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212220101823 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212220101823 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:01:02.705719 run pcap-recorder_any(filters='host 10.42.42.2')(pid=345): Terminating (SIGTERM) 22:01:02.746133 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=355): Terminating (SIGTERM) 22:01:02.786618 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=359): Terminating (SIGTERM) 22:01:02.827373 --- ParallelTerminationStrategy: PID 345 died... 22:01:02.846871 run pcap-recorder_any(filters='host 10.42.42.2')(pid=345): Terminated: ok {rc=0} 22:01:02.891789 --- ParallelTerminationStrategy: PID 355 died... 22:01:02.910991 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=355): Terminated: ok {rc=0} 22:01:02.956380 --- ParallelTerminationStrategy: PID 359 died... 22:01:02.975438 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=359): Terminated: ok {rc=0} 22:01:03.060173 bus /sierra_3: Setting Powered False 22:01:04.159599 bus /sierra_3: Setting Powered False 22:01:05.280298 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 handover_2G:trx-lms-limenet-micro+bts1-sysmo --------------------------------------------------------------------- 22:01:06.548666 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:01:06.553930 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x bts (candidates: 11) 22:01:06.600003 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 22:01:06.626289 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x modem (candidates: 12) 22:01:06.678532 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x bts (candidates: 11) 22:01:06.725716 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 22:01:06.751831 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x modem (candidates: 12) 22:01:07.305298 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover.py ---------------------------------------------- 22:01:07.310642 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 22:01:07.322248 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 22:01:07.369068 tst handover.py: using LAC 31802 22:01:07.497716 tst handover.py: using RAC 182 22:01:07.630133 tst handover.py: using CellId 31802 22:01:07.760145 tst handover.py: using BVCI 31803 22:01:07.881179 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 22:01:07.916915 tst handover.py: using LAC 31803 22:01:08.045664 tst handover.py: using RAC 183 22:01:08.166969 tst handover.py: using CellId 31803 22:01:08.297194 tst handover.py: using BVCI 31804 22:01:08.417170 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 22:01:08.428790 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 22:01:08.440238 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 22:01:08.452177 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 22:01:08.463964 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 22:01:08.475506 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 22:01:08.591244 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 22:01:08.708340 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:01:09.189811 run create_hlr_db(pid=370): Launched 22:01:09.314357 bus /sierra_2: Setting Powered False 22:01:10.379255 run create_hlr_db(pid=370): Terminated: ok {rc=0} 22:01:10.805294 run pcap-recorder_any(filters='host 10.42.42.2')(pid=372): Launched 22:01:11.131573 run osmo-hlr_10.42.42.2(pid=373): Launched 22:01:11.258567 run osmo-stp_10.42.42.5: Starting osmo-stp 22:01:11.798303 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=375): Launched 22:01:12.126159 run osmo-stp_10.42.42.5(pid=376): Launched 22:01:12.252235 run osmo-msc_10.42.42.6: Starting osmo-msc 22:01:12.819128 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=378): Launched 22:01:13.126847 run osmo-msc_10.42.42.6(pid=379): Launched 22:01:13.298120 run osmo-stp_10.42.42.5(pid=376): ERR: Terminated: ERROR {rc=1} [trial-2382↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=376)] 22:01:13.428469 run osmo-stp_10.42.42.5(pid=376): stdout: | (launched: 2022-12-12_22:01:12.066977) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:01:13.557848 run osmo-stp_10.42.42.5(pid=376): stderr: | 20221212220112260 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212220112261 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212220112261 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212220112261 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212220112264 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212220112264 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212220112264 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:01:13.685421 run osmo-stp_10.42.42.5(pid=376): stdout: | (launched: 2022-12-12_22:01:12.066977) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:01:13.808521 run osmo-stp_10.42.42.5(pid=376): stderr: | 20221212220112260 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212220112261 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212220112261 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212220112261 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212220112264 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212220112264 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212220112264 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:01:13.953608 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=376): Process ended prematurely: osmo-stp_10.42.42.5(pid=376) [trial-2382↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=376)] [trial-2382↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18] 22:01:13.961940 tst handover.py:18: Test FAILED (6.6 sec) 22:01:13.988206 run osmo-hlr_10.42.42.2(pid=373): ERR: Terminated: ERROR {rc=237} [trial-2382↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=373)] 22:01:14.036383 run osmo-hlr_10.42.42.2(pid=373): stdout: | (launched: 2022-12-12_22:01:11.072494) 22:01:14.086115 run osmo-hlr_10.42.42.2(pid=373): stderr: | 20221212220111272 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212220111272 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212220111272 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212220111272 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212220111272 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212220111272 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212220111290 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/handover_2G:trx-lms-limenet-micro+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212220111299 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212220111300 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212220111300 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:01:14.155775 run osmo-msc_10.42.42.6(pid=379): ERR: Terminated: ERROR {rc=2} [trial-2382↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=379)] 22:01:14.203858 run osmo-msc_10.42.42.6(pid=379): stdout: | (launched: 2022-12-12_22:01:13.071499) 22:01:14.253505 run osmo-msc_10.42.42.6(pid=379): stderr: | 20221212220113345 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212220113345 DLGLOBAL DEBUG validating counter group 0x7f250c0c4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212220113345 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212220113345 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212220113346 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212220113346 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212220113347 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212220113348 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212220113348 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212220113348 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:01:14.303437 run pcap-recorder_any(filters='host 10.42.42.2')(pid=372): Terminating (SIGTERM) 22:01:14.343114 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=375): Terminating (SIGTERM) 22:01:14.383293 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=378): Terminating (SIGTERM) 22:01:14.423751 --- ParallelTerminationStrategy: PID 372 died... 22:01:14.443158 run pcap-recorder_any(filters='host 10.42.42.2')(pid=372): Terminated: ok {rc=0} 22:01:14.487806 --- ParallelTerminationStrategy: PID 375 died... 22:01:14.506722 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=375): Terminated: ok {rc=0} 22:01:14.551192 --- ParallelTerminationStrategy: PID 378 died... 22:01:14.570150 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=378): Terminated: ok {rc=0} 22:01:14.656318 bus /sierra_3: Setting Powered False 22:01:15.756698 bus /sierra_3: Setting Powered False 22:01:16.872028 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 handover_2G:trx-lms-limenet-micro+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 --------------------------------------------------------------------- 22:01:18.127702 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:01:18.133488 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 22:01:18.194595 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 22:01:18.221716 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 22:01:18.276033 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 22:01:18.336784 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 22:01:18.364330 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 22:01:18.916856 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover.py ---------------------------------------------- 22:01:18.922297 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 22:01:18.933714 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 22:01:18.978760 tst handover.py: using LAC 31804 22:01:19.110181 tst handover.py: using RAC 184 22:01:19.245316 tst handover.py: using CellId 31804 22:01:19.374425 tst handover.py: using BVCI 31805 22:01:19.486654 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 22:01:19.535790 tst handover.py: using LAC 31805 22:01:19.657377 tst handover.py: using RAC 185 22:01:19.776854 tst handover.py: using CellId 31805 22:01:19.895777 tst handover.py: using BVCI 31806 22:01:20.018251 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 22:01:20.029874 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 22:01:20.041381 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 22:01:20.053844 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 22:01:20.066239 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 22:01:20.078492 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 22:01:20.199712 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 22:01:20.317043 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:01:20.766297 run create_hlr_db(pid=385): Launched 22:01:20.892278 bus /sierra_2: Setting Powered False 22:01:21.953748 run create_hlr_db(pid=385): Terminated: ok {rc=0} 22:01:22.355102 run pcap-recorder_any(filters='host 10.42.42.2')(pid=387): Launched 22:01:22.661023 run osmo-hlr_10.42.42.2(pid=388): Launched 22:01:22.778572 run osmo-stp_10.42.42.5: Starting osmo-stp 22:01:23.277901 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=390): Launched 22:01:23.583392 run osmo-stp_10.42.42.5(pid=391): Launched 22:01:23.699989 run osmo-msc_10.42.42.6: Starting osmo-msc 22:01:24.225548 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=393): Launched 22:01:24.532672 run osmo-msc_10.42.42.6(pid=394): Launched 22:01:24.703585 run osmo-stp_10.42.42.5(pid=391): ERR: Terminated: ERROR {rc=1} [trial-2382↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=391)] 22:01:24.833563 run osmo-stp_10.42.42.5(pid=391): stdout: | (launched: 2022-12-12_22:01:23.527500) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:01:24.963159 run osmo-stp_10.42.42.5(pid=391): stderr: | 20221212220123700 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212220123700 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212220123700 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212220123701 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212220123701 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212220123701 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212220123702 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:01:25.091013 run osmo-stp_10.42.42.5(pid=391): stdout: | (launched: 2022-12-12_22:01:23.527500) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:01:25.212225 run osmo-stp_10.42.42.5(pid=391): stderr: | 20221212220123700 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212220123700 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212220123700 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212220123701 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212220123701 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212220123701 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212220123702 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:01:25.357709 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=391): Process ended prematurely: osmo-stp_10.42.42.5(pid=391) [trial-2382↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=391)] [trial-2382↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18] 22:01:25.365917 tst handover.py:18: Test FAILED (6.4 sec) 22:01:25.392006 run osmo-hlr_10.42.42.2(pid=388): ERR: Terminated: ERROR {rc=237} [trial-2382↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=388)] 22:01:25.440027 run osmo-hlr_10.42.42.2(pid=388): stdout: | (launched: 2022-12-12_22:01:22.604746) 22:01:25.490404 run osmo-hlr_10.42.42.2(pid=388): stderr: | 20221212220122782 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212220122782 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212220122782 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212220122782 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212220122782 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212220122782 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212220122796 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/handover_2G:trx-lms-limenet-micro+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212220122806 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212220122806 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212220122806 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:01:25.560376 run osmo-msc_10.42.42.6(pid=394): ERR: Terminated: ERROR {rc=2} [trial-2382↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=394)] 22:01:25.608282 run osmo-msc_10.42.42.6(pid=394): stdout: | (launched: 2022-12-12_22:01:24.476681) 22:01:25.658219 run osmo-msc_10.42.42.6(pid=394): stderr: | 20221212220124750 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212220124750 DLGLOBAL DEBUG validating counter group 0x7f272221cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212220124750 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212220124750 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212220124750 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212220124750 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212220124752 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212220124753 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212220124753 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212220124753 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:01:25.708477 run pcap-recorder_any(filters='host 10.42.42.2')(pid=387): Terminating (SIGTERM) 22:01:25.748717 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=390): Terminating (SIGTERM) 22:01:25.789013 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=393): Terminating (SIGTERM) 22:01:25.829609 --- ParallelTerminationStrategy: PID 387 died... 22:01:25.849118 run pcap-recorder_any(filters='host 10.42.42.2')(pid=387): Terminated: ok {rc=0} 22:01:25.893807 --- ParallelTerminationStrategy: PID 390 died... 22:01:25.912483 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=390): Terminated: ok {rc=0} 22:01:25.957147 --- ParallelTerminationStrategy: PID 393 died... 22:01:25.975925 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=393): Terminated: ok {rc=0} 22:01:26.062605 bus /sierra_3: Setting Powered False 22:01:27.161978 bus /sierra_3: Setting Powered False 22:01:28.277539 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx --------------------------------------------------------------------- 22:01:29.552820 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:01:29.558712 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 22:01:29.618679 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 22:01:29.645676 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 22:01:29.699540 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 22:01:29.759295 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 22:01:29.786453 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 22:01:30.337776 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover.py ---------------------------------------------- 22:01:30.343098 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 22:01:30.354558 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 22:01:30.399983 tst handover.py: using LAC 31806 22:01:30.530998 tst handover.py: using RAC 186 22:01:30.662195 tst handover.py: using CellId 31806 22:01:30.793075 tst handover.py: using BVCI 31807 22:01:30.942121 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 22:01:30.997303 tst handover.py: using LAC 31807 22:01:31.138347 tst handover.py: using RAC 187 22:01:31.296710 tst handover.py: using CellId 31807 22:01:31.430435 tst handover.py: using BVCI 31808 22:01:31.563680 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 22:01:31.575659 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 22:01:31.587525 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 22:01:31.599513 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 22:01:31.610900 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 22:01:31.622140 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 22:01:31.739420 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 22:01:31.862691 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:01:32.371141 run create_hlr_db(pid=399): Launched 22:01:32.497285 bus /sierra_2: Setting Powered False 22:01:33.558966 run create_hlr_db(pid=399): Terminated: ok {rc=0} 22:01:33.958656 run pcap-recorder_any(filters='host 10.42.42.2')(pid=401): Launched 22:01:34.264582 run osmo-hlr_10.42.42.2(pid=402): Launched 22:01:34.381857 run osmo-stp_10.42.42.5: Starting osmo-stp 22:01:34.894748 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=404): Launched 22:01:35.199323 run osmo-stp_10.42.42.5(pid=405): Launched 22:01:35.315862 run osmo-msc_10.42.42.6: Starting osmo-msc 22:01:35.840593 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=407): Launched 22:01:36.144259 run osmo-msc_10.42.42.6(pid=408): Launched 22:01:36.314651 run osmo-stp_10.42.42.5(pid=405): ERR: Terminated: ERROR {rc=1} [trial-2382↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=405)] 22:01:36.443997 run osmo-stp_10.42.42.5(pid=405): stdout: | (launched: 2022-12-12_22:01:35.143532) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:01:36.572810 run osmo-stp_10.42.42.5(pid=405): stderr: | 20221212220135316 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212220135316 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212220135316 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212220135316 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212220135317 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212220135317 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212220135317 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:01:36.699575 run osmo-stp_10.42.42.5(pid=405): stdout: | (launched: 2022-12-12_22:01:35.143532) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:01:36.820153 run osmo-stp_10.42.42.5(pid=405): stderr: | 20221212220135316 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212220135316 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212220135316 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212220135316 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212220135317 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212220135317 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212220135317 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:01:36.964702 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=405): Process ended prematurely: osmo-stp_10.42.42.5(pid=405) [trial-2382↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=405)] [trial-2382↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18] 22:01:36.972863 tst handover.py:18: Test FAILED (6.6 sec) 22:01:36.998916 run osmo-hlr_10.42.42.2(pid=402): ERR: Terminated: ERROR {rc=237} [trial-2382↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=402)] 22:01:37.047035 run osmo-hlr_10.42.42.2(pid=402): stdout: | (launched: 2022-12-12_22:01:34.208248) 22:01:37.096903 run osmo-hlr_10.42.42.2(pid=402): stderr: | 20221212220134386 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212220134386 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212220134386 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212220134386 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212220134386 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212220134386 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212220134398 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212220134407 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212220134407 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212220134407 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:01:37.166694 run osmo-msc_10.42.42.6(pid=408): ERR: Terminated: ERROR {rc=2} [trial-2382↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=408)] 22:01:37.214710 run osmo-msc_10.42.42.6(pid=408): stdout: | (launched: 2022-12-12_22:01:36.088715) 22:01:37.264226 run osmo-msc_10.42.42.6(pid=408): stderr: | 20221212220136364 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212220136364 DLGLOBAL DEBUG validating counter group 0x7f8fa8074c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212220136364 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212220136364 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212220136364 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212220136364 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212220136368 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212220136369 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212220136369 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212220136369 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:01:37.314326 run pcap-recorder_any(filters='host 10.42.42.2')(pid=401): Terminating (SIGTERM) 22:01:37.353999 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=404): Terminating (SIGTERM) 22:01:37.393658 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=407): Terminating (SIGTERM) 22:01:37.433616 --- ParallelTerminationStrategy: PID 401 died... 22:01:37.452772 run pcap-recorder_any(filters='host 10.42.42.2')(pid=401): Terminated: ok {rc=0} 22:01:37.496710 --- ParallelTerminationStrategy: PID 404 died... 22:01:37.515409 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=404): Terminated: ok {rc=0} 22:01:37.559891 --- ParallelTerminationStrategy: PID 407 died... 22:01:37.578801 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=407): Terminated: ok {rc=0} 22:01:37.664321 bus /sierra_3: Setting Powered False 22:01:38.764517 bus /sierra_3: Setting Powered False 22:01:39.880090 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 handover_2G:trx-sysmocell5000+bts1-sysmo --------------------------------------------------------------------- 22:01:41.144105 tst handover_2G:trx-sysmocell5000+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:01:41.149423 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x bts (candidates: 11) 22:01:41.199546 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 22:01:41.225676 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x modem (candidates: 12) 22:01:41.276762 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x bts (candidates: 11) 22:01:41.327324 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 22:01:41.353602 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x modem (candidates: 12) 22:01:41.908230 tst handover_2G:trx-sysmocell5000+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 handover_2G:trx-sysmocell5000+bts1-sysmo handover.py ---------------------------------------------- 22:01:41.913963 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 22:01:41.925581 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 22:01:41.976091 tst handover.py: using LAC 31808 22:01:42.099284 tst handover.py: using RAC 188 22:01:42.221049 tst handover.py: using CellId 31808 22:01:42.343355 tst handover.py: using BVCI 31809 22:01:42.456008 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 22:01:42.493583 tst handover.py: using LAC 31809 22:01:42.614525 tst handover.py: using RAC 189 22:01:42.734451 tst handover.py: using CellId 31809 22:01:42.853508 tst handover.py: using BVCI 31810 22:01:42.964368 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 22:01:42.975437 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 22:01:42.986326 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 22:01:42.997233 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 22:01:43.008140 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 22:01:43.019030 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 22:01:43.138703 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 22:01:43.254874 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:01:43.703905 run create_hlr_db(pid=413): Launched 22:01:43.829284 bus /sierra_2: Setting Powered False 22:01:44.890444 run create_hlr_db(pid=413): Terminated: ok {rc=0} 22:01:45.311333 run pcap-recorder_any(filters='host 10.42.42.2')(pid=415): Launched 22:01:45.641723 run osmo-hlr_10.42.42.2(pid=416): Launched 22:01:45.768802 run osmo-stp_10.42.42.5: Starting osmo-stp 22:01:46.377918 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=418): Launched 22:01:46.718675 run osmo-stp_10.42.42.5(pid=419): Launched 22:01:46.878321 run osmo-msc_10.42.42.6: Starting osmo-msc 22:01:47.587475 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=421): Launched 22:01:47.917464 run osmo-msc_10.42.42.6(pid=422): Launched 22:01:48.102299 run osmo-stp_10.42.42.5(pid=419): ERR: Terminated: ERROR {rc=1} [trial-2382↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=419)] 22:01:48.243198 run osmo-stp_10.42.42.5(pid=419): stdout: | (launched: 2022-12-12_22:01:46.651970) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:01:48.384107 run osmo-stp_10.42.42.5(pid=419): stderr: | 20221212220146988 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212220146988 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212220146988 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212220147000 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212220147001 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212220147001 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212220147001 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:01:48.523794 run osmo-stp_10.42.42.5(pid=419): stdout: | (launched: 2022-12-12_22:01:46.651970) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:01:48.655326 run osmo-stp_10.42.42.5(pid=419): stderr: | 20221212220146988 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212220146988 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212220146988 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212220147000 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212220147001 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212220147001 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212220147001 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:01:48.812646 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=419): Process ended prematurely: osmo-stp_10.42.42.5(pid=419) [trial-2382↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=419)] [trial-2382↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18] 22:01:48.821924 tst handover.py:18: Test FAILED (6.9 sec) 22:01:48.850213 run osmo-hlr_10.42.42.2(pid=416): ERR: Terminated: ERROR {rc=237} [trial-2382↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=416)] 22:01:48.901524 run osmo-hlr_10.42.42.2(pid=416): stdout: | (launched: 2022-12-12_22:01:45.582038) 22:01:48.954742 run osmo-hlr_10.42.42.2(pid=416): stderr: | 20221212220145781 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212220145781 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212220145781 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212220145781 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212220145781 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212220145781 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212220145794 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/handover_2G:trx-sysmocell5000+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212220145802 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212220145803 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212220145803 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:01:49.028283 run osmo-msc_10.42.42.6(pid=422): ERR: Terminated: ERROR {rc=2} [trial-2382↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=422)] 22:01:49.079254 run osmo-msc_10.42.42.6(pid=422): stdout: | (launched: 2022-12-12_22:01:47.857626) 22:01:49.131968 run osmo-msc_10.42.42.6(pid=422): stderr: | 20221212220148182 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212220148182 DLGLOBAL DEBUG validating counter group 0x7fa3e62d4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212220148182 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212220148183 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212220148183 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212220148183 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212220148185 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212220148185 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212220148185 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212220148185 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:01:49.185558 run pcap-recorder_any(filters='host 10.42.42.2')(pid=415): Terminating (SIGTERM) 22:01:49.228423 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=418): Terminating (SIGTERM) 22:01:49.271121 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=421): Terminating (SIGTERM) 22:01:49.313709 --- ParallelTerminationStrategy: PID 415 died... 22:01:49.334101 run pcap-recorder_any(filters='host 10.42.42.2')(pid=415): Terminated: ok {rc=0} 22:01:49.381559 --- ParallelTerminationStrategy: PID 418 died... 22:01:49.401468 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=418): Terminated: ok {rc=0} 22:01:49.448624 --- ParallelTerminationStrategy: PID 421 died... 22:01:49.468586 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=421): Terminated: ok {rc=0} 22:01:49.558321 bus /sierra_3: Setting Powered False 22:01:50.660246 bus /sierra_3: Setting Powered False 22:01:51.777945 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 handover_2G:trx-sysmocell5000+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 handover_2G:trx-sysmocell5000+bts1-trx-b200 --------------------------------------------------------------------- 22:01:53.030851 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:01:53.036238 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 22:01:53.098637 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 22:01:53.125116 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 22:01:53.176510 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 22:01:53.242026 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 22:01:53.268146 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 22:01:53.817826 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 handover_2G:trx-sysmocell5000+bts1-trx-b200 handover.py ---------------------------------------------- 22:01:53.824314 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 22:01:53.836763 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 22:01:53.888350 tst handover.py: using LAC 31810 22:01:54.018378 tst handover.py: using RAC 190 22:01:54.146750 tst handover.py: using CellId 31810 22:01:54.276743 tst handover.py: using BVCI 31811 22:01:54.397952 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 22:01:54.447176 tst handover.py: using LAC 31811 22:01:54.577426 tst handover.py: using RAC 191 22:01:54.699716 tst handover.py: using CellId 31811 22:01:54.823208 tst handover.py: using BVCI 31812 22:01:54.937289 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 22:01:54.948285 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 22:01:54.959130 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 22:01:54.970109 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 22:01:54.980903 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 22:01:54.991741 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 22:01:55.110208 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 22:01:55.227624 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:01:55.676690 run create_hlr_db(pid=428): Launched 22:01:55.801655 bus /sierra_2: Setting Powered False 22:01:56.863769 run create_hlr_db(pid=428): Terminated: ok {rc=0} 22:01:57.283657 run pcap-recorder_any(filters='host 10.42.42.2')(pid=430): Launched 22:01:57.611391 run osmo-hlr_10.42.42.2(pid=431): Launched 22:01:57.738584 run osmo-stp_10.42.42.5: Starting osmo-stp 22:01:58.278971 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=433): Launched 22:01:58.608074 run osmo-stp_10.42.42.5(pid=434): Launched 22:01:58.734025 run osmo-msc_10.42.42.6: Starting osmo-msc 22:01:59.299468 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=436): Launched 22:01:59.627728 run osmo-msc_10.42.42.6(pid=437): Launched 22:01:59.812388 run osmo-stp_10.42.42.5(pid=434): ERR: Terminated: ERROR {rc=1} [trial-2382↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=434)] 22:01:59.952229 run osmo-stp_10.42.42.5(pid=434): stdout: | (launched: 2022-12-12_22:01:58.548695) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:02:00.092845 run osmo-stp_10.42.42.5(pid=434): stderr: | 20221212220158742 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212220158743 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212220158743 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212220158743 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212220158744 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212220158744 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212220158744 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:02:00.231334 run osmo-stp_10.42.42.5(pid=434): stdout: | (launched: 2022-12-12_22:01:58.548695) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:02:00.362214 run osmo-stp_10.42.42.5(pid=434): stderr: | 20221212220158742 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212220158743 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212220158743 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212220158743 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212220158744 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212220158744 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212220158744 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:02:00.519074 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=434): Process ended prematurely: osmo-stp_10.42.42.5(pid=434) [trial-2382↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=434)] [trial-2382↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18] 22:02:00.528109 tst handover.py:18: Test FAILED (6.7 sec) 22:02:00.556025 run osmo-hlr_10.42.42.2(pid=431): ERR: Terminated: ERROR {rc=237} [trial-2382↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=431)] 22:02:00.607418 run osmo-hlr_10.42.42.2(pid=431): stdout: | (launched: 2022-12-12_22:01:57.552149) 22:02:00.659887 run osmo-hlr_10.42.42.2(pid=431): stderr: | 20221212220157752 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212220157752 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212220157752 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212220157752 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212220157752 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212220157752 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212220157765 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/handover_2G:trx-sysmocell5000+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212220157774 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212220157774 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212220157774 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:02:00.733037 run osmo-msc_10.42.42.6(pid=437): ERR: Terminated: ERROR {rc=2} [trial-2382↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=437)] 22:02:00.783543 run osmo-msc_10.42.42.6(pid=437): stdout: | (launched: 2022-12-12_22:01:59.568268) 22:02:00.836078 run osmo-msc_10.42.42.6(pid=437): stderr: | 20221212220159892 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212220159892 DLGLOBAL DEBUG validating counter group 0x7f5d838f3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212220159892 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212220159892 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212220159892 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212220159892 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212220159894 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212220159894 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212220159895 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212220159895 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:02:00.894460 run pcap-recorder_any(filters='host 10.42.42.2')(pid=430): Terminating (SIGTERM) 22:02:00.948753 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=433): Terminating (SIGTERM) 22:02:00.992104 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=436): Terminating (SIGTERM) 22:02:01.035418 --- ParallelTerminationStrategy: PID 430 died... 22:02:01.056534 run pcap-recorder_any(filters='host 10.42.42.2')(pid=430): Terminated: ok {rc=0} 22:02:01.105129 --- ParallelTerminationStrategy: PID 433 died... 22:02:01.125361 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=433): Terminated: ok {rc=0} 22:02:01.174077 --- ParallelTerminationStrategy: PID 436 died... 22:02:01.194403 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=436): Terminated: ok {rc=0} 22:02:01.285497 bus /sierra_3: Setting Powered False 22:02:02.383172 bus /sierra_3: Setting Powered False 22:02:03.500072 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 handover_2G:trx-sysmocell5000+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 handover_2G:trx-sysmocell5000+bts1-trx-umtrx --------------------------------------------------------------------- 22:02:04.776777 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:02:04.781921 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 22:02:04.844081 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 22:02:04.870564 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 22:02:04.920463 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 22:02:04.983286 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 22:02:05.009808 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 22:02:05.562274 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover.py ---------------------------------------------- 22:02:05.567700 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 22:02:05.579145 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 22:02:05.627261 tst handover.py: using LAC 31812 22:02:05.751616 tst handover.py: using RAC 192 22:02:05.872232 tst handover.py: using CellId 31812 22:02:05.991722 tst handover.py: using BVCI 31813 22:02:06.113334 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 22:02:06.163616 tst handover.py: using LAC 31813 22:02:06.294089 tst handover.py: using RAC 193 22:02:06.422971 tst handover.py: using CellId 31813 22:02:06.550145 tst handover.py: using BVCI 31814 22:02:06.670164 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 22:02:06.681677 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 22:02:06.692801 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 22:02:06.704618 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 22:02:06.716372 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 22:02:06.728210 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 22:02:06.845204 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 22:02:06.962790 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:02:07.410215 run create_hlr_db(pid=442): Launched 22:02:07.540378 bus /sierra_2: Setting Powered False 22:02:08.606031 run create_hlr_db(pid=442): Terminated: ok {rc=0} 22:02:09.032846 run pcap-recorder_any(filters='host 10.42.42.2')(pid=444): Launched 22:02:09.361650 run osmo-hlr_10.42.42.2(pid=445): Launched 22:02:09.487697 run osmo-stp_10.42.42.5: Starting osmo-stp 22:02:10.029365 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=447): Launched 22:02:10.359814 run osmo-stp_10.42.42.5(pid=448): Launched 22:02:10.485791 run osmo-msc_10.42.42.6: Starting osmo-msc 22:02:11.050935 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=450): Launched 22:02:11.379812 run osmo-msc_10.42.42.6(pid=451): Launched 22:02:11.563789 run osmo-stp_10.42.42.5(pid=448): ERR: Terminated: ERROR {rc=1} [trial-2382↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=448)] 22:02:11.703098 run osmo-stp_10.42.42.5(pid=448): stdout: | (launched: 2022-12-12_22:02:10.299985) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:02:11.842995 run osmo-stp_10.42.42.5(pid=448): stderr: | 20221212220210493 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212220210493 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212220210493 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212220210493 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212220210496 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212220210496 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212220210496 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:02:11.982111 run osmo-stp_10.42.42.5(pid=448): stdout: | (launched: 2022-12-12_22:02:10.299985) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:02:12.113124 run osmo-stp_10.42.42.5(pid=448): stderr: | 20221212220210493 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212220210493 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212220210493 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212220210493 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212220210496 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212220210496 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212220210496 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:02:12.269986 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=448): Process ended prematurely: osmo-stp_10.42.42.5(pid=448) [trial-2382↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=448)] [trial-2382↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18] 22:02:12.278838 tst handover.py:18: Test FAILED (6.7 sec) 22:02:12.306650 run osmo-hlr_10.42.42.2(pid=445): ERR: Terminated: ERROR {rc=237} [trial-2382↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=445)] 22:02:12.357583 run osmo-hlr_10.42.42.2(pid=445): stdout: | (launched: 2022-12-12_22:02:09.302108) 22:02:12.410765 run osmo-hlr_10.42.42.2(pid=445): stderr: | 20221212220209501 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212220209501 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212220209501 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212220209501 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212220209501 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212220209501 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212220209516 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/handover_2G:trx-sysmocell5000+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212220209526 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212220209526 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212220209526 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:02:12.484037 run osmo-msc_10.42.42.6(pid=451): ERR: Terminated: ERROR {rc=2} [trial-2382↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=451)] 22:02:12.534690 run osmo-msc_10.42.42.6(pid=451): stdout: | (launched: 2022-12-12_22:02:11.320613) 22:02:12.586995 run osmo-msc_10.42.42.6(pid=451): stderr: | 20221212220211641 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212220211641 DLGLOBAL DEBUG validating counter group 0x7f1a4b488c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212220211641 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212220211641 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212220211642 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212220211642 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212220211645 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212220211646 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212220211646 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212220211646 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:02:12.639753 run pcap-recorder_any(filters='host 10.42.42.2')(pid=444): Terminating (SIGTERM) 22:02:12.681694 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=447): Terminating (SIGTERM) 22:02:12.723961 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=450): Terminating (SIGTERM) 22:02:12.766822 --- ParallelTerminationStrategy: PID 444 died... 22:02:12.787198 run pcap-recorder_any(filters='host 10.42.42.2')(pid=444): Terminated: ok {rc=0} 22:02:12.834639 --- ParallelTerminationStrategy: PID 447 died... 22:02:12.854554 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=447): Terminated: ok {rc=0} 22:02:12.901931 --- ParallelTerminationStrategy: PID 450 died... 22:02:12.921715 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=450): Terminated: ok {rc=0} 22:02:13.009757 bus /sierra_3: Setting Powered False 22:02:14.111587 bus /sierra_3: Setting Powered False 22:02:15.228772 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 handover_2G:trx-sysmocell5000+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 handover_2G:sysmo+bts1-trx-b200 --------------------------------------------------------------------- 22:02:16.505283 tst handover_2G:sysmo+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:02:16.510376 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 22:02:16.562671 tst handover_2G:sysmo+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 22:02:16.591431 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 22:02:16.646595 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 22:02:16.707824 tst handover_2G:sysmo+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 22:02:16.741218 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 22:02:17.287375 tst handover_2G:sysmo+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 handover_2G:sysmo+bts1-trx-b200 handover.py ---------------------------------------------- 22:02:17.294311 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 22:02:17.307012 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 22:02:17.342473 tst handover.py: using LAC 31814 22:02:17.470820 tst handover.py: using RAC 194 22:02:17.601352 tst handover.py: using CellId 31814 22:02:17.734651 tst handover.py: using BVCI 31815 22:02:17.857058 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 22:02:17.904865 tst handover.py: using LAC 31815 22:02:18.032287 tst handover.py: using RAC 195 22:02:18.159514 tst handover.py: using CellId 31815 22:02:18.288322 tst handover.py: using BVCI 31816 22:02:18.407828 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 22:02:18.419262 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 22:02:18.430630 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 22:02:18.442251 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 22:02:18.453851 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 22:02:18.465384 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 22:02:18.582406 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 22:02:18.698184 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:02:19.146158 run create_hlr_db(pid=456): Launched 22:02:19.271755 bus /sierra_2: Setting Powered False 22:02:20.334502 run create_hlr_db(pid=456): Terminated: ok {rc=0} 22:02:20.754121 run pcap-recorder_any(filters='host 10.42.42.2')(pid=458): Launched 22:02:21.083502 run osmo-hlr_10.42.42.2(pid=459): Launched 22:02:21.210354 run osmo-stp_10.42.42.5: Starting osmo-stp 22:02:21.751465 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=461): Launched 22:02:22.080086 run osmo-stp_10.42.42.5(pid=462): Launched 22:02:22.206856 run osmo-msc_10.42.42.6: Starting osmo-msc 22:02:22.773277 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=464): Launched 22:02:23.101371 run osmo-msc_10.42.42.6(pid=465): Launched 22:02:23.287225 run osmo-stp_10.42.42.5(pid=462): ERR: Terminated: ERROR {rc=1} [trial-2382↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=462)] 22:02:23.427469 run osmo-stp_10.42.42.5(pid=462): stdout: | (launched: 2022-12-12_22:02:22.020630) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:02:23.568232 run osmo-stp_10.42.42.5(pid=462): stderr: | 20221212220222214 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212220222214 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212220222214 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212220222215 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212220222215 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212220222215 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212220222215 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:02:23.707205 run osmo-stp_10.42.42.5(pid=462): stdout: | (launched: 2022-12-12_22:02:22.020630) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:02:23.839208 run osmo-stp_10.42.42.5(pid=462): stderr: | 20221212220222214 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212220222214 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212220222214 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212220222215 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212220222215 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212220222215 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212220222215 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:02:23.996814 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=462): Process ended prematurely: osmo-stp_10.42.42.5(pid=462) [trial-2382↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=462)] [trial-2382↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18] 22:02:24.005914 tst handover.py:18: Test FAILED (6.7 sec) 22:02:24.034536 run osmo-hlr_10.42.42.2(pid=459): ERR: Terminated: ERROR {rc=237} [trial-2382↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=459)] 22:02:24.085507 run osmo-hlr_10.42.42.2(pid=459): stdout: | (launched: 2022-12-12_22:02:21.023994) 22:02:24.138261 run osmo-hlr_10.42.42.2(pid=459): stderr: | 20221212220221225 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212220221225 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212220221225 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212220221225 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212220221225 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212220221225 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212220221238 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/handover_2G:sysmo+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212220221247 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212220221247 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212220221247 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:02:24.212148 run osmo-msc_10.42.42.6(pid=465): ERR: Terminated: ERROR {rc=2} [trial-2382↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=465)] 22:02:24.263254 run osmo-msc_10.42.42.6(pid=465): stdout: | (launched: 2022-12-12_22:02:23.041865) 22:02:24.315834 run osmo-msc_10.42.42.6(pid=465): stderr: | 20221212220223365 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212220223365 DLGLOBAL DEBUG validating counter group 0x7ff2e3971c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212220223365 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212220223365 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212220223365 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212220223366 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212220223368 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212220223369 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212220223369 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212220223369 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:02:24.369125 run pcap-recorder_any(filters='host 10.42.42.2')(pid=458): Terminating (SIGTERM) 22:02:24.411283 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=461): Terminating (SIGTERM) 22:02:24.453827 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=464): Terminating (SIGTERM) 22:02:24.496837 --- ParallelTerminationStrategy: PID 458 died... 22:02:24.517201 run pcap-recorder_any(filters='host 10.42.42.2')(pid=458): Terminated: ok {rc=0} 22:02:24.564917 --- ParallelTerminationStrategy: PID 461 died... 22:02:24.584899 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=461): Terminated: ok {rc=0} 22:02:24.632591 --- ParallelTerminationStrategy: PID 464 died... 22:02:24.652503 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=464): Terminated: ok {rc=0} 22:02:24.741050 bus /sierra_3: Setting Powered False 22:02:25.841062 bus /sierra_3: Setting Powered False 22:02:26.956729 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 handover_2G:sysmo+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 handover_2G:sysmo+bts1-trx-umtrx --------------------------------------------------------------------- 22:02:28.214679 tst handover_2G:sysmo+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:02:28.220280 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 22:02:28.271868 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 22:02:28.299242 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 22:02:28.351549 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 22:02:28.402682 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 22:02:28.430053 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 22:02:28.980914 tst handover_2G:sysmo+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 handover_2G:sysmo+bts1-trx-umtrx handover.py ---------------------------------------------- 22:02:28.986300 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 22:02:28.997576 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 22:02:29.033372 tst handover.py: using LAC 31816 22:02:29.155586 tst handover.py: using RAC 196 22:02:29.279515 tst handover.py: using CellId 31816 22:02:29.401846 tst handover.py: using BVCI 31817 22:02:29.523628 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 22:02:29.572357 tst handover.py: using LAC 31817 22:02:29.696147 tst handover.py: using RAC 197 22:02:29.826844 tst handover.py: using CellId 31817 22:02:29.956783 tst handover.py: using BVCI 31818 22:02:30.079204 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 22:02:30.090699 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 22:02:30.101785 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 22:02:30.113071 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 22:02:30.124498 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 22:02:30.135845 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 22:02:30.257942 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 22:02:30.377486 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:02:30.866329 run create_hlr_db(pid=470): Launched 22:02:31.014659 bus /sierra_2: Setting Powered False 22:02:32.075464 run create_hlr_db(pid=470): Terminated: ok {rc=0} 22:02:32.484245 run pcap-recorder_any(filters='host 10.42.42.2')(pid=472): Launched 22:02:32.791254 run osmo-hlr_10.42.42.2(pid=473): Launched 22:02:32.908815 run osmo-stp_10.42.42.5: Starting osmo-stp 22:02:33.407894 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=475): Launched 22:02:33.713075 run osmo-stp_10.42.42.5(pid=476): Launched 22:02:33.829970 run osmo-msc_10.42.42.6: Starting osmo-msc 22:02:34.356756 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=478): Launched 22:02:34.662494 run osmo-msc_10.42.42.6(pid=479): Launched 22:02:34.833469 run osmo-stp_10.42.42.5(pid=476): ERR: Terminated: ERROR {rc=1} [trial-2382↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=476)] 22:02:34.962909 run osmo-stp_10.42.42.5(pid=476): stdout: | (launched: 2022-12-12_22:02:33.657103) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:02:35.092827 run osmo-stp_10.42.42.5(pid=476): stderr: | 20221212220233830 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212220233830 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212220233830 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212220233830 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212220233831 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212220233831 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212220233831 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:02:35.220766 run osmo-stp_10.42.42.5(pid=476): stdout: | (launched: 2022-12-12_22:02:33.657103) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:02:35.342372 run osmo-stp_10.42.42.5(pid=476): stderr: | 20221212220233830 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212220233830 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212220233830 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212220233830 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212220233831 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212220233831 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212220233831 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:02:35.487973 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=476): Process ended prematurely: osmo-stp_10.42.42.5(pid=476) [trial-2382↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=476)] [trial-2382↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18] 22:02:35.496372 tst handover.py:18: Test FAILED (6.5 sec) 22:02:35.522729 run osmo-hlr_10.42.42.2(pid=473): ERR: Terminated: ERROR {rc=237} [trial-2382↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=473)] 22:02:35.571255 run osmo-hlr_10.42.42.2(pid=473): stdout: | (launched: 2022-12-12_22:02:32.735766) 22:02:35.621410 run osmo-hlr_10.42.42.2(pid=473): stderr: | 20221212220232912 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212220232912 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212220232912 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212220232912 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212220232912 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212220232912 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212220232925 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/handover_2G:sysmo+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212220232934 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212220232934 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212220232934 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:02:35.691438 run osmo-msc_10.42.42.6(pid=479): ERR: Terminated: ERROR {rc=2} [trial-2382↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=479)] 22:02:35.739945 run osmo-msc_10.42.42.6(pid=479): stdout: | (launched: 2022-12-12_22:02:34.606793) 22:02:35.790164 run osmo-msc_10.42.42.6(pid=479): stderr: | 20221212220234880 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212220234880 DLGLOBAL DEBUG validating counter group 0x7fce98acbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212220234881 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212220234881 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212220234881 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212220234881 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212220234883 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212220234883 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212220234883 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212220234883 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:02:35.840557 run pcap-recorder_any(filters='host 10.42.42.2')(pid=472): Terminating (SIGTERM) 22:02:35.880788 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=475): Terminating (SIGTERM) 22:02:35.921281 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=478): Terminating (SIGTERM) 22:02:35.961937 --- ParallelTerminationStrategy: PID 472 died... 22:02:35.981529 run pcap-recorder_any(filters='host 10.42.42.2')(pid=472): Terminated: ok {rc=0} 22:02:36.027036 --- ParallelTerminationStrategy: PID 475 died... 22:02:36.046372 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=475): Terminated: ok {rc=0} 22:02:36.091167 --- ParallelTerminationStrategy: PID 478 died... 22:02:36.110319 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=478): Terminated: ok {rc=0} 22:02:36.194732 bus /sierra_3: Setting Powered False 22:02:37.290893 bus /sierra_3: Setting Powered False 22:02:38.406715 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 handover_2G:sysmo+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2382 handover_2G:trx-b200+bts1-trx-umtrx --------------------------------------------------------------------- 22:02:39.668537 tst handover_2G:trx-b200+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:02:39.674358 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 22:02:39.738083 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 22:02:39.765490 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 22:02:39.819537 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 22:02:39.883539 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 22:02:39.910785 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 22:02:40.460066 tst handover_2G:trx-b200+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts Ettus B200 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2382 handover_2G:trx-b200+bts1-trx-umtrx handover.py ---------------------------------------------- 22:02:40.465580 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 22:02:40.476776 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 22:02:40.529762 tst handover.py: using LAC 31818 22:02:40.658131 tst handover.py: using RAC 198 22:02:40.785478 tst handover.py: using CellId 31818 22:02:40.914962 tst handover.py: using BVCI 31819 22:02:41.036125 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 22:02:41.083071 tst handover.py: using LAC 31819 22:02:41.210367 tst handover.py: using RAC 199 22:02:41.337380 tst handover.py: using CellId 31819 22:02:41.464503 tst handover.py: using BVCI 31820 22:02:41.583911 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 22:02:41.595248 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 22:02:41.606395 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 22:02:41.617905 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 22:02:41.629533 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 22:02:41.640823 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 22:02:41.760367 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 22:02:41.880853 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:02:42.329611 run create_hlr_db(pid=484): Launched 22:02:42.456138 bus /sierra_2: Setting Powered False 22:02:43.517771 run create_hlr_db(pid=484): Terminated: ok {rc=0} 22:02:43.936026 run pcap-recorder_any(filters='host 10.42.42.2')(pid=486): Launched 22:02:44.266593 run osmo-hlr_10.42.42.2(pid=487): Launched 22:02:44.393090 run osmo-stp_10.42.42.5: Starting osmo-stp 22:02:44.930862 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=489): Launched 22:02:45.259937 run osmo-stp_10.42.42.5(pid=490): Launched 22:02:45.385755 run osmo-msc_10.42.42.6: Starting osmo-msc 22:02:45.973734 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=492): Launched 22:02:46.339758 run osmo-msc_10.42.42.6(pid=493): Launched 22:02:46.743862 run osmo-stp_10.42.42.5(pid=490): ERR: Terminated: ERROR {rc=1} [trial-2382↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=490)] 22:02:46.980103 run osmo-stp_10.42.42.5(pid=490): stdout: | (launched: 2022-12-12_22:02:45.199694) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:02:47.120915 run osmo-stp_10.42.42.5(pid=490): stderr: | 20221212220245394 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212220245394 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212220245394 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212220245395 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212220245395 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212220245395 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212220245395 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:02:47.262295 run osmo-stp_10.42.42.5(pid=490): stdout: | (launched: 2022-12-12_22:02:45.199694) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:02:47.396305 run osmo-stp_10.42.42.5(pid=490): stderr: | 20221212220245394 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212220245394 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212220245394 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212220245395 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212220245395 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212220245395 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212220245395 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:02:47.553859 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=490): Process ended prematurely: osmo-stp_10.42.42.5(pid=490) [trial-2382↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=490)] [trial-2382↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18] 22:02:47.562668 tst handover.py:18: Test FAILED (7.1 sec) 22:02:47.591358 run osmo-hlr_10.42.42.2(pid=487): ERR: Terminated: ERROR {rc=237} [trial-2382↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=487)] 22:02:47.642875 run osmo-hlr_10.42.42.2(pid=487): stdout: | (launched: 2022-12-12_22:02:44.207048) 22:02:47.696117 run osmo-hlr_10.42.42.2(pid=487): stderr: | 20221212220244406 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212220244406 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212220244406 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212220244406 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212220244406 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212220244406 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212220244419 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/handover_2G:trx-b200+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212220244427 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212220244427 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212220244427 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:02:47.770290 run osmo-msc_10.42.42.6(pid=493): ERR: Terminated: ERROR {rc=2} [trial-2382↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=493)] 22:02:47.821807 run osmo-msc_10.42.42.6(pid=493): stdout: | (launched: 2022-12-12_22:02:46.275134) 22:02:47.874908 run osmo-msc_10.42.42.6(pid=493): stderr: | 20221212220246708 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212220246708 DLGLOBAL DEBUG validating counter group 0x7f6047d11c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212220246708 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212220246709 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212220246710 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212220246710 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212220246716 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212220246718 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212220246718 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212220246718 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:02:47.928577 run pcap-recorder_any(filters='host 10.42.42.2')(pid=486): Terminating (SIGTERM) 22:02:47.971488 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=489): Terminating (SIGTERM) 22:02:48.014402 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=492): Terminating (SIGTERM) 22:02:48.057481 --- ParallelTerminationStrategy: PID 486 died... 22:02:48.078062 run pcap-recorder_any(filters='host 10.42.42.2')(pid=486): Terminated: ok {rc=0} 22:02:48.126605 --- ParallelTerminationStrategy: PID 489 died... 22:02:48.146795 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=489): Terminated: ok {rc=0} 22:02:48.195558 --- ParallelTerminationStrategy: PID 492 died... 22:02:48.215630 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=492): Terminated: ok {rc=0} 22:02:48.305873 bus /sierra_3: Setting Powered False 22:02:49.406033 bus /sierra_3: Setting Powered False 22:02:50.525921 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2382 handover_2G:trx-b200+bts1-trx-umtrx FAIL --------------------------------------------------------------------- 22:02:51.799549 tst trial-2382: Storing JUnit report in /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382/run.2022-12-12_20-36-34/trial-2382.xml -------------------------------------------------------------------------------------------- trial-2382 FAIL -------------------------------------------------------------------------------------------- 22:02:53.750293 tst trial-2382: trial-2382: FAIL, 200 suites failed FAIL: nitb_sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (5.1 sec) Error: osmo-nitb_10.42.42.2(pid=24873): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24873) [trial-2382↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24873)] FAIL: sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (15.7 sec) Error: osmo-stp_10.42.42.5(pid=25156): Process ended prematurely: osmo-stp_10.42.42.5(pid=25156) [trial-2382↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25156)] FAIL: nitb_ussd:sysmo (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=25166): Process ended prematurely: osmo-nitb_10.42.42.2(pid=25166) [trial-2382↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25166)] FAIL: ussd:sysmo (fail: 1) FAIL: assert_extension.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=25176): Process ended prematurely: osmo-stp_10.42.42.5(pid=25176) [trial-2382↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25176)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=25192): Process ended prematurely: osmo-stp_10.42.42.5(pid=25192) [trial-2382↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25192)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=25203): Process ended prematurely: osmo-stp_10.42.42.5(pid=25203) [trial-2382↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25203)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=25217): Process ended prematurely: osmo-stp_10.42.42.5(pid=25217) [trial-2382↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25217)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=25231): Process ended prematurely: osmo-stp_10.42.42.5(pid=25231) [trial-2382↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25231)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=25245): Process ended prematurely: osmo-stp_10.42.42.5(pid=25245) [trial-2382↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25245)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=25256): Process ended prematurely: osmo-stp_10.42.42.5(pid=25256) [trial-2382↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25256)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=25271): Process ended prematurely: osmo-stp_10.42.42.5(pid=25271) [trial-2382↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25271)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=25282): Process ended prematurely: osmo-stp_10.42.42.5(pid=25282) [trial-2382↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25282)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=25296): Process ended prematurely: osmo-stp_10.42.42.5(pid=25296) [trial-2382↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25296)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=25307): Process ended prematurely: osmo-stp_10.42.42.5(pid=25307) [trial-2382↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25307)] FAIL: voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=25321): Process ended prematurely: osmo-stp_10.42.42.5(pid=25321) [trial-2382↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25321)] FAIL: mo_mt_call_osmux.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=25332): Process ended prematurely: osmo-stp_10.42.42.5(pid=25332) [trial-2382↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25332)] FAIL: voice:sysmo+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=25346): Process ended prematurely: osmo-stp_10.42.42.5(pid=25346) [trial-2382↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25346)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=25357): Process ended prematurely: osmo-stp_10.42.42.5(pid=25357) [trial-2382↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25357)] FAIL: emergency:sysmo (fail: 2) FAIL: emergency_mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=25382): Process ended prematurely: osmo-stp_10.42.42.5(pid=25382) [trial-2382↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25382)] FAIL: emergency_preemptive_call.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=25393): Process ended prematurely: osmo-stp_10.42.42.5(pid=25393) [trial-2382↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25393)] FAIL: gprs:sysmo (fail: 5) FAIL: cs_paging_gprs_active.py (10.2 sec) Error: osmo-stp_10.42.42.5(pid=25411): Process ended prematurely: osmo-stp_10.42.42.5(pid=25411) [trial-2382↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25411)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=25423): Process ended prematurely: osmo-stp_10.42.42.5(pid=25423) [trial-2382↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25423)] FAIL: iperf3m4.py (11.3 sec) Error: osmo-stp_10.42.42.5(pid=25441): Process ended prematurely: osmo-stp_10.42.42.5(pid=25441) [trial-2382↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25441)] FAIL: ping.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=25451): Process ended prematurely: osmo-stp_10.42.42.5(pid=25451) [trial-2382↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25451)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=25470): Process ended prematurely: osmo-stp_10.42.42.5(pid=25470) [trial-2382↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25470)] FAIL: gprs:sysmo+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (9.3 sec) Error: osmo-stp_10.42.42.5(pid=25487): Process ended prematurely: osmo-stp_10.42.42.5(pid=25487) [trial-2382↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25487)] FAIL: iperf3.py (8.2 sec) Error: osmo-stp_10.42.42.5(pid=25500): Process ended prematurely: osmo-stp_10.42.42.5(pid=25500) [trial-2382↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25500)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=25518): Process ended prematurely: osmo-stp_10.42.42.5(pid=25518) [trial-2382↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25518)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=25529): Process ended prematurely: osmo-stp_10.42.42.5(pid=25529) [trial-2382↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25529)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=25539): Process ended prematurely: osmo-stp_10.42.42.5(pid=25539) [trial-2382↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25539)] FAIL: gprs:sysmo+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (9.1 sec) Error: osmo-stp_10.42.42.5(pid=25559): Process ended prematurely: osmo-stp_10.42.42.5(pid=25559) [trial-2382↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25559)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=25571): Process ended prematurely: osmo-stp_10.42.42.5(pid=25571) [trial-2382↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25571)] FAIL: iperf3m4.py (11.6 sec) Error: osmo-stp_10.42.42.5(pid=25592): Process ended prematurely: osmo-stp_10.42.42.5(pid=25592) [trial-2382↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25592)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=25602): Process ended prematurely: osmo-stp_10.42.42.5(pid=25602) [trial-2382↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25602)] FAIL: ping_idle_ping.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=25612): Process ended prematurely: osmo-stp_10.42.42.5(pid=25612) [trial-2382↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25612)] FAIL: gprs:sysmo+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=25629): Process ended prematurely: osmo-stp_10.42.42.5(pid=25629) [trial-2382↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25629)] FAIL: iperf3.py (8.1 sec) Error: osmo-stp_10.42.42.5(pid=25641): Process ended prematurely: osmo-stp_10.42.42.5(pid=25641) [trial-2382↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25641)] FAIL: iperf3m4.py (11.3 sec) Error: osmo-stp_10.42.42.5(pid=25659): Process ended prematurely: osmo-stp_10.42.42.5(pid=25659) [trial-2382↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25659)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=25669): Process ended prematurely: osmo-stp_10.42.42.5(pid=25669) [trial-2382↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25669)] FAIL: ping_idle_ping.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=25679): Process ended prematurely: osmo-stp_10.42.42.5(pid=25679) [trial-2382↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25679)] FAIL: dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=25693): Process ended prematurely: osmo-stp_10.42.42.5(pid=25693) [trial-2382↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25693)] FAIL: dynts:sysmo+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=25706): Process ended prematurely: osmo-stp_10.42.42.5(pid=25706) [trial-2382↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25706)] FAIL: nitb_sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=25716): Process ended prematurely: osmo-nitb_10.42.42.2(pid=25716) [trial-2382↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25716)] FAIL: sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=25726): Process ended prematurely: osmo-stp_10.42.42.5(pid=25726) [trial-2382↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25726)] FAIL: nitb_ussd:oc2g (fail: 1) FAIL: assert_extension.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=25735): Process ended prematurely: osmo-nitb_10.42.42.2(pid=25735) [trial-2382↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25735)] FAIL: ussd:oc2g (fail: 1) FAIL: assert_extension.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=25745): Process ended prematurely: osmo-stp_10.42.42.5(pid=25745) [trial-2382↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25745)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=25759): Process ended prematurely: osmo-stp_10.42.42.5(pid=25759) [trial-2382↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25759)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=25770): Process ended prematurely: osmo-stp_10.42.42.5(pid=25770) [trial-2382↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25770)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=25784): Process ended prematurely: osmo-stp_10.42.42.5(pid=25784) [trial-2382↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25784)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=25795): Process ended prematurely: osmo-stp_10.42.42.5(pid=25795) [trial-2382↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25795)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=25809): Process ended prematurely: osmo-stp_10.42.42.5(pid=25809) [trial-2382↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25809)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=25820): Process ended prematurely: osmo-stp_10.42.42.5(pid=25820) [trial-2382↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25820)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=25835): Process ended prematurely: osmo-stp_10.42.42.5(pid=25835) [trial-2382↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25835)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=25846): Process ended prematurely: osmo-stp_10.42.42.5(pid=25846) [trial-2382↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25846)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=25861): Process ended prematurely: osmo-stp_10.42.42.5(pid=25861) [trial-2382↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25861)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=25872): Process ended prematurely: osmo-stp_10.42.42.5(pid=25872) [trial-2382↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25872)] FAIL: voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=25886): Process ended prematurely: osmo-stp_10.42.42.5(pid=25886) [trial-2382↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25886)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=25901): Process ended prematurely: osmo-stp_10.42.42.5(pid=25901) [trial-2382↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25901)] FAIL: voice:oc2g+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=25915): Process ended prematurely: osmo-stp_10.42.42.5(pid=25915) [trial-2382↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25915)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=25926): Process ended prematurely: osmo-stp_10.42.42.5(pid=25926) [trial-2382↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25926)] FAIL: emergency:oc2g (fail: 2) FAIL: emergency_mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=25944): Process ended prematurely: osmo-stp_10.42.42.5(pid=25944) [trial-2382↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25944)] FAIL: emergency_preemptive_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=25955): Process ended prematurely: osmo-stp_10.42.42.5(pid=25955) [trial-2382↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25955)] FAIL: gprs:oc2g (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=25973): Process ended prematurely: osmo-stp_10.42.42.5(pid=25973) [trial-2382↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25973)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=25985): Process ended prematurely: osmo-stp_10.42.42.5(pid=25985) [trial-2382↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25985)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=26003): Process ended prematurely: osmo-stp_10.42.42.5(pid=26003) [trial-2382↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26003)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=26013): Process ended prematurely: osmo-stp_10.42.42.5(pid=26013) [trial-2382↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26013)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=26023): Process ended prematurely: osmo-stp_10.42.42.5(pid=26023) [trial-2382↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26023)] FAIL: gprs:oc2g+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=26041): Process ended prematurely: osmo-stp_10.42.42.5(pid=26041) [trial-2382↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26041)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=26053): Process ended prematurely: osmo-stp_10.42.42.5(pid=26053) [trial-2382↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26053)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=26071): Process ended prematurely: osmo-stp_10.42.42.5(pid=26071) [trial-2382↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26071)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=26081): Process ended prematurely: osmo-stp_10.42.42.5(pid=26081) [trial-2382↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26081)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=26091): Process ended prematurely: osmo-stp_10.42.42.5(pid=26091) [trial-2382↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26091)] FAIL: gprs:oc2g+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=26109): Process ended prematurely: osmo-stp_10.42.42.5(pid=26109) [trial-2382↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26109)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=26121): Process ended prematurely: osmo-stp_10.42.42.5(pid=26121) [trial-2382↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26121)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=26139): Process ended prematurely: osmo-stp_10.42.42.5(pid=26139) [trial-2382↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26139)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=26150): Process ended prematurely: osmo-stp_10.42.42.5(pid=26150) [trial-2382↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26150)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=26160): Process ended prematurely: osmo-stp_10.42.42.5(pid=26160) [trial-2382↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26160)] FAIL: gprs:oc2g+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=26177): Process ended prematurely: osmo-stp_10.42.42.5(pid=26177) [trial-2382↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26177)] FAIL: iperf3.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=26485): Process ended prematurely: osmo-stp_10.42.42.5(pid=26485) [trial-2382↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26485)] FAIL: iperf3m4.py (12.4 sec) Error: osmo-stp_10.42.42.5(pid=26504): Process ended prematurely: osmo-stp_10.42.42.5(pid=26504) [trial-2382↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26504)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=26515): Process ended prematurely: osmo-stp_10.42.42.5(pid=26515) [trial-2382↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26515)] FAIL: ping_idle_ping.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=26525): Process ended prematurely: osmo-stp_10.42.42.5(pid=26525) [trial-2382↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26525)] FAIL: dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=26539): Process ended prematurely: osmo-stp_10.42.42.5(pid=26539) [trial-2382↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26539)] FAIL: dynts:oc2g+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=26552): Process ended prematurely: osmo-stp_10.42.42.5(pid=26552) [trial-2382↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26552)] FAIL: nitb_sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=26563): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26563) [trial-2382↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26563)] FAIL: sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=26573): Process ended prematurely: osmo-stp_10.42.42.5(pid=26573) [trial-2382↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26573)] FAIL: nitb_ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=26582): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26582) [trial-2382↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26582)] FAIL: ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=26592): Process ended prematurely: osmo-stp_10.42.42.5(pid=26592) [trial-2382↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26592)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=26606): Process ended prematurely: osmo-stp_10.42.42.5(pid=26606) [trial-2382↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26606)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=26617): Process ended prematurely: osmo-stp_10.42.42.5(pid=26617) [trial-2382↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26617)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=26632): Process ended prematurely: osmo-stp_10.42.42.5(pid=26632) [trial-2382↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26632)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=26643): Process ended prematurely: osmo-stp_10.42.42.5(pid=26643) [trial-2382↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26643)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=26657): Process ended prematurely: osmo-stp_10.42.42.5(pid=26657) [trial-2382↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26657)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=26668): Process ended prematurely: osmo-stp_10.42.42.5(pid=26668) [trial-2382↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26668)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=26684): Process ended prematurely: osmo-stp_10.42.42.5(pid=26684) [trial-2382↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26684)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=26695): Process ended prematurely: osmo-stp_10.42.42.5(pid=26695) [trial-2382↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26695)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=26709): Process ended prematurely: osmo-stp_10.42.42.5(pid=26709) [trial-2382↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26709)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=26720): Process ended prematurely: osmo-stp_10.42.42.5(pid=26720) [trial-2382↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26720)] FAIL: voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=26734): Process ended prematurely: osmo-stp_10.42.42.5(pid=26734) [trial-2382↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26734)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=26745): Process ended prematurely: osmo-stp_10.42.42.5(pid=26745) [trial-2382↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26745)] FAIL: voice:trx-b200+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=26759): Process ended prematurely: osmo-stp_10.42.42.5(pid=26759) [trial-2382↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26759)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=26770): Process ended prematurely: osmo-stp_10.42.42.5(pid=26770) [trial-2382↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26770)] FAIL: voice:trx-b200+mod-bts0-trxdversion0 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=26784): Process ended prematurely: osmo-stp_10.42.42.5(pid=26784) [trial-2382↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26784)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=26795): Process ended prematurely: osmo-stp_10.42.42.5(pid=26795) [trial-2382↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26795)] FAIL: voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=26810): Process ended prematurely: osmo-stp_10.42.42.5(pid=26810) [trial-2382↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26810)] FAIL: mo_mt_call_osmux.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=26821): Process ended prematurely: osmo-stp_10.42.42.5(pid=26821) [trial-2382↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26821)] FAIL: emergency:trx-b200 (fail: 2) FAIL: emergency_mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=26836): Process ended prematurely: osmo-stp_10.42.42.5(pid=26836) [trial-2382↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26836)] FAIL: emergency_preemptive_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=26852): Process ended prematurely: osmo-stp_10.42.42.5(pid=26852) [trial-2382↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26852)] FAIL: gprs:trx-b200 (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=26871): Process ended prematurely: osmo-stp_10.42.42.5(pid=26871) [trial-2382↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26871)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=26884): Process ended prematurely: osmo-stp_10.42.42.5(pid=26884) [trial-2382↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26884)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=26902): Process ended prematurely: osmo-stp_10.42.42.5(pid=26902) [trial-2382↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26902)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=26936): Process ended prematurely: osmo-stp_10.42.42.5(pid=26936) [trial-2382↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26936)] FAIL: ping_idle_ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=26947): Process ended prematurely: osmo-stp_10.42.42.5(pid=26947) [trial-2382↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26947)] FAIL: gprs:trx-b200+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (9.2 sec) Error: osmo-stp_10.42.42.5(pid=26964): Process ended prematurely: osmo-stp_10.42.42.5(pid=26964) [trial-2382↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26964)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=26976): Process ended prematurely: osmo-stp_10.42.42.5(pid=26976) [trial-2382↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26976)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=26994): Process ended prematurely: osmo-stp_10.42.42.5(pid=26994) [trial-2382↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26994)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=27004): Process ended prematurely: osmo-stp_10.42.42.5(pid=27004) [trial-2382↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27004)] FAIL: ping_idle_ping.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=27015): Process ended prematurely: osmo-stp_10.42.42.5(pid=27015) [trial-2382↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27015)] FAIL: gprs:trx-b200+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (9.2 sec) Error: osmo-stp_10.42.42.5(pid=27032): Process ended prematurely: osmo-stp_10.42.42.5(pid=27032) [trial-2382↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27032)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=27044): Process ended prematurely: osmo-stp_10.42.42.5(pid=27044) [trial-2382↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27044)] FAIL: iperf3m4.py (11.6 sec) Error: osmo-stp_10.42.42.5(pid=27062): Process ended prematurely: osmo-stp_10.42.42.5(pid=27062) [trial-2382↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27062)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=27072): Process ended prematurely: osmo-stp_10.42.42.5(pid=27072) [trial-2382↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27072)] FAIL: ping_idle_ping.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=27082): Process ended prematurely: osmo-stp_10.42.42.5(pid=27082) [trial-2382↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27082)] FAIL: gprs:trx-b200+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.4 sec) Error: osmo-stp_10.42.42.5(pid=27100): Process ended prematurely: osmo-stp_10.42.42.5(pid=27100) [trial-2382↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27100)] FAIL: iperf3.py (8.1 sec) Error: osmo-stp_10.42.42.5(pid=27112): Process ended prematurely: osmo-stp_10.42.42.5(pid=27112) [trial-2382↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27112)] FAIL: iperf3m4.py (11.4 sec) Error: osmo-stp_10.42.42.5(pid=27130): Process ended prematurely: osmo-stp_10.42.42.5(pid=27130) [trial-2382↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27130)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=27141): Process ended prematurely: osmo-stp_10.42.42.5(pid=27141) [trial-2382↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27141)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=27151): Process ended prematurely: osmo-stp_10.42.42.5(pid=27151) [trial-2382↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27151)] FAIL: gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=27169): Process ended prematurely: osmo-stp_10.42.42.5(pid=27169) [trial-2382↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27169)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=27182): Process ended prematurely: osmo-stp_10.42.42.5(pid=27182) [trial-2382↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27182)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=27200): Process ended prematurely: osmo-stp_10.42.42.5(pid=27200) [trial-2382↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27200)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=27210): Process ended prematurely: osmo-stp_10.42.42.5(pid=27210) [trial-2382↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27210)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=27220): Process ended prematurely: osmo-stp_10.42.42.5(pid=27220) [trial-2382↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27220)] FAIL: dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=27234): Process ended prematurely: osmo-stp_10.42.42.5(pid=27234) [trial-2382↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27234)] FAIL: dynts:trx-b200+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=27248): Process ended prematurely: osmo-stp_10.42.42.5(pid=27248) [trial-2382↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27248)] FAIL: nitb_sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=27256): Process ended prematurely: osmo-nitb_10.42.42.2(pid=27256) [trial-2382↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27256)] FAIL: sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=27269): Process ended prematurely: osmo-stp_10.42.42.5(pid=27269) [trial-2382↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27269)] FAIL: nitb_ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=27278): Process ended prematurely: osmo-nitb_10.42.42.2(pid=27278) [trial-2382↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27278)] FAIL: ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=27288): Process ended prematurely: osmo-stp_10.42.42.5(pid=27288) [trial-2382↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27288)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=27302): Process ended prematurely: osmo-stp_10.42.42.5(pid=27302) [trial-2382↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27302)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=27313): Process ended prematurely: osmo-stp_10.42.42.5(pid=27313) [trial-2382↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27313)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=27327): Process ended prematurely: osmo-stp_10.42.42.5(pid=27327) [trial-2382↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27327)] FAIL: mo_mt_call_osmux.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=27338): Process ended prematurely: osmo-stp_10.42.42.5(pid=27338) [trial-2382↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27338)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=27352): Process ended prematurely: osmo-stp_10.42.42.5(pid=27352) [trial-2382↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27352)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=27363): Process ended prematurely: osmo-stp_10.42.42.5(pid=27363) [trial-2382↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27363)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=27377): Process ended prematurely: osmo-stp_10.42.42.5(pid=27377) [trial-2382↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27377)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=27388): Process ended prematurely: osmo-stp_10.42.42.5(pid=27388) [trial-2382↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27388)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=27404): Process ended prematurely: osmo-stp_10.42.42.5(pid=27404) [trial-2382↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27404)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=27415): Process ended prematurely: osmo-stp_10.42.42.5(pid=27415) [trial-2382↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27415)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=27429): Process ended prematurely: osmo-stp_10.42.42.5(pid=27429) [trial-2382↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27429)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=27440): Process ended prematurely: osmo-stp_10.42.42.5(pid=27440) [trial-2382↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27440)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=27455): Process ended prematurely: osmo-stp_10.42.42.5(pid=27455) [trial-2382↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27455)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=27466): Process ended prematurely: osmo-stp_10.42.42.5(pid=27466) [trial-2382↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27466)] FAIL: emergency:trx-sysmocell5000 (fail: 2) FAIL: emergency_mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=27480): Process ended prematurely: osmo-stp_10.42.42.5(pid=27480) [trial-2382↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27480)] FAIL: emergency_preemptive_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=27491): Process ended prematurely: osmo-stp_10.42.42.5(pid=27491) [trial-2382↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27491)] FAIL: gprs:trx-sysmocell5000 (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=27509): Process ended prematurely: osmo-stp_10.42.42.5(pid=27509) [trial-2382↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27509)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=27521): Process ended prematurely: osmo-stp_10.42.42.5(pid=27521) [trial-2382↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27521)] FAIL: iperf3m4.py (12.7 sec) Error: osmo-stp_10.42.42.5(pid=27810): Process ended prematurely: osmo-stp_10.42.42.5(pid=27810) [trial-2382↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27810)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=27821): Process ended prematurely: osmo-stp_10.42.42.5(pid=27821) [trial-2382↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27821)] FAIL: ping_idle_ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=27831): Process ended prematurely: osmo-stp_10.42.42.5(pid=27831) [trial-2382↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27831)] FAIL: gprs:trx-sysmocell5000+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (9.1 sec) Error: osmo-stp_10.42.42.5(pid=27848): Process ended prematurely: osmo-stp_10.42.42.5(pid=27848) [trial-2382↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27848)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=27865): Process ended prematurely: osmo-stp_10.42.42.5(pid=27865) [trial-2382↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27865)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=27883): Process ended prematurely: osmo-stp_10.42.42.5(pid=27883) [trial-2382↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27883)] FAIL: ping.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=28177): Process ended prematurely: osmo-stp_10.42.42.5(pid=28177) [trial-2382↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28177)] FAIL: ping_idle_ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=28268): Process ended prematurely: osmo-stp_10.42.42.5(pid=28268) [trial-2382↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28268)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (9.2 sec) Error: osmo-stp_10.42.42.5(pid=28458): Process ended prematurely: osmo-stp_10.42.42.5(pid=28458) [trial-2382↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28458)] FAIL: iperf3.py (8.3 sec) Error: osmo-stp_10.42.42.5(pid=28470): Process ended prematurely: osmo-stp_10.42.42.5(pid=28470) [trial-2382↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28470)] FAIL: iperf3m4.py (11.6 sec) Error: osmo-stp_10.42.42.5(pid=28488): Process ended prematurely: osmo-stp_10.42.42.5(pid=28488) [trial-2382↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28488)] FAIL: ping.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=28498): Process ended prematurely: osmo-stp_10.42.42.5(pid=28498) [trial-2382↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28498)] FAIL: ping_idle_ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=28508): Process ended prematurely: osmo-stp_10.42.42.5(pid=28508) [trial-2382↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28508)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.3 sec) Error: osmo-stp_10.42.42.5(pid=28525): Process ended prematurely: osmo-stp_10.42.42.5(pid=28525) [trial-2382↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28525)] FAIL: iperf3.py (8.0 sec) Error: osmo-stp_10.42.42.5(pid=28537): Process ended prematurely: osmo-stp_10.42.42.5(pid=28537) [trial-2382↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28537)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=28555): Process ended prematurely: osmo-stp_10.42.42.5(pid=28555) [trial-2382↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28555)] FAIL: ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=28565): Process ended prematurely: osmo-stp_10.42.42.5(pid=28565) [trial-2382↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28565)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=28575): Process ended prematurely: osmo-stp_10.42.42.5(pid=28575) [trial-2382↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28575)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=28588): Process ended prematurely: osmo-stp_10.42.42.5(pid=28588) [trial-2382↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28588)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=28602): Process ended prematurely: osmo-stp_10.42.42.5(pid=28602) [trial-2382↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28602)] FAIL: nitb_sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=28612): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28612) [trial-2382↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28612)] FAIL: sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=28622): Process ended prematurely: osmo-stp_10.42.42.5(pid=28622) [trial-2382↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28622)] FAIL: nitb_ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=28631): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28631) [trial-2382↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28631)] FAIL: ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=28641): Process ended prematurely: osmo-stp_10.42.42.5(pid=28641) [trial-2382↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28641)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=28655): Process ended prematurely: osmo-stp_10.42.42.5(pid=28655) [trial-2382↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28655)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=28666): Process ended prematurely: osmo-stp_10.42.42.5(pid=28666) [trial-2382↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28666)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=28680): Process ended prematurely: osmo-stp_10.42.42.5(pid=28680) [trial-2382↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28680)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=28691): Process ended prematurely: osmo-stp_10.42.42.5(pid=28691) [trial-2382↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28691)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=28705): Process ended prematurely: osmo-stp_10.42.42.5(pid=28705) [trial-2382↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28705)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=28717): Process ended prematurely: osmo-stp_10.42.42.5(pid=28717) [trial-2382↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28717)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=28732): Process ended prematurely: osmo-stp_10.42.42.5(pid=28732) [trial-2382↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28732)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=28743): Process ended prematurely: osmo-stp_10.42.42.5(pid=28743) [trial-2382↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28743)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=28758): Process ended prematurely: osmo-stp_10.42.42.5(pid=28758) [trial-2382↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28758)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=28774): Process ended prematurely: osmo-stp_10.42.42.5(pid=28774) [trial-2382↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28774)] FAIL: voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=28788): Process ended prematurely: osmo-stp_10.42.42.5(pid=28788) [trial-2382↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28788)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=28799): Process ended prematurely: osmo-stp_10.42.42.5(pid=28799) [trial-2382↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28799)] FAIL: voice:trx-umtrx+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=28813): Process ended prematurely: osmo-stp_10.42.42.5(pid=28813) [trial-2382↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28813)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=28824): Process ended prematurely: osmo-stp_10.42.42.5(pid=28824) [trial-2382↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28824)] FAIL: voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=28838): Process ended prematurely: osmo-stp_10.42.42.5(pid=28838) [trial-2382↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28838)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=28849): Process ended prematurely: osmo-stp_10.42.42.5(pid=28849) [trial-2382↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28849)] FAIL: emergency:trx-umtrx (fail: 2) FAIL: emergency_mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=28863): Process ended prematurely: osmo-stp_10.42.42.5(pid=28863) [trial-2382↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28863)] FAIL: emergency_preemptive_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=28874): Process ended prematurely: osmo-stp_10.42.42.5(pid=28874) [trial-2382↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28874)] FAIL: gprs:trx-umtrx (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=28892): Process ended prematurely: osmo-stp_10.42.42.5(pid=28892) [trial-2382↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28892)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=28907): Process ended prematurely: osmo-stp_10.42.42.5(pid=28907) [trial-2382↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28907)] FAIL: iperf3m4.py (11.4 sec) Error: osmo-stp_10.42.42.5(pid=28925): Process ended prematurely: osmo-stp_10.42.42.5(pid=28925) [trial-2382↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28925)] FAIL: ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=28935): Process ended prematurely: osmo-stp_10.42.42.5(pid=28935) [trial-2382↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28935)] FAIL: ping_idle_ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=28945): Process ended prematurely: osmo-stp_10.42.42.5(pid=28945) [trial-2382↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28945)] FAIL: gprs:trx-umtrx+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=28964): Process ended prematurely: osmo-stp_10.42.42.5(pid=28964) [trial-2382↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28964)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=28976): Process ended prematurely: osmo-stp_10.42.42.5(pid=28976) [trial-2382↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28976)] FAIL: iperf3m4.py (11.4 sec) Error: osmo-stp_10.42.42.5(pid=28994): Process ended prematurely: osmo-stp_10.42.42.5(pid=28994) [trial-2382↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28994)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=29004): Process ended prematurely: osmo-stp_10.42.42.5(pid=29004) [trial-2382↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29004)] FAIL: ping_idle_ping.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=29014): Process ended prematurely: osmo-stp_10.42.42.5(pid=29014) [trial-2382↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29014)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (9.3 sec) Error: osmo-stp_10.42.42.5(pid=29032): Process ended prematurely: osmo-stp_10.42.42.5(pid=29032) [trial-2382↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29032)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=29044): Process ended prematurely: osmo-stp_10.42.42.5(pid=29044) [trial-2382↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29044)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=29062): Process ended prematurely: osmo-stp_10.42.42.5(pid=29062) [trial-2382↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29062)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=29073): Process ended prematurely: osmo-stp_10.42.42.5(pid=29073) [trial-2382↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29073)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=29083): Process ended prematurely: osmo-stp_10.42.42.5(pid=29083) [trial-2382↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29083)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=29100): Process ended prematurely: osmo-stp_10.42.42.5(pid=29100) [trial-2382↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29100)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=29116): Process ended prematurely: osmo-stp_10.42.42.5(pid=29116) [trial-2382↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29116)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=29134): Process ended prematurely: osmo-stp_10.42.42.5(pid=29134) [trial-2382↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29134)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=29144): Process ended prematurely: osmo-stp_10.42.42.5(pid=29144) [trial-2382↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29144)] FAIL: ping_idle_ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=29154): Process ended prematurely: osmo-stp_10.42.42.5(pid=29154) [trial-2382↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29154)] FAIL: gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (9.3 sec) Error: osmo-stp_10.42.42.5(pid=29172): Process ended prematurely: osmo-stp_10.42.42.5(pid=29172) [trial-2382↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29172)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=29184): Process ended prematurely: osmo-stp_10.42.42.5(pid=29184) [trial-2382↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29184)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=29202): Process ended prematurely: osmo-stp_10.42.42.5(pid=29202) [trial-2382↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29202)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=29212): Process ended prematurely: osmo-stp_10.42.42.5(pid=29212) [trial-2382↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29212)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=29222): Process ended prematurely: osmo-stp_10.42.42.5(pid=29222) [trial-2382↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29222)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=29235): Process ended prematurely: osmo-stp_10.42.42.5(pid=29235) [trial-2382↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29235)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=29248): Process ended prematurely: osmo-stp_10.42.42.5(pid=29248) [trial-2382↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29248)] FAIL: nitb_sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=29256): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29256) [trial-2382↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29256)] FAIL: sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=29266): Process ended prematurely: osmo-stp_10.42.42.5(pid=29266) [trial-2382↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29266)] FAIL: nitb_ussd:trx-lms (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=29275): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29275) [trial-2382↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29275)] FAIL: ussd:trx-lms (fail: 1) FAIL: assert_extension.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=29286): Process ended prematurely: osmo-stp_10.42.42.5(pid=29286) [trial-2382↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29286)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=29301): Process ended prematurely: osmo-stp_10.42.42.5(pid=29301) [trial-2382↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29301)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=29312): Process ended prematurely: osmo-stp_10.42.42.5(pid=29312) [trial-2382↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29312)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=29326): Process ended prematurely: osmo-stp_10.42.42.5(pid=29326) [trial-2382↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29326)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=29337): Process ended prematurely: osmo-stp_10.42.42.5(pid=29337) [trial-2382↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29337)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=29351): Process ended prematurely: osmo-stp_10.42.42.5(pid=29351) [trial-2382↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29351)] FAIL: mo_mt_call_osmux.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=29634): Process ended prematurely: osmo-stp_10.42.42.5(pid=29634) [trial-2382↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29634)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=29648): Process ended prematurely: osmo-stp_10.42.42.5(pid=29648) [trial-2382↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29648)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=29660): Process ended prematurely: osmo-stp_10.42.42.5(pid=29660) [trial-2382↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29660)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=29674): Process ended prematurely: osmo-stp_10.42.42.5(pid=29674) [trial-2382↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29674)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=29686): Process ended prematurely: osmo-stp_10.42.42.5(pid=29686) [trial-2382↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29686)] FAIL: voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=29701): Process ended prematurely: osmo-stp_10.42.42.5(pid=29701) [trial-2382↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29701)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=29712): Process ended prematurely: osmo-stp_10.42.42.5(pid=29712) [trial-2382↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29712)] FAIL: voice:trx-lms+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=29829): Process ended prematurely: osmo-stp_10.42.42.5(pid=29829) [trial-2382↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29829)] FAIL: mo_mt_call_osmux.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=29844): Process ended prematurely: osmo-stp_10.42.42.5(pid=29844) [trial-2382↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29844)] FAIL: emergency:trx-lms (fail: 2) FAIL: emergency_mo_mt_call.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=29858): Process ended prematurely: osmo-stp_10.42.42.5(pid=29858) [trial-2382↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29858)] FAIL: emergency_preemptive_call.py (8.2 sec) Error: osmo-stp_10.42.42.5(pid=29869): Process ended prematurely: osmo-stp_10.42.42.5(pid=29869) [trial-2382↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29869)] FAIL: gprs:trx-lms (fail: 5) FAIL: cs_paging_gprs_active.py (10.0 sec) Error: osmo-stp_10.42.42.5(pid=29887): Process ended prematurely: osmo-stp_10.42.42.5(pid=29887) [trial-2382↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29887)] FAIL: iperf3.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=29899): Process ended prematurely: osmo-stp_10.42.42.5(pid=29899) [trial-2382↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29899)] FAIL: iperf3m4.py (12.5 sec) Error: osmo-stp_10.42.42.5(pid=29917): Process ended prematurely: osmo-stp_10.42.42.5(pid=29917) [trial-2382↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29917)] FAIL: ping.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=29927): Process ended prematurely: osmo-stp_10.42.42.5(pid=29927) [trial-2382↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29927)] FAIL: ping_idle_ping.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=29937): Process ended prematurely: osmo-stp_10.42.42.5(pid=29937) [trial-2382↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29937)] FAIL: gprs:trx-lms+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (10.0 sec) Error: osmo-stp_10.42.42.5(pid=29954): Process ended prematurely: osmo-stp_10.42.42.5(pid=29954) [trial-2382↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29954)] FAIL: iperf3.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=29966): Process ended prematurely: osmo-stp_10.42.42.5(pid=29966) [trial-2382↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29966)] FAIL: iperf3m4.py (12.6 sec) Error: osmo-stp_10.42.42.5(pid=29984): Process ended prematurely: osmo-stp_10.42.42.5(pid=29984) [trial-2382↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29984)] FAIL: ping.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=29994): Process ended prematurely: osmo-stp_10.42.42.5(pid=29994) [trial-2382↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29994)] FAIL: ping_idle_ping.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=30004): Process ended prematurely: osmo-stp_10.42.42.5(pid=30004) [trial-2382↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30004)] FAIL: gprs:trx-lms+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (10.2 sec) Error: osmo-stp_10.42.42.5(pid=30021): Process ended prematurely: osmo-stp_10.42.42.5(pid=30021) [trial-2382↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30021)] FAIL: iperf3.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=30033): Process ended prematurely: osmo-stp_10.42.42.5(pid=30033) [trial-2382↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30033)] FAIL: iperf3m4.py (12.1 sec) Error: osmo-stp_10.42.42.5(pid=30063): Process ended prematurely: osmo-stp_10.42.42.5(pid=30063) [trial-2382↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30063)] FAIL: ping.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=30073): Process ended prematurely: osmo-stp_10.42.42.5(pid=30073) [trial-2382↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30073)] FAIL: ping_idle_ping.py (8.0 sec) Error: osmo-stp_10.42.42.5(pid=30083): Process ended prematurely: osmo-stp_10.42.42.5(pid=30083) [trial-2382↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30083)] FAIL: gprs:trx-lms+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (10.1 sec) Error: osmo-stp_10.42.42.5(pid=30101): Process ended prematurely: osmo-stp_10.42.42.5(pid=30101) [trial-2382↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30101)] FAIL: iperf3.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=30117): Process ended prematurely: osmo-stp_10.42.42.5(pid=30117) [trial-2382↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30117)] FAIL: iperf3m4.py (11.5 sec) Error: osmo-stp_10.42.42.5(pid=30135): Process ended prematurely: osmo-stp_10.42.42.5(pid=30135) [trial-2382↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30135)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=30149): Process ended prematurely: osmo-stp_10.42.42.5(pid=30149) [trial-2382↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30149)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=30160): Process ended prematurely: osmo-stp_10.42.42.5(pid=30160) [trial-2382↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30160)] FAIL: dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=30174): Process ended prematurely: osmo-stp_10.42.42.5(pid=30174) [trial-2382↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30174)] FAIL: dynts:trx-lms+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=30189): Process ended prematurely: osmo-stp_10.42.42.5(pid=30189) [trial-2382↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30189)] FAIL: nitb_sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=30197): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30197) [trial-2382↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30197)] FAIL: sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=30208): Process ended prematurely: osmo-stp_10.42.42.5(pid=30208) [trial-2382↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30208)] FAIL: nitb_ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=30218): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30218) [trial-2382↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30218)] FAIL: ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=30228): Process ended prematurely: osmo-stp_10.42.42.5(pid=30228) [trial-2382↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30228)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=30242): Process ended prematurely: osmo-stp_10.42.42.5(pid=30242) [trial-2382↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30242)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=30253): Process ended prematurely: osmo-stp_10.42.42.5(pid=30253) [trial-2382↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30253)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=30267): Process ended prematurely: osmo-stp_10.42.42.5(pid=30267) [trial-2382↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30267)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=30278): Process ended prematurely: osmo-stp_10.42.42.5(pid=30278) [trial-2382↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30278)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=30292): Process ended prematurely: osmo-stp_10.42.42.5(pid=30292) [trial-2382↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30292)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=30303): Process ended prematurely: osmo-stp_10.42.42.5(pid=30303) [trial-2382↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30303)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=30317): Process ended prematurely: osmo-stp_10.42.42.5(pid=30317) [trial-2382↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30317)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=30328): Process ended prematurely: osmo-stp_10.42.42.5(pid=30328) [trial-2382↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30328)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=30342): Process ended prematurely: osmo-stp_10.42.42.5(pid=30342) [trial-2382↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30342)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=30354): Process ended prematurely: osmo-stp_10.42.42.5(pid=30354) [trial-2382↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30354)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=30368): Process ended prematurely: osmo-stp_10.42.42.5(pid=30368) [trial-2382↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30368)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=30379): Process ended prematurely: osmo-stp_10.42.42.5(pid=30379) [trial-2382↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30379)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=30394): Process ended prematurely: osmo-stp_10.42.42.5(pid=30394) [trial-2382↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30394)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=30405): Process ended prematurely: osmo-stp_10.42.42.5(pid=30405) [trial-2382↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30405)] FAIL: emergency:trx-lms-limenet-micro (fail: 2) FAIL: emergency_mo_mt_call.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=30420): Process ended prematurely: osmo-stp_10.42.42.5(pid=30420) [trial-2382↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30420)] FAIL: emergency_preemptive_call.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=30431): Process ended prematurely: osmo-stp_10.42.42.5(pid=30431) [trial-2382↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30431)] FAIL: gprs:trx-lms-limenet-micro (fail: 5) FAIL: cs_paging_gprs_active.py (9.4 sec) Error: osmo-stp_10.42.42.5(pid=30450): Process ended prematurely: osmo-stp_10.42.42.5(pid=30450) [trial-2382↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30450)] FAIL: iperf3.py (8.0 sec) Error: osmo-stp_10.42.42.5(pid=30464): Process ended prematurely: osmo-stp_10.42.42.5(pid=30464) [trial-2382↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30464)] FAIL: iperf3m4.py (11.6 sec) Error: osmo-stp_10.42.42.5(pid=30482): Process ended prematurely: osmo-stp_10.42.42.5(pid=30482) [trial-2382↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30482)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=30495): Process ended prematurely: osmo-stp_10.42.42.5(pid=30495) [trial-2382↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30495)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=30505): Process ended prematurely: osmo-stp_10.42.42.5(pid=30505) [trial-2382↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30505)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (9.2 sec) Error: osmo-stp_10.42.42.5(pid=30522): Process ended prematurely: osmo-stp_10.42.42.5(pid=30522) [trial-2382↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30522)] FAIL: iperf3.py (8.0 sec) Error: osmo-stp_10.42.42.5(pid=30534): Process ended prematurely: osmo-stp_10.42.42.5(pid=30534) [trial-2382↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30534)] FAIL: iperf3m4.py (11.3 sec) Error: osmo-stp_10.42.42.5(pid=30555): Process ended prematurely: osmo-stp_10.42.42.5(pid=30555) [trial-2382↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30555)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=30565): Process ended prematurely: osmo-stp_10.42.42.5(pid=30565) [trial-2382↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30565)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=30575): Process ended prematurely: osmo-stp_10.42.42.5(pid=30575) [trial-2382↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30575)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=30592): Process ended prematurely: osmo-stp_10.42.42.5(pid=30592) [trial-2382↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30592)] FAIL: iperf3.py (8.0 sec) Error: osmo-stp_10.42.42.5(pid=30604): Process ended prematurely: osmo-stp_10.42.42.5(pid=30604) [trial-2382↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30604)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=30622): Process ended prematurely: osmo-stp_10.42.42.5(pid=30622) [trial-2382↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30622)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=30632): Process ended prematurely: osmo-stp_10.42.42.5(pid=30632) [trial-2382↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30632)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=30642): Process ended prematurely: osmo-stp_10.42.42.5(pid=30642) [trial-2382↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30642)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=30661): Process ended prematurely: osmo-stp_10.42.42.5(pid=30661) [trial-2382↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30661)] FAIL: iperf3.py (8.1 sec) Error: osmo-stp_10.42.42.5(pid=30673): Process ended prematurely: osmo-stp_10.42.42.5(pid=30673) [trial-2382↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30673)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=30691): Process ended prematurely: osmo-stp_10.42.42.5(pid=30691) [trial-2382↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30691)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=30701): Process ended prematurely: osmo-stp_10.42.42.5(pid=30701) [trial-2382↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30701)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=30711): Process ended prematurely: osmo-stp_10.42.42.5(pid=30711) [trial-2382↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30711)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=30724): Process ended prematurely: osmo-stp_10.42.42.5(pid=30724) [trial-2382↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30724)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=30738): Process ended prematurely: osmo-stp_10.42.42.5(pid=30738) [trial-2382↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30738)] FAIL: nitb_sms:nanobts (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=31017): Process ended prematurely: osmo-nitb_10.42.42.2(pid=31017) [trial-2382↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31017)] FAIL: sms:nanobts+band-1900 (fail: 1) FAIL: mo_mt_sms.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=31027): Process ended prematurely: osmo-stp_10.42.42.5(pid=31027) [trial-2382↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31027)] FAIL: nitb_ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=31037): Process ended prematurely: osmo-nitb_10.42.42.2(pid=31037) [trial-2382↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31037)] FAIL: ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=31047): Process ended prematurely: osmo-stp_10.42.42.5(pid=31047) [trial-2382↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31047)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=31062): Process ended prematurely: osmo-stp_10.42.42.5(pid=31062) [trial-2382↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31062)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=31074): Process ended prematurely: osmo-stp_10.42.42.5(pid=31074) [trial-2382↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31074)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=31088): Process ended prematurely: osmo-stp_10.42.42.5(pid=31088) [trial-2382↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31088)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=31102): Process ended prematurely: osmo-stp_10.42.42.5(pid=31102) [trial-2382↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31102)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=31116): Process ended prematurely: osmo-stp_10.42.42.5(pid=31116) [trial-2382↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31116)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=31127): Process ended prematurely: osmo-stp_10.42.42.5(pid=31127) [trial-2382↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31127)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=31141): Process ended prematurely: osmo-stp_10.42.42.5(pid=31141) [trial-2382↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31141)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=31152): Process ended prematurely: osmo-stp_10.42.42.5(pid=31152) [trial-2382↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31152)] FAIL: voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=31166): Process ended prematurely: osmo-stp_10.42.42.5(pid=31166) [trial-2382↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31166)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=31177): Process ended prematurely: osmo-stp_10.42.42.5(pid=31177) [trial-2382↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31177)] FAIL: emergency:nanobts+band-1900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=31192): Process ended prematurely: osmo-stp_10.42.42.5(pid=31192) [trial-2382↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31192)] FAIL: emergency_preemptive_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=31203): Process ended prematurely: osmo-stp_10.42.42.5(pid=31203) [trial-2382↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31203)] FAIL: gprs:nanobts+band-1900 (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=31222): Process ended prematurely: osmo-stp_10.42.42.5(pid=31222) [trial-2382↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31222)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=31234): Process ended prematurely: osmo-stp_10.42.42.5(pid=31234) [trial-2382↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31234)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=31254): Process ended prematurely: osmo-stp_10.42.42.5(pid=31254) [trial-2382↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31254)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=31264): Process ended prematurely: osmo-stp_10.42.42.5(pid=31264) [trial-2382↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31264)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=31274): Process ended prematurely: osmo-stp_10.42.42.5(pid=31274) [trial-2382↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31274)] FAIL: gprs:nanobts+band-1900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=31291): Process ended prematurely: osmo-stp_10.42.42.5(pid=31291) [trial-2382↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31291)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=31303): Process ended prematurely: osmo-stp_10.42.42.5(pid=31303) [trial-2382↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31303)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=31321): Process ended prematurely: osmo-stp_10.42.42.5(pid=31321) [trial-2382↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31321)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=31331): Process ended prematurely: osmo-stp_10.42.42.5(pid=31331) [trial-2382↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31331)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=31342): Process ended prematurely: osmo-stp_10.42.42.5(pid=31342) [trial-2382↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31342)] FAIL: gprs:nanobts+band-1900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=31360): Process ended prematurely: osmo-stp_10.42.42.5(pid=31360) [trial-2382↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31360)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=31372): Process ended prematurely: osmo-stp_10.42.42.5(pid=31372) [trial-2382↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31372)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=31390): Process ended prematurely: osmo-stp_10.42.42.5(pid=31390) [trial-2382↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31390)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=31401): Process ended prematurely: osmo-stp_10.42.42.5(pid=31401) [trial-2382↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31401)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=31412): Process ended prematurely: osmo-stp_10.42.42.5(pid=31412) [trial-2382↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31412)] FAIL: dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=31425): Process ended prematurely: osmo-stp_10.42.42.5(pid=31425) [trial-2382↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31425)] FAIL: sms:nanobts+band-900 (fail: 1) FAIL: mo_mt_sms.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=31439): Process ended prematurely: osmo-stp_10.42.42.5(pid=31439) [trial-2382↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31439)] FAIL: nitb_ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=31451): Process ended prematurely: osmo-nitb_10.42.42.2(pid=31451) [trial-2382↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31451)] FAIL: ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=31461): Process ended prematurely: osmo-stp_10.42.42.5(pid=31461) [trial-2382↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31461)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=31475): Process ended prematurely: osmo-stp_10.42.42.5(pid=31475) [trial-2382↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31475)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=31486): Process ended prematurely: osmo-stp_10.42.42.5(pid=31486) [trial-2382↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31486)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=31500): Process ended prematurely: osmo-stp_10.42.42.5(pid=31500) [trial-2382↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31500)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=31511): Process ended prematurely: osmo-stp_10.42.42.5(pid=31511) [trial-2382↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31511)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=31525): Process ended prematurely: osmo-stp_10.42.42.5(pid=31525) [trial-2382↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31525)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=31536): Process ended prematurely: osmo-stp_10.42.42.5(pid=31536) [trial-2382↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31536)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=31550): Process ended prematurely: osmo-stp_10.42.42.5(pid=31550) [trial-2382↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31550)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=31561): Process ended prematurely: osmo-stp_10.42.42.5(pid=31561) [trial-2382↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31561)] FAIL: voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=31575): Process ended prematurely: osmo-stp_10.42.42.5(pid=31575) [trial-2382↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31575)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=31586): Process ended prematurely: osmo-stp_10.42.42.5(pid=31586) [trial-2382↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31586)] FAIL: voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=31601): Process ended prematurely: osmo-stp_10.42.42.5(pid=31601) [trial-2382↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31601)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=31612): Process ended prematurely: osmo-stp_10.42.42.5(pid=31612) [trial-2382↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31612)] FAIL: emergency:nanobts+band-900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=31626): Process ended prematurely: osmo-stp_10.42.42.5(pid=31626) [trial-2382↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31626)] FAIL: emergency_preemptive_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=31637): Process ended prematurely: osmo-stp_10.42.42.5(pid=31637) [trial-2382↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31637)] FAIL: gprs:nanobts+band-900 (fail: 5) FAIL: cs_paging_gprs_active.py (9.2 sec) Error: osmo-stp_10.42.42.5(pid=31655): Process ended prematurely: osmo-stp_10.42.42.5(pid=31655) [trial-2382↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31655)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=31667): Process ended prematurely: osmo-stp_10.42.42.5(pid=31667) [trial-2382↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31667)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=31692): Process ended prematurely: osmo-stp_10.42.42.5(pid=31692) [trial-2382↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31692)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=31702): Process ended prematurely: osmo-stp_10.42.42.5(pid=31702) [trial-2382↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31702)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=31712): Process ended prematurely: osmo-stp_10.42.42.5(pid=31712) [trial-2382↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31712)] FAIL: gprs:nanobts+band-900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=31730): Process ended prematurely: osmo-stp_10.42.42.5(pid=31730) [trial-2382↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31730)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=31742): Process ended prematurely: osmo-stp_10.42.42.5(pid=31742) [trial-2382↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31742)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=31760): Process ended prematurely: osmo-stp_10.42.42.5(pid=31760) [trial-2382↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31760)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=31770): Process ended prematurely: osmo-stp_10.42.42.5(pid=31770) [trial-2382↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31770)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=31780): Process ended prematurely: osmo-stp_10.42.42.5(pid=31780) [trial-2382↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31780)] FAIL: gprs:nanobts+band-900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=31800): Process ended prematurely: osmo-stp_10.42.42.5(pid=31800) [trial-2382↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31800)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=31813): Process ended prematurely: osmo-stp_10.42.42.5(pid=31813) [trial-2382↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31813)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=31833): Process ended prematurely: osmo-stp_10.42.42.5(pid=31833) [trial-2382↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31833)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=31843): Process ended prematurely: osmo-stp_10.42.42.5(pid=31843) [trial-2382↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31843)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=31853): Process ended prematurely: osmo-stp_10.42.42.5(pid=31853) [trial-2382↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31853)] FAIL: gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=31870): Process ended prematurely: osmo-stp_10.42.42.5(pid=31870) [trial-2382↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31870)] FAIL: iperf3.py (8.1 sec) Error: osmo-stp_10.42.42.5(pid=31882): Process ended prematurely: osmo-stp_10.42.42.5(pid=31882) [trial-2382↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31882)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=31900): Process ended prematurely: osmo-stp_10.42.42.5(pid=31900) [trial-2382↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31900)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=31910): Process ended prematurely: osmo-stp_10.42.42.5(pid=31910) [trial-2382↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31910)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=31920): Process ended prematurely: osmo-stp_10.42.42.5(pid=31920) [trial-2382↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31920)] FAIL: dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=31933): Process ended prematurely: osmo-stp_10.42.42.5(pid=31933) [trial-2382↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31933)] FAIL: nitb_smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (2.4 sec) Error: osmo-nitb_10.42.42.2(pid=31941): Process ended prematurely: osmo-nitb_10.42.42.2(pid=31941) [trial-2382↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31941)] FAIL: esme_connect_policy_closed.py (2.1 sec) Error: osmo-nitb_10.42.42.2(pid=31943): Process ended prematurely: osmo-nitb_10.42.42.2(pid=31943) [trial-2382↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31943)] FAIL: esme_ms_sms_storeforward.py (3.0 sec) Error: osmo-nitb_10.42.42.2(pid=31945): Process ended prematurely: osmo-nitb_10.42.42.2(pid=31945) [trial-2382↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31945)] FAIL: esme_ms_sms_transaction.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=31947): Process ended prematurely: osmo-nitb_10.42.42.2(pid=31947) [trial-2382↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31947)] FAIL: smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (5.5 sec) Error: osmo-hlr_10.42.42.2(pid=31958): Process ended prematurely: osmo-hlr_10.42.42.2(pid=31958) [trial-2382↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31958)] FAIL: esme_connect_policy_closed.py (6.1 sec) Error: osmo-hlr_10.42.42.2(pid=31969): Process ended prematurely: osmo-hlr_10.42.42.2(pid=31969) [trial-2382↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31969)] FAIL: esme_ms_sms_storeforward.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=31981): Process ended prematurely: osmo-stp_10.42.42.5(pid=31981) [trial-2382↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31981)] FAIL: esme_ms_sms_transaction.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=31992): Process ended prematurely: osmo-stp_10.42.42.5(pid=31992) [trial-2382↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31992)] FAIL: encryption (fail: 4) FAIL: register_a5_0_authopt.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=32006): Process ended prematurely: osmo-stp_10.42.42.5(pid=32006) [trial-2382↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32006)] FAIL: register_a5_0_authreq.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=32017): Process ended prematurely: osmo-stp_10.42.42.5(pid=32017) [trial-2382↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32017)] FAIL: register_a5_1_authreq.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=32028): Process ended prematurely: osmo-stp_10.42.42.5(pid=32028) [trial-2382↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32028)] FAIL: register_a5_3_authreq.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=32039): Process ended prematurely: osmo-stp_10.42.42.5(pid=32039) [trial-2382↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32039)] FAIL: 4g:srsenb-rftype@zmq+srsue-rftype@zmq (fail: 7) FAIL: handover.py (21.1 sec) Error: srsepc(pid=32059): Process ended prematurely: srsepc(pid=32059) [trial-2382↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=32059)] FAIL: iperf3_bidir.py (19.8 sec) Error: srsepc(pid=32347): Process ended prematurely: srsepc(pid=32347) [trial-2382↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=32347)] FAIL: iperf3_dl.py (18.5 sec) Error: srsepc(pid=32363): Process ended prematurely: srsepc(pid=32363) [trial-2382↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=32363)] FAIL: iperf3_ul.py (18.5 sec) Error: srsepc(pid=32380): Process ended prematurely: srsepc(pid=32380) [trial-2382↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=32380)] FAIL: ping.py (18.1 sec) Error: srsepc(pid=32399): Process ended prematurely: srsepc(pid=32399) [trial-2382↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=32399)] FAIL: rrc_idle_mo_ping.py (18.2 sec) Error: srsepc(pid=32416): Process ended prematurely: srsepc(pid=32416) [trial-2382↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=32416)] FAIL: rrc_idle_mt_ping.py (18.6 sec) Error: srsepc(pid=32435): Process ended prematurely: srsepc(pid=32435) [trial-2382↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=32435)] FAIL: handover_2G:nanobts+bts1-oc2g (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=32448): Process ended prematurely: osmo-stp_10.42.42.5(pid=32448) [trial-2382↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32448)] FAIL: handover_2G:nanobts+bts1-octphy (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=32462): Process ended prematurely: osmo-stp_10.42.42.5(pid=32462) [trial-2382↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32462)] FAIL: handover_2G:nanobts+bts1-trx-lms (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=32477): Process ended prematurely: osmo-stp_10.42.42.5(pid=32477) [trial-2382↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32477)] FAIL: handover_2G:nanobts+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=32491): Process ended prematurely: osmo-stp_10.42.42.5(pid=32491) [trial-2382↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32491)] FAIL: handover_2G:nanobts+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=32505): Process ended prematurely: osmo-stp_10.42.42.5(pid=32505) [trial-2382↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32505)] FAIL: handover_2G:nanobts+bts1-sysmo (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=32519): Process ended prematurely: osmo-stp_10.42.42.5(pid=32519) [trial-2382↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32519)] FAIL: handover_2G:nanobts+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=32533): Process ended prematurely: osmo-stp_10.42.42.5(pid=32533) [trial-2382↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32533)] FAIL: handover_2G:nanobts+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=32547): Process ended prematurely: osmo-stp_10.42.42.5(pid=32547) [trial-2382↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32547)] FAIL: handover_2G:oc2g+bts1-octphy (fail: 1) FAIL: handover.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=32561): Process ended prematurely: osmo-stp_10.42.42.5(pid=32561) [trial-2382↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32561)] FAIL: handover_2G:oc2g+bts1-trx-lms (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=32575): Process ended prematurely: osmo-stp_10.42.42.5(pid=32575) [trial-2382↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32575)] FAIL: handover_2G:oc2g+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=32589): Process ended prematurely: osmo-stp_10.42.42.5(pid=32589) [trial-2382↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32589)] FAIL: handover_2G:oc2g+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=32603): Process ended prematurely: osmo-stp_10.42.42.5(pid=32603) [trial-2382↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32603)] FAIL: handover_2G:oc2g+bts1-sysmo (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=32617): Process ended prematurely: osmo-stp_10.42.42.5(pid=32617) [trial-2382↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32617)] FAIL: handover_2G:oc2g+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=32631): Process ended prematurely: osmo-stp_10.42.42.5(pid=32631) [trial-2382↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32631)] FAIL: handover_2G:oc2g+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=32645): Process ended prematurely: osmo-stp_10.42.42.5(pid=32645) [trial-2382↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32645)] FAIL: handover_2G:octphy+bts1-trx-lms (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=32659): Process ended prematurely: osmo-stp_10.42.42.5(pid=32659) [trial-2382↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32659)] FAIL: handover_2G:octphy+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=32673): Process ended prematurely: osmo-stp_10.42.42.5(pid=32673) [trial-2382↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32673)] FAIL: handover_2G:octphy+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=32687): Process ended prematurely: osmo-stp_10.42.42.5(pid=32687) [trial-2382↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32687)] FAIL: handover_2G:octphy+bts1-sysmo (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=32701): Process ended prematurely: osmo-stp_10.42.42.5(pid=32701) [trial-2382↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32701)] FAIL: handover_2G:octphy+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=32715): Process ended prematurely: osmo-stp_10.42.42.5(pid=32715) [trial-2382↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32715)] FAIL: handover_2G:octphy+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=32729): Process ended prematurely: osmo-stp_10.42.42.5(pid=32729) [trial-2382↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32729)] FAIL: handover_2G:trx-lms+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=32746): Process ended prematurely: osmo-stp_10.42.42.5(pid=32746) [trial-2382↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32746)] FAIL: handover_2G:trx-lms+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=32760): Process ended prematurely: osmo-stp_10.42.42.5(pid=32760) [trial-2382↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32760)] FAIL: handover_2G:trx-lms+bts1-sysmo (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=306): Process ended prematurely: osmo-stp_10.42.42.5(pid=306) [trial-2382↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=306)] FAIL: handover_2G:trx-lms+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=321): Process ended prematurely: osmo-stp_10.42.42.5(pid=321) [trial-2382↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=321)] FAIL: handover_2G:trx-lms+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=335): Process ended prematurely: osmo-stp_10.42.42.5(pid=335) [trial-2382↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=335)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=356): Process ended prematurely: osmo-stp_10.42.42.5(pid=356) [trial-2382↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=356)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-sysmo (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=376): Process ended prematurely: osmo-stp_10.42.42.5(pid=376) [trial-2382↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=376)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=391): Process ended prematurely: osmo-stp_10.42.42.5(pid=391) [trial-2382↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=391)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=405): Process ended prematurely: osmo-stp_10.42.42.5(pid=405) [trial-2382↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=405)] FAIL: handover_2G:trx-sysmocell5000+bts1-sysmo (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=419): Process ended prematurely: osmo-stp_10.42.42.5(pid=419) [trial-2382↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=419)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=434): Process ended prematurely: osmo-stp_10.42.42.5(pid=434) [trial-2382↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=434)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=448): Process ended prematurely: osmo-stp_10.42.42.5(pid=448) [trial-2382↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=448)] FAIL: handover_2G:sysmo+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=462): Process ended prematurely: osmo-stp_10.42.42.5(pid=462) [trial-2382↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=462)] FAIL: handover_2G:sysmo+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=476): Process ended prematurely: osmo-stp_10.42.42.5(pid=476) [trial-2382↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=476)] FAIL: handover_2G:trx-b200+bts1-trx-umtrx (fail: 1) FAIL: handover.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=490): Process ended prematurely: osmo-stp_10.42.42.5(pid=490) [trial-2382↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=490)] + rm -rf trial-2382/inst + cd trial-2382 + command -v journalctl + [ ! -z /bin/journalctl ] + readlink last_run + journalctl -u ofono -o short-precise --since 2022-12-12 20:36:22 + readlink last_run + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382-run.tgz run.2022-12-12_20-36-34 + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2382-bin.tgz checksums.md5 open5gs.build-8.tgz osmo-bsc.build-17675.tgz osmo-bts-oc2g.build-5534.tgz osmo-bts-sysmo.build-8038.tgz osmo-bts.build-7507.tgz osmo-ggsn.build-6687.tgz osmo-hlr.build-8711.tgz osmo-hnbgw.build-2978.tgz osmo-mgw.build-8956.tgz osmo-msc.build-29296.tgz osmo-nitb.build-12985.tgz osmo-pcu-oc2g.build-3909.tgz osmo-pcu-sysmo.build-5191.tgz osmo-pcu.build-5152.tgz osmo-sgsn.build-30079.tgz osmo-stp.build-9252.tgz osmo-trx.build-4679.tgz osmocom-bb.build-4707.tgz srslte.build-19.tgz + exit 1 Build step 'Execute shell' marked build as failure Archiving artifacts Recording test results [Checks API] No suitable checks publisher found. Sending e-mails to: pespin@sysmocom.de Finished: FAILURE